Cognitive Chain-of-Thought (CoCoT): Structured Multimodal Reasoning about Social Situations

arXiv:2507.20409 · cs.CL, cs.AI, cs.CY · Submitted 2025-07-27 · Read on arXiv

cs.CL, cs.AI, cs.CY

Submitted: 2025-07-27

Updated: 2026-08-28

Terminology

• Trace — 51× in this paper · explained in 2 episodes
• Benchmark — 38× in this paper · explained in 2 episodes
• Accuracy — 21× in this paper · explained in 1 episode
• Grounding — 16× in this paper · explained in 3 episodes
• Structured Reasoning — 12× in this paper · explained in 3 episodes
• Ablation — 11× in this paper · explained in 1 episode
• Fine-Tuning — 10× in this paper · explained in 5 episodes
• Scaffolding — 8× in this paper · explained in 3 episodes
• Interpretability — 7× in this paper · explained in 15 episodes
• Reasoning Traces — 7× in this paper · explained in 3 episodes
• Abstraction — 6× in this paper · explained in 1 episode
• Chain-of-Thought (CoT) — 5× in this paper · explained in 4 episodes
• Multimodal Reasoning — 5× in this paper · explained in 5 episodes
• Chain-of-Thought (CoT) Prompting — 4× in this paper · explained in 3 episodes
• Thinking mode — 4× in this paper · explained in 2 episodes
• Visual Grounding — 4× in this paper · explained in 2 episodes
• Robustness — 3× in this paper · explained in 5 episodes
• Alignment — 2× in this paper · explained in 1 episode
• Annotator Agreement — 2× in this paper · explained in 1 episode
• Calibration — 2× in this paper · explained in 7 episodes
• Generalizability — 2× in this paper · explained in 6 episodes
• Hallucination — 2× in this paper · explained in 3 episodes
• Regret — 2× in this paper · explained in 3 episodes
• Structured Prompting — 2× in this paper · explained in 2 episodes
• Transferability — 2× in this paper · explained in 4 episodes
• AI Agents — 1× in this paper · explained in 2 episodes
• Ablation Studies — 1× in this paper · explained in 1 episode
• Accountability — 1× in this paper · explained in 2 episodes
• Adaptive Reasoning — 1× in this paper · explained in 2 episodes
• Benchmarking — 1× in this paper · explained in 3 episodes
• Chain-of-Thought Prompting — 1× in this paper · explained in 2 episodes
• Cognitive Scaffolding — 1× in this paper · explained in 3 episodes
• Consistency — 1× in this paper · explained in 3 episodes
• Data Augmentation — 1× in this paper · explained in 7 episodes
• Error Localization — 1× in this paper · explained in 2 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• Foundation Models — 1× in this paper · explained in 7 episodes
• Information Asymmetry — 1× in this paper · explained in 2 episodes
• Prompt Engineering — 1× in this paper · explained in 4 episodes
• Self-consistency — 1× in this paper · explained in 2 episodes
• Task Decomposition — 1× in this paper · explained in 2 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
• Complexity-Based Prompting for Multi-Step Reasoning
• Measuring Faithfulness in Chain-of-Thought Reasoning
• Critical or Compliant? The Double-Edged Sword of Reasoning in Chain-of-Thought Explanations
• Visual Chain of Thought: Bridging Logical Gaps with Multimodal Infillings
• Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models
• MM-MoralBench: A MultiModal Moral Evaluation Benchmark for Large Vision-Language Models
• MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action
• Social World Models

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering