Sci-Rho: A Multilingual Visually-Grounded Symbolic Benchmark for STEM Problems

arXiv:2606.08034 · cs.CV, cs.AI, cs.CL · Submitted 2026-06-06 · Read on arXiv

cs.CV, cs.AI, cs.CL

Submitted: 2026-06-06

Updated: 2026-09-26

Terminology

• Benchmark — 31× in this paper · explained in 2 episodes
• Accuracy — 26× in this paper · explained in 1 episode
• Robustness — 11× in this paper · explained in 5 episodes
• Grounding — 5× in this paper · explained in 3 episodes
• Verification — 5× in this paper · explained in 2 episodes
• Adam — 3× in this paper · explained in 2 episodes
• Consistency — 3× in this paper · explained in 3 episodes
• Trace — 3× in this paper · explained in 2 episodes
• Visual Grounding — 3× in this paper · explained in 2 episodes
• Benchmarking — 2× in this paper · explained in 3 episodes
• F1 Score — 2× in this paper · explained in 3 episodes
• Hallucination — 2× in this paper · explained in 3 episodes
• Image Attention Ratio — 2× in this paper
• LLM judge — 2× in this paper · explained in 2 episodes
• Vision-Language Models (VLMs) — 2× in this paper · explained in 6 episodes
• Alignment — 1× in this paper · explained in 1 episode
• Core — 1× in this paper · explained in 2 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• Foundation Models — 1× in this paper · explained in 7 episodes
• In-Context Learning — 1× in this paper · explained in 4 episodes
• Mixture-of-Experts (MoE) — 1× in this paper · explained in 7 episodes
• Multimodal Reasoning — 1× in this paper · explained in 5 episodes
• Prompt Engineering — 1× in this paper · explained in 4 episodes

Sources

• Qwen3-VL Technical Report
• True Multimodal In-Context Learning Needs Attention to the Visual Context
• Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding
• Words or Vision: Do Vision-Language Models Have Blind Faith in Text?
• EngTrace: A Symbolic Benchmark for Verifiable Process Supervision of Engineering Reasoning
• SciVerse: Unveiling the Knowledge Comprehension and Visual Reasoning of LMMs on Multi-modal Scientific Problems
• Vision Language Models are Confused Tourists
• Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering
• MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
• GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models
• PHYBench: Holistic Evaluation of Physical Perception and Reasoning in Large Language Models
• VGRP-Bench: Visual Grid Reasoning Puzzle Benchmark for Large Vision-Language Models
• OpenAI GPT-5 System Card
• Gemma 3 Technical Report
• Vision Language Models are Biased
• InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency
• SeePhys: Does Seeing Help Thinking? -- Benchmarking Vision-Based Physics Reasoning
• FinChain: A Symbolic Benchmark for Verifiable Chain-of-Thought Financial Reasoning
• Refusal Falls off a Cliff: How Safety Alignment Fails in Reasoning?
• PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoning

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models