The day in conversation for 2026-10-21
discussion
Transcript
The discussion: Tom: That 43% video-level accuracy for EVID-Bench is pretty concerning. It suggests that even with a robust search mechanism, the systems are fundamentally failing to connect the dots when the ground truth isn't perfectly present in the immediate vicinity of the manipulated footage. Jane: I agree. And it brings back that same issue we saw last week with editorial splicing detection—where models mislabel genuine editing as manipulation because they can't fully contextualize where the *real* evidence should be. It seems like search-grounded verification introduces a whole new layer of ambiguity because the necessary verification anchors are outside the video frame entirely. Lu: Exactly. We’re moving from detecting internal inconsistencies—like audio glitches or frame skips—to needing external, real-time knowledge retrieval to validate claims, and the system breaks down precisely where that retrieval is imperfect or irrelevant. It's not a failure of detection so much as a failure of scope. Meng: I think the problem is compounded by how these frontier multimodal models are trained. They seem hyper-focused on the immediate visual evidence they *can* process, ignoring those peripheral search results because they aren't weighted correctly against the primary video content. They’re getting distracted by irrelevant anchors, as the summary mentioned. Lalam: So if we look at this through the lens of our previous work on single-source editing versus multi-source editing, it seems like search grounding is a multi-source problem taken to an extreme. We can handle two sources within a known context, but here we require an infinite pool of external evidence that the model
More episodes
- 2506.10974-AutoMind: Adaptive Knowledgeable Agent for Automated Data Science
- 2507.14056-Dynamic gain neuromodulation attenuates stability gaps during continual joint training
- 2508.03411-SlotMatch: Distilling Object-Centric Representations for Unsupervised Video Segmentation
- 2509.09009-Open-sci-ref-0.02: open reference baselines for reproducible language model and dataset comparison
- 2512.14554-VLegal-Bench: Cognitively Grounded Benchmark for Vietnamese Legal Reasoning of Large Language Models
- 2601.10960-Steering Language Models Before They Speak: Logit-Level Interventions
- 2602.03802-Do We Need Asynchronous SGD? On the Near-Optimality of Synchronous Methods
- 2603.05735-Agentic AI -- Physicist Collaboration in Experimental Particle Physics: A Proof-of-Concept Measurement with LEP Open Data
- 2602.04805-Skin Tokens: A Learned Compact Representation for Unified Autoregressive Rigging
- 2603.16423-SF-Mamba: Rethinking State Space Model for Vision