ScreenHaystack: Finding Blind Zones in GUI Grounding

arXiv:2609.32036 · cs.CV · Submitted 2026-09-25 · Read on arXiv

cs.CV

Submitted: 2026-09-25

Updated: 2026-09-25

Code: https://github.com/mlfoundations/gelato

Terminology

Accuracy — 114× in this paper · explained in 1 episode
Grounding — 81× in this paper · explained in 3 episodes
Fine-Tuning — 19× in this paper · explained in 5 episodes
Benchmark — 18× in this paper · explained in 2 episodes
Calibration — 7× in this paper · explained in 7 episodes
Generalization — 3× in this paper · explained in 13 episodes
Actor — 2× in this paper · explained in 3 episodes
Core — 2× in this paper · explained in 2 episodes
Robustness — 2× in this paper · explained in 5 episodes
Test-time Scaling — 2× in this paper · explained in 2 episodes
Visual Grounding — 2× in this paper · explained in 2 episodes
Aggregation — 1× in this paper · explained in 1 episode
Alignment — 1× in this paper · explained in 1 episode
Consistency — 1× in this paper · explained in 3 episodes
LoRA Adapters — 1× in this paper · explained in 3 episodes
Reinforcement Learning — 1× in this paper · explained in 4 episodes

Sources

Related papers