Stress-Query and Temporal Reliability of Vision-Language Models as copilots in Autonomous UAV Navigation

arXiv:2610.23877 · cs.RO · Submitted 2026-09-21 · Read on arXiv

cs.RO

Submitted: 2026-09-21

Updated: 2026-09-21

Comments: Paper accepted at the Latin American Robotics Symposium LARS 2026

License: http://creativecommons.org/licenses/by/4.0/

The gist: Integrating Vision-Language Models (VLMs) into autonomous UAV navigation enables high-level semantic reasoning but introduces critical temporal bottlenecks that can destabilize flight control.

Terminology

Abstract

Integrating Vision-Language Models (VLMs) into autonomous UAV navigation enables high-level semantic reasoning but introduces critical temporal bottlenecks that can destabilize flight control. This paper presents a systematic benchmark that evaluates the operational trade-offs among model scale, hardware constraints, and flight reliability. By subjecting the system to extensive stress tests on both a high-performance workstation and a constrained integrated-graphics laptop, we isolate the kinetic impact of inference latency against reasoning accuracy. Our findings reveal a performance dichotomy: lightweight models struggle with structural hallucinations that break deterministic state machines, while heavyweight models induce trajectory overcorrections due to inference lag. We demonstrate that a mid-weight architecture strikes the optimal balance, successfully rehabilitating navigation in degraded environments without compromising real-time stability across different hardware profiles.

Related papers