A Reverse Sign Language Dictionary: Open-Vocabulary Sign Recognition from Continuous Signing via Video Captioning and Description Retrieval

arXiv:2609.03788 · cs.CV, cs.CL · Submitted 2026-09-03 · Read on arXiv

cs.CV, cs.CL

Submitted: 2026-09-03

Updated: 2026-09-03

Comments: 4 pages, 2 figures, 1 table. Extended version of an abstract presented at the BU-SHI workshop (Broadening the Users: A Cross-Disciplinary Roadmap for Social Humanoid Interaction), IEEE RO-MAN 2026, Kitakyushu, Japan, 28 August 2026. The workshop is non-archival; no proceedings

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Fine-Tuning — 10× in this paper · explained in 5 episodes
Accuracy — 7× in this paper · explained in 1 episode
Generalization — 3× in this paper · explained in 13 episodes
Adaptation — 2× in this paper · explained in 1 episode
Isolated Sign Language Recognition — 2× in this paper
Japanese Sign Language — 2× in this paper
Vision-language models — 2× in this paper · explained in 2 episodes
Ablation — 1× in this paper · explained in 1 episode
Contrastive Learning — 1× in this paper · explained in 5 episodes
Cosine Similarity — 1× in this paper · explained in 3 episodes
Distillation — 1× in this paper · explained in 2 episodes
Embeddings — 1× in this paper · explained in 2 episodes
Knowledge Distillation — 1× in this paper · explained in 11 episodes
LoRA Adapters — 1× in this paper · explained in 3 episodes
Transformer — 1× in this paper · explained in 2 episodes
Vision Transformer (ViT) — 1× in this paper · explained in 2 episodes

Sources

InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models

Terminology

Sources

Related papers