WIDE: Wildcard Inference with Dynamic Expansion for Cross-Modal Generative Retrieval

arXiv:2609.03554 · cs.CV, cs.AI · Submitted 2026-09-03 · Read on arXiv

cs.CV, cs.AI

Submitted: 2026-09-03

Updated: 2026-09-03

Comments: Accepted to the 34th ACM International Conference on Multimedia (ACM MM 2026). 10 pages, 5 figures

License: http://creativecommons.org/licenses/by/4.0/

The gist: Generative retrieval has demonstrated significant success by unifying representation learning and search into a single sequence-to-sequence generation task.

Terminology

Abstract

Generative retrieval has demonstrated significant success by unifying representation learning and search into a single sequence-to-sequence generation task. However, extending this paradigm to cross-modal retrieval reveals a critical challenge arising from the inherent information asymmetry across different modalities, such as the gap between concise text queries and dense visual candidates. This structural mismatch causes the autoregressive decoder to suffer from forced hallucination when generating identifiers via standard trie-constrained beam search, where the model is severely penalized for failing to guess fine-grained details absent from the query, allowing irrelevant candidates to hijack top rankings. To address this issue, we propose Wildcard Inference with Dynamic Expansion (WIDE). WIDE employs Adaptive Entropy Thresholding (AET) to calibrate layer-specific uncertainty boundaries offline. During the decoding generation phase, Asymmetry-aware Wildcard Decoding (AWD) detects semantic blind spots and emits wildcards instead of forced deterministic identifiers, dynamically expanding the search space without incurring log-probability penalties. Finally, Blind-Spot Re-ranking (BSR) evaluates the expanded candidate pool using a hybrid scoring mechanism that combines discrete generation confidence with continuous semantic similarity. Extensive experiments on the M-BEIR benchmark demonstrate that WIDE outperforms state-of-the-art generative retrieval methods, effectively suppressing forced hallucination while maintaining compact index structures.

Sources

Related papers