Rethinking Contrastive Loss in CLIP Post-training: A Complementary Framework with Frozen Text Encoder

arXiv:2610.11374 · cs.CV, cs.AI · Submitted 2026-10-08 · Read on arXiv

cs.CV, cs.AI

Submitted: 2026-10-08

Updated: 2026-10-08

Code: https://github.com/showstarpro/ComCLIP

Terminology

• Accuracy — 30× in this paper · explained in 1 episode
• Benchmark — 22× in this paper · explained in 2 episodes
• Distillation — 21× in this paper · explained in 2 episodes
• Linear probe — 19× in this paper · explained in 2 episodes
• Linear Probing — 16× in this paper · explained in 2 episodes
• Ablation — 12× in this paper · explained in 1 episode
• Alignment — 11× in this paper · explained in 1 episode
• Computer Vision and Pattern Recognition — 11× in this paper
• Transferability — 8× in this paper · explained in 4 episodes
• Core — 7× in this paper · explained in 2 episodes
• Ablation study — 6× in this paper · explained in 1 episode
• Generative Model — 6× in this paper · explained in 2 episodes
• Catastrophic Forgetting — 4× in this paper · explained in 5 episodes
• Self-distillation — 4× in this paper · explained in 6 episodes
• Decoupling — 3× in this paper · explained in 2 episodes
• Embeddings — 3× in this paper · explained in 2 episodes
• Generative Models — 3× in this paper · explained in 2 episodes
• Knowledge Distillation — 3× in this paper · explained in 11 episodes
• Modality Gap — 3× in this paper · explained in 4 episodes
• Representation Learning — 3× in this paper · explained in 2 episodes
• Foundation Model — 2× in this paper · explained in 3 episodes
• Foundation Models — 2× in this paper · explained in 7 episodes
• Institutional Review Board — 2× in this paper
• Adam — 1× in this paper · explained in 2 episodes
• Adversarial Examples — 1× in this paper · explained in 2 episodes
• Calibration — 1× in this paper · explained in 7 episodes
• Contrastive Learning — 1× in this paper · explained in 5 episodes
• Cooperation — 1× in this paper · explained in 2 episodes
• Cosine Similarity — 1× in this paper · explained in 3 episodes
• Data Augmentation — 1× in this paper · explained in 7 episodes
• Evaluation Dimensions — 1× in this paper · explained in 3 episodes
• Failure Modes — 1× in this paper · explained in 3 episodes
• Hallucination — 1× in this paper · explained in 3 episodes
• Instruction Tuning — 1× in this paper · explained in 2 episodes
• Loss Function — 1× in this paper · explained in 2 episodes
• Multimodal Reasoning — 1× in this paper · explained in 5 episodes
• Predictive Coding — 1× in this paper · explained in 2 episodes
• Regularization — 1× in this paper · explained in 3 episodes
• Self-Supervised Learning — 1× in this paper · explained in 7 episodes
• Vision-Language Models (VLMs) — 1× in this paper · explained in 6 episodes
• Zero-Shot Transfer — 1× in this paper · explained in 3 episodes

Sources

• Microsoft COCO Captions: Data Collection and Evaluation Server
• MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models
• un$^2$CLIP: Improving CLIP's Visual Detail Capturing Ability via Inverting unCLIP
• Representation Learning with Contrastive Predictive Coding
• EVA-CLIP: Improved Training Techniques for CLIP at Scale

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models