Synthetic Semantic Supervision for Contrastive Code Representation Learning in Small Transformers: An Empirical Study
cs.AI
Submitted: 2026-09-03
Updated: 2026-09-03
Terminology
Sources
- code2seq: Generating Sequences from Structured Representations of Code
- CodeBERT: A Pre-Trained Model for Programming and Natural Languages
- UniXcoder: Unified Cross-Modal Pre-training for Code Representation
- GraphCodeBERT: Pre-training Code Representations with Data Flow
- DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence
- DeBERTa: Decoding-enhanced BERT with Disentangled Attention
- CodeSearchNet Challenge: Evaluating the State of Semantic Code Search
- Gemini Embedding: Generalizable Embeddings from Gemini
- Can Contrastive Learning Refine Embeddings
- UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
- Nomic Embed: Training a Reproducible Long Context Text Embedder
- CodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Tasks
- Qwen2.5 Technical Report
- Contrastive Learning with Hard Negative Samples
- SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation
- Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Models
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
- VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection