Orthogonal Yet Coupled: Decoupling Geometric Components for Model Merging
cs.CL
Submitted: 2026-09-29
Updated: 2026-09-29
Code: https://github.com/wzj1718/DiGA
Terminology
Sources
- Program Synthesis with Large Language Models
- Qwen2.5-VL Technical Report
- Lessons from the Trenches on Reproducible Evaluation of Language Models
- On the Opportunities and Risks of Foundation Models
- HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- Training Verifiers to Solve Math Word Problems
- The Llama 3 Herd of Models
- PathVQA: 30000+ Questions for Medical Visual Question Answering
- Training Compute-Optimal Large Language Models
- Scaling Laws for Neural Language Models
- SMoA: Spectrum Modulation Adapter for Parameter-Efficient Fine-Tuning
- olmOCR 2: Unit Test Rewards for Document OCR
- DiM\textsuperscript{3}: Bridging Multilingual and Multimodal Models via Direction- and Magnitude-Aware Merging
- MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence
- Orthogonal Model Merging
- Instruction-Following Evaluation for Large Language Models
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering