oHC: Orthogonal Hyper-Connections on SO(4) via Quaternions
cs.CL, cs.LG
Submitted: 2026-09-02
Updated: 2026-09-02
Terminology
Sources
- mHC: Manifold-Constrained Hyper-Connections
- Frac-Connections: Fractional Extension of Hyper-Connections
- xHC: Expanded Hyper-Connections
- KromHC: Manifold-Constrained Hyper-Connections with Kronecker-Product Residual Matrices
- go-$m$HC: Direct Parameterization of Manifold-Constrained Hyper-Connections via Generalized Orthostochastic Matrices
- TBP-mHC: full expressivity for manifold-constrained hyper connections through transportation polytopes
- Accelerating Birkhoff Projection for Manifold-Constrained Hyper-Connections
- mHC-lite: You Don't Need 20 Sinkhorn-Knopp Iterations
- Sinkhorn doubly stochastic attention rank decay analysis
- Spectral-Sphere-Constrained Hyper-Connections
- JPmHC Dynamical Isometry via Orthogonal Hyper-Connections
- Training Compute-Optimal Large Language Models
- Scaling Laws for Fine-Grained Mixture of Experts
- Measuring Massive Multitask Language Understanding
- MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark
- Are We Done with MMLU?
- CMMLU: Measuring massive multitask language understanding in Chinese
- C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models
- SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplines
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering