FuncCode: Compressing Kolmogorov--Arnold Networks in Function Space with Hardware-Aware Quantization
cs.LG
Submitted: 2026-08-04
Updated: 2026-08-04
Code: https://github.com/OSU-STARLAB/FuncCode
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Kolmogorov--Arnold Networks (KANs) replace scalar edge weights with learnable univariate functions, increasing flexibility but also parameter memory because each edge stores multiple coefficients,
Terminology
Abstract
Kolmogorov--Arnold Networks (KANs) replace scalar edge weights with learnable univariate functions, increasing flexibility but also parameter memory because each edge stores multiple coefficients, often together with a separate base branch. We introduce FuncCode, a basis-agnostic compression approach that forms shared codebooks from sampled edge responses, codes the basis and base branches independently, and exports the resulting codebooks and per-edge indices in a quantized, bit-packed format. Across spline and polynomial KANs, sampled edge responses exhibit 13 -- 35% lower effective rank than their coefficient representations. Further replicated controls show that function-space clustering alone is statistically tied with coefficient-space clustering; the consistent accuracy gain comes from preserving the distinct sharing structure of the two branches. On a ten-seed MNIST benchmark, FuncCode compresses spline and GRAM KANs by 31.6 times and 17.6 times with only 0.31 and 0.34 pp accuracy loss. On a 6.1M-edge convolutional KAGN, it achieves 19.9 times compression while remaining within 0.54 pp of dense accuracy on CIFAR-10 and 1.89 pp on CIFAR-100. After compression, per-edge indices account for up to 99.4% of stored weight bits, making the representation index-bound. Across nine bit-exact FPGA accelerators, FuncCode reduces SplineKAN post-route weight memory by 3.87 times relative to dense INT4, without increasing cycle count or latency. The FuncCode implementation is available at https://github.com/OSU-STARLAB/FuncCode.
Sources
- Convolutional Kolmogorov-Arnold Networks
- Wav-KAN: Wavelet Kolmogorov-Arnold Networks
- Compressing Neural Networks with the Hashing Trick
- Kolmogorov-Arnold Convolutions: Design Principles and Empirical Studies
- KANtize: Exploring Low-bit Quantization of Kolmogorov-Arnold Networks for Efficient Inference
- Learned Step Size Quantization
- Shift-Invariant Attribute Scoring for Kolmogorov-Arnold Networks via Shapley Value
- QuantKAN: A Unified Quantization Framework for Kolmogorov Arnold Networks
- Compressing Deep Convolutional Networks using Vector Quantization
- Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding
- Hardware Acceleration of Kolmogorov-Arnold Network (KAN) in Large-Scale Systems
- Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference
- Kolmogorov-Arnold Networks are Radial Basis Function Networks
- KAN: Kolmogorov-Arnold Networks
- MetaCluster: Enabling Deep Compression of Kolmogorov-Arnold Network
- SHARe-KAN: Post-Training Vector Quantization for Cache-Resident KAN Inference
- Chebyshev Polynomial-Based Kolmogorov-Arnold Networks: An Efficient Architecture for Nonlinear Function Approximation
- PRKAN: Parameter-Reduced Kolmogorov-Arnold Networks
- KAN or MLP: A Fairer Comparison
- Improving Memory Efficiency for Training KANs via Meta Learning
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks