Adaptive Dual-Mode Distillation with Incentive Schemes for Scalable, Heterogeneous Federated Learning on Non-IID Data

arXiv:2509.22507 · cs.LG, cs.CV · Submitted 2025-09-26 · Read on arXiv

cs.LG, cs.CV

Submitted: 2025-09-26

Updated: 2025-09-26

Terminology

• Distillation — 55× in this paper · explained in 2 episodes
• Federated Learning — 55× in this paper · explained in 15 episodes
• Accuracy — 23× in this paper · explained in 1 episode
• Aggregation — 23× in this paper · explained in 1 episode
• Non-IID Data — 23× in this paper · explained in 2 episodes
• Decentralized Learning — 12× in this paper · explained in 2 episodes
• Communication Overhead — 10× in this paper · explained in 2 episodes
• Benchmark — 9× in this paper · explained in 2 episodes
• Personalization — 9× in this paper · explained in 2 episodes
• Robustness — 5× in this paper · explained in 5 episodes
• Transfer Learning — 4× in this paper · explained in 10 episodes
• Adaptation — 3× in this paper · explained in 1 episode
• Computational overhead — 3× in this paper · explained in 2 episodes
• Federated Learning (FL) — 3× in this paper · explained in 7 episodes
• Generative Adversarial Network — 3× in this paper
• Knowledge Distillation — 3× in this paper · explained in 11 episodes
• Meta-learning — 3× in this paper · explained in 2 episodes
• Activation Function — 2× in this paper · explained in 1 episode
• Calibration — 2× in this paper · explained in 7 episodes
• Data Augmentation — 2× in this paper · explained in 7 episodes
• Decentralized Learning with Statistical Heterogeneity — 2× in this paper
• Domain Adaptation — 2× in this paper · explained in 5 episodes
• Model-Agnostic — 2× in this paper · explained in 2 episodes
• Core — 1× in this paper · explained in 2 episodes
• Energy Efficiency — 1× in this paper · explained in 3 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• Generalizability — 1× in this paper · explained in 6 episodes
• Homogeneity — 1× in this paper · explained in 2 episodes
• Loss Function — 1× in this paper · explained in 2 episodes
• Mutual Information — 1× in this paper
• Unified Framework — 1× in this paper · explained in 5 episodes

Related papers

• Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
• AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
• Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
• Convergence issues in Relational Concept Analysis based on AOC-posets
• Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
• Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks