Distributed Linear Solvers and Data Heterogeneity

arXiv:2304.10640 · cs.DC, cs.LG, cs.NA, math.NA · Submitted 2023-04-20 · Read on arXiv

cs.DC, cs.LG, cs.NA, math.NA

Submitted: 2023-04-20

Updated: 2026-09-19

Comments: 31 pages, 11 figures

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Data Heterogeneity — 16× in this paper · explained in 3 episodes
• Accelerated Projection — 7× in this paper · explained in 1 episode
• Cosine Similarity — 6× in this paper · explained in 3 episodes
• Accelerated Projection-Based Consensus — 4× in this paper
• Core — 2× in this paper · explained in 2 episodes
• Distributed Gradient Descent — 2× in this paper
• Federated Learning — 2× in this paper · explained in 16 episodes
• Alternating Direction Method of Multipliers (ADMM) — 1× in this paper · explained in 2 episodes
• Differentially Private — 1× in this paper · explained in 3 episodes
• Loss Function — 1× in this paper · explained in 2 episodes
• Minimax optimality — 1× in this paper · explained in 2 episodes
• Regularization — 1× in this paper · explained in 3 episodes
• Robustness — 1× in this paper · explained in 5 episodes

Sources

• Differentially Private Synthetic Data Generation for Relational Databases

Related papers

• iScheduler: Reinforcement Learning-Driven Continual Optimization for Large-Scale Resource Investment Problems
• SAMM: Sharded Automated Market Maker
• InferScale: GPU-Native KV Injection for Personalized LLM Serving
• Vigil: Accountable Liveness against Selective Silence
• Steelhead: Interleaving Partially Synchronous and Asynchronous Commit Rules on a Shared DAG
• Pushing CPU Speech Synthesis to the Wall: Extreme Inference Tuning under Serverless Architecture and Billing