Synchronization on circles and spheres with nonlinear interactions

arXiv:2405.18273 · math.OC, cs.LG, math.DS · Submitted 2026-01-27 · Read on arXiv

Christopher Criscitiello, Quentin Rebjock, Andrew D. McRae, Nicolas Boumal

math.OC, cs.LG, math.DS

Submitted: 2026-01-27

Updated: 2026-08-24

Terminology

• Gradient Flow — 20× in this paper · explained in 2 episodes
• Transformer — 16× in this paper · explained in 2 episodes
• Conference on Decision and Control — 3× in this paper
• Adjacency Matrix — 2× in this paper · explained in 1 episode
• Clustering — 2× in this paper · explained in 2 episodes
• Representation Learning — 2× in this paper · explained in 2 episodes
• Ambient Dimension — 1× in this paper · explained in 1 episode
• Entrainment — 1× in this paper · explained in 2 episodes
• Inverse Problem — 1× in this paper · explained in 2 episodes
• Metastability — 1× in this paper · explained in 2 episodes
• Riemannian optimization — 1× in this paper · explained in 2 episodes
• Sparsity — 1× in this paper · explained in 4 episodes
• Stiefel manifold — 1× in this paper · explained in 2 episodes
• Transformer Architecture — 1× in this paper · explained in 2 episodes
• Transformer Models — 1× in this paper · explained in 2 episodes

Sources

• Dynamic metastability in the self-attention model
• Saddle-to-Saddle Dynamics in Deep Linear Networks: Small Initialization Training, Symmetry, and Sparsity
• Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View
• Synchronization of mean-field models on the circle
• The Asymptotic Behavior of Attention in Transformers
• Synchronization on the circle

Related papers

• Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise
• Adam-HNAG: A Convergent Reformulation of Adam with Accelerated Rate
• Incremental Learning in Mirror Flows
• Online Control via Counterfactual Tracking
• Asynchronous Replanning in Two Population Linear Quadratic Mean Field Games: Information Requirements and Stability
• Petrov-Galerkin operator inference with application to stability-encouraging identification