Rotational Equivariance in Machine Learning: A Comprehensive Tutorial
cs.LG
Submitted: 2026-08-31
Updated: 2026-08-31
License: http://creativecommons.org/licenses/by/4.0/
The gist: Rotational symmetry is one of the most important structural principles in machine learning on 3D data.
Terminology
Abstract
Rotational symmetry is one of the most important structural principles in machine learning on 3D data. In applications ranging from physics and materials science to 3D computer vision, predictions should not depend on an arbitrary choice of coordinate frame. Rotational equivariance captures this requirement mathematically by enforcing that a rotation of the input induces a corresponding transformation of the model output. This tutorial provides a comprehensive introduction to rotational equivariance, starting from the physical and geometric intuition behind coordinate independence and building up the necessary machinery from geometric deep learning, group theory, and representation theory. We introduce message passing on Euclidean graphs, group actions and representations, spherical harmonics, Wigner matrices, tensor products, and Clebsch-Gordan decomposition, and explain how these ingredients give rise to modern equivariant architectures. We then survey the principal strategies for incorporating rotational equivariance in deep learning, including group convolutions, internal tensorial representations, and canonicalization-based methods, and discuss their practical strengths and limitations. The tutorial aims to lower the barrier to the subject by connecting the underlying mathematics to practical model design, by unifying ideas that are often expressed in different formal languages, and by helping practitioners choose among competing approaches through a clear discussion of their trade-offs.
Sources
- Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
- A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systems
- e3nn: Euclidean Neural Networks
- Geometrically Equivariant Graph Neural Networks: A Survey
- Lorentz-Equivariant Geometric Algebra Transformers for High-Energy Physics
- Learning Smooth and Expressive Interatomic Potentials for Physical Property Prediction
- Fast, Expressive SE$(n)$ Equivariant Networks through Weight-Sharing in Position-Orientation Space
- Platonic Transformers: A Solid Choice For Equivariance
- Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point clouds
- Gauge Equivariant Mesh CNNs: Anisotropic convolutions on geometric graphs
- Swallowing the Bitter Pill: Simplified Scalable Conformer Generation
- Relaxed Equivariance via Multitask Learning
- Probing the effects of broken symmetries in machine learning
- How simple can you go? An off-the-shelf transformer approach to molecular dynamics
- Approximate Equivariance via Projection-based Regularisation
- Pushing the limits of unconstrained machine-learned interatomic potentials
- Does equivariance matter at scale?
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks