Theory for groupoid equivariant neural networks: an approach for steerable CNNs on bounded domains
cs.LG, math.DG
Submitted: 2026-09-22
Updated: 2026-09-22
Code: https://github.com/mariajimvaz-afk/groupoid-equivariant-cnn
License: http://creativecommons.org/licenses/by/4.0/
The gist: Equivariant convolutional neural networks are usually built from a group acting globally on the space of signals.
Terminology
Abstract
Equivariant convolutional neural networks are usually built from a group acting globally on the space of signals. This hypothesis is inappropriate for many bounded or stratified domains: an ambient rigid motion may be admissible only on part of the domain, and the boundary introduces geometric types that are invisible to a transitive group action. We develop a theory of groupoid-equivariant neural networks in which the symmetry datum consists of a groupoid, a selected pseudogroup of local bisections, a measure, and input and output representation bundles. For integral channels on the object space, we prove a bisection-equivariant kernel theorem: equivariance is equivalent to a transport constraint on the two-point kernel, and its solutions are classified by one joint-stabilizer intertwiner on each orbit of pairs. As a case study we apply the theory to bounded planar domains. The resulting architecture is implemented through offline nullspace bases and sparse gather--transform--scatter operations. A Poisson--Dirichlet kernel study is used separately to assess boundary-aware inductive bias; the exact inverse is shown to preserve the global symmetries of the rectangle but not general proper local bisections. The numerical results show that the proposed architectures provide significant advantages when symmetries cannot be globally implemented by group actions and provide an accuracy improvement of at least one order of magnitude with respect to the models tested.
Sources
- Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
- Group Equivariant Convolutional Networks
- Steerable CNNs
- Spherical CNNs
- General $E(2)$-Equivariant Steerable CNNs
- On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groups
- A General Theory of Equivariant CNNs on Homogeneous Spaces
- Gauge Equivariant Convolutional Networks and the Icosahedral CNN
- On Translation Invariance in CNNs: Convolutional Layers can Exploit Absolute Spatial Location
- How Much Position Information Do Convolutional Neural Networks Encode?
- Learning Partial Equivariances from Data
- Categorical Equivariant Deep Learning: Category-Equivariant Neural Networks and Universal Approximation Theorems
- Theoretical Aspects of Lie Groupoid and Lie Algebroid Equivariant Convolutional Neural Networks
- Fourier Neural Operator for Parametric Partial Differential Equations
- A groupoidal description of elementary particles
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks