Geometric Mean Pooling for Equal-Weight Multiplicative Coarse-Graining
cs.LG, stat.ML
Submitted: 2026-09-18
Updated: 2026-09-25
Comments: 17 pages, 6 figures
Code: https://github.com/angkun-research/GeometricMeanPooling
License: http://creativecommons.org/licenses/by/4.0/
The gist: As an alternative to the additive and extremal biases of average and max pooling, we introduce Geometric Mean Pooling (GMP), a signed pooling operator that combines the product of feature signs with
Terminology
Abstract
As an alternative to the additive and extremal biases of average and max pooling, we introduce Geometric Mean Pooling (GMP), a signed pooling operator that combines the product of feature signs with the geometric mean of feature magnitudes. Motivated by local-to-global composition in quantum many-body physics, GMP retains both joint sign information and a characteristic multiplicative scale without introducing learnable pooling parameters. We show that non-overlapping hierarchical GMP preserves the corresponding global multiplicative statistic and evaluate it on synthetic sequence tasks, iterative coarse-graining, image classification, and molecular lipophilicity regression. On the synthetic tasks, GMP recovers product-based signals more accurately than average and max pooling and maintains predictive performance under the tested levels of multiplicative input noise. On image and molecular data, however, its effectiveness depends on the representation, target parameterization, and placement of local and global pooling. These results position GMP as a complementary, regime-dependent inductive bias for tasks in which equal-weight multiplicative composition is plausible, rather than as a universal replacement for standard pooling operators.
Sources
- Torch Geometric Pool: the PyTorch library for pooling in Graph Neural Networks
- Alpha-Integration Pooling for Convolutional Neural Networks
- Attention-Aware Generalized Mean Pooling for Image Retrieval
- Learned-Norm Pooling for Deep Feedforward and Recurrent Neural Networks
- Group Generalized Mean Pooling for Vision Transformer
- Neural Arithmetic Units
- Fine-tuning CNN Image Retrieval with No Human Annotation
- Learning scale-variant and scale-invariant features for deep image classification
- Compact Spin-Charge Separated Neural Quantum States for Valence-Bond States
- MoleculeNet: A Benchmark for Molecular Machine Learning
- Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks