Emergent Sparsity: How Many Effective Variables Survive Coarse-Graining in AlphaEarth Embeddings?
cs.LG, cond-mat.stat-mech, physics.geo-ph
Submitted: 2026-10-18
Updated: 2026-10-18
Comments: Camera-ready version of a paper accepted at the 2nd Workshop on Advances in Representation Learning for Earth Observation (REO), NeurIPS 2026. 20 pages, 15 figures
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: AlphaEarth encodes each 10 m land pixel as a 64-component vector intended to support diverse global mapping tasks.
Terminology
Abstract
AlphaEarth encodes each 10 m land pixel as a 64-component vector intended to support diverse global mapping tasks. Yet many scientific applications work at coarser spatial supports, for which fewer than 64 effective variables may suffice. We ask whether these vectors can be reorganized into ranked global nonlinear coordinates, how many suffice at a chosen reconstruction accuracy, and whether that number decreases with spatial scale. We thus describe effective dimension as a two-control surface over tolerance and spatial scale, rather than one intrinsic number. At each scale, a β-VAE scan with a common architecture produces a rank--distortion envelope, giving the smallest retained count achieved within the scanned family at each reconstruction tolerance. At 3% validation tolerance, this number falls from 24 to 7 when the scale is increased from 10 m to 78.9 km, whereas the corresponding PCA rank falls only from 46 to 38. Repeating the analysis on unit-norm targets preserves this trend.
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks