MIND the Gap: A Geographic Implicit Neural Representation with Adjustable Spatial Scale
cs.CV, cs.LG
Submitted: 2026-09-21
Updated: 2026-09-24
Comments: https://research.taylorgeospatial.org/mind
License: http://creativecommons.org/licenses/by/4.0/
The gist: Geographic measurements are often sparse, leaving large areas without labels for the quantities we want to map.
Terminology
Abstract
Geographic measurements are often sparse, leaving large areas without labels for the quantities we want to map. Geographic implicit neural representations (INRs) address this by learning smooth, general-purpose embeddings that can be queried at any coordinate. Downstream models combine these embeddings with sparse labels to predict target values at unsampled locations without satellite imagery at inference. However, generalization to distant regions remains largely unexplored, despite its importance for remote sensing applications. We introduce Matryoshka Implicit Neural Distillation (MIND), which distills embeddings from specialist pretrained geospatial models into a single generalist coordinate embedding with adjustable spatial granularity. MIND uses nested supervision at several embedding dimensions, which define a series of contiguous chunks. In our experiments, early chunks capture coarser geographic variation, while later chunks add more fine-grained details. A downstream predictor can retain only leading chunks or be fitted with our Chunked Penalty to downweight later chunks while keeping the full embedding, without retraining the INR. To measure MIND and compare to existing approaches around the world, we introduce CoordBench, a large-scale INR evaluation suite of 52 datasets and 78 targets that aims to test both local interpolation and prediction in held-out regions at various spatial scales. MIND and its Chunked Penalty variant achieve the highest aggregate regression and classification scores among tested INRs, and the highest scores overall under regional holdout, setting a new state-of-the-art for geographic INRs.
Sources
- General Geospatial Inference with a Population Dynamics Foundation Model
- VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning
- AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label data
- Tessellating The Earth
- Spatial Implicit Neural Representations for Global-Scale Species Mapping
- RANGE: Retrieval Augmented Neural Fields for Multi-Resolution Geo-Embeddings
- Climplicit: Climatic Implicit Embeddings for Global Ecological Tasks
- TESSERA v2: Scaling Pixel-wise Earth Foundation Models
- SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagery
- Matryoshka Representation Learning
- SLED: Scalable Location Encoding via Distillation
- BARF: Bundle-Adjusting Neural Radiance Fields
- BACON: Band-limited Coordinate Networks for Multiscale Scene Representation
- GAIR: Location-Aware Self-Supervised Contrastive Pre-Training with Geo-Aligned Implicit Representations
- Decoupled Weight Decay Regularization
- Multi-Scale Representation Learning for Spatial Feature Distributions using Grid Cells
- PHI-S: Distribution Balancing for Label-Free Multi-Teacher Distillation
- Learning Ordered Representations with Nested Dropout
- Evaluation Challenges for Geospatial ML
- Implicit Neural Representations with Periodic Activation Functions
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models