Manifold Dimension Estimation via Local Graph Structure
stat.ML, cs.LG, stat.AP
Submitted: 2025-10-16
Updated: 2026-09-14
Comments: multiple appendix sections added, main contents updated to incorporate new theoretical results
Code: https://github.com/loong-bi/manifold-dimension-estimation
License: http://creativecommons.org/licenses/by/4.0/
The gist: Most existing manifold dimension estimators rely on the assumption that the underlying manifold is locally flat within the neighborhoods under consideration.
Terminology
Abstract
Most existing manifold dimension estimators rely on the assumption that the underlying manifold is locally flat within the neighborhoods under consideration. More recently, curvature-adjusted principal component analysis (CA-PCA) has emerged as a powerful alternative by explicitly accounting for the manifold's curvature. Motivated by these ideas, we propose a manifold dimension estimation framework that captures the local graph structure of the manifold through regression on local PCA coordinates. Within this framework, we introduce two representative estimators: quadratic embedding (QE) and total least squares (TLS). Experiments on both synthetic and real-world datasets demonstrate that these methods perform competitively with, and often outperform, state-of-the-art approaches.
Sources
- UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
- Auto-Encoding Variational Bayes
- Intrinsic dimension estimation of data by principal component analysis
- A Survey and Comparative Evaluation of Intrinsic Dimension Estimators under the Manifold Hypothesis
- Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Related papers
- Behavior of prediction performance metrics with rare events
- Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs
- A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- One Permutation Is All You Need: Fast, Deterministic Feature Importance and Model Stress-Testing
- Online Conformal Prediction for Non-Exchangeable Panel Data
- Deep Time-Series Forecasting in 10 Years: A Survey