Enhancing Photometric Redshift Estimation for LSST with a Hybrid LSTM-Mixture Density Network
Zhijian Luo, Yangyang Li, Xinyu Luo, Hubing Xiao, Wei Fang, Shaohua Zhang, Chenggang Shu
astro-ph.GA, astro-ph.IM
Submitted: 2026-07-08
Code: https://github.com/zjluo-code/LSTM-MDNz-GalaxiesML
License: http://creativecommons.org/licenses/by/4.0/
The gist: Accurate photometric redshift (photo- z) estimation and robust uncertainty quantification are essential for the LSST to achieve its precision cosmology goals.
Terminology
Abstract
Accurate photometric redshift (photo- z) estimation and robust uncertainty quantification are essential for the LSST to achieve its precision cosmology goals. Traditional machine learning algorithms are largely restricted to point estimates, struggling to characterize the multimodal nature of redshift PDFs and the degeneracies within the color-redshift space. To address this, we present and validate the LSTM-MDNz architecture, which integrates sequential feature extraction with flexible probability density modeling to enhance both prediction accuracy and uncertainty calibration across a broad redshift range, thereby meeting the stringent data quality requirements necessitated by next-generation cosmological analysis. The LSTM-MDNz framework treats multi-band photometry as wavelength-ordered sequences, utilizing LSTM networks to capture non-linear evolutionary correlations across the SED. A Mixture Density Network (MDN) is then employed to explicitly model posterior PDFs via Gaussian mixture models (GMMs). Performance is evaluated on the HSC GalaxiesML dataset (which serves as a small-scale proxy for next-generation surveys like LSST) and benchmarked against the BNN architecture established by Jones et al. (2024). The proposed model consistently outperforms the BNN baseline, achieving a about 10% improvement in point-estimation accuracy (specifically across RMSE, MAE, scatter, and sigma NMAD) and a about 20% reduction in the rates of both general and catastrophic outliers. A uniform probability integral transform (PIT) distribution confirms well-calibrated probabilistic outputs. Furthermore, the PDF-based confidence metric z conf enables high-purity catalog construction: excluding just approximately 4% of extremely low-confidence (z conf < 0.05) samples reduces the overall outlier rate by about 48%.
Sources
- The Wide Field Infrared Survey Telescope: 100 Hubbles for the 2020s
- Practical recommendations for gradient-based training of deep architectures
- XGBoost: A Scalable Tree Boosting System
- GalaxiesML: a dataset of galaxy images, photometry, redshifts, and structural parameters for machine learning
- Adam: A Method for Stochastic Optimization
- Euclid Definition Study Report
- LSST Science Book, Version 2.0
- Photometric Redshifts for the Hyper Suprime-Cam Subaru Strategic Program Data Release 2
- Uncertain Photometric Redshifts
- Using different sources of ground truths and transfer learning to improve the generalization of photometric redshift estimation
Related papers
- Apparent Stability in Self-Gravitating Turbulence and the Evolution of Molecular Clouds
- Two sets of potential-density basis pairs for the study of radial perturbations in collisionless spherical stellar systems
- Constraining reionization-era Ly alpha escape with JELS-MUSE: a highly complete H alpha-selected sample at z about6.1
- Deriving volume density profiles of filaments from observed surface densities
- Little Red Dots and Supermassive Black Hole Seed Formation in Ultralight Dark Matter Halos
- MEGATRON: how the first stars can create an iron metallicity plateau in the smallest dwarf galaxies