Hermes - Towards an Optimal High-Performance Algorithm for Cosmic Statistics of Large Data Sets
Long-long Feng, Tengpeng Xu, Tian-Cheng Luan, Jiawei Li, Xin Sun, Wenjie Ju, Zhuoyang Li, Shiyu Yue, Weishan Zhu, Yan-Chuan Cai
astro-ph.CO
Submitted: 2026-07-26
Comments: 45 pages, 18 figures, and 4 tables. Source code: https://github.com/SYSUSPA-Projects/PyHermes
Code: https://github.com/SYSUSPA-Projects/PyHermes
License: http://creativecommons.org/licenses/by/4.0/
The gist: We present Hermes, an in situ multiresolution framework for efficient and flexible measurements of cosmic large-scale-structure statistics from discrete catalogues.
Terminology
Abstract
We present Hermes, an in situ multiresolution framework for efficient and flexible measurements of cosmic large-scale-structure statistics from discrete catalogues. Hermes reconstructs a catalogue as a continuous density field in a compact scaling-function basis and replaces explicit counting of particle tuples with algebraic operations among window-filtered fields. Standard binning schemes for counts-in-cells, two-point and higher-order correlation functions are thereby expressed through choices of window functions, while new statistics can be constructed by modifying the kernels without redesigning the estimator. We introduce PyHermes, an open-source Python implementation combining multiresolution reconstruction, FFT-based convolution, MPI/thread parallelism, and GPU acceleration. It supports isotropic and anisotropic two-point statistics, marked correlations, standard and multipole three-point functions, filtered statistics, and differential operators for derived physical fields. Tests with cosmological N-body halo catalogues demonstrate a range of clustering measurements and quantify the computational efficiency and scalability of the approach. By separating field representation from statistical windows, a single reconstructed field can be reused for many standard and customised measurements, making Hermes well suited to large data sets from current and future galaxy surveys.
Sources
- Inflation: Theory and Observations
- The Wide Field Infrared Survey Telescope: 100 Hubbles for the 2020s
- CUTE solutions for two-point correlation functions from large cosmological datasets
- The DESI Experiment Part I: Science,Targeting, and Survey Design
- Multi-Tree Methods for Statistics on Very Large Datasets in Astronomy
- Euclid Definition Study Report
- Fast Algorithms and Efficient Statistics: N-point Correlation Functions
Related papers
- Angular clustering and bias of photometric quasars in the Kilo-Degree Survey Data Release 4
- A Novel kinetic Sunyaev-Zel'dovich Estimator for Electron-Electron Correlations
- Magnetic fields at the dawn of structure formation I. The CARLA J1510+5958 proto-cluster
- Dark Energy Survey Year 6 Results: Weak Lensing and Galaxy Clustering Cosmological Analysis Framework
- Exploring the Impact of Systematic Bias in Type Ia Supernova Cosmology Across Diverse Dark Energy Parametrizations
- Non-Gaussian Galaxy Stochasticity and the Noise-Field Formulation