Beyond the BLUE I: the advantage ceiling - how much can any estimator beat the matched filter in mm/submm survey data?
astro-ph.IM, astro-ph.CO
Submitted: 2026-09-09
Updated: 2026-09-09
Comments: Paper I of two. 52 pages, 9 figures, 13 tables. A shortened version will be submitted to a journal. Comments welcome
License: http://creativecommons.org/licenses/by/4.0/
The gist: Convolutional neural networks are increasingly used to measure source amplitudes in survey maps, often with claims of outperforming the matched filter.
Terminology
Abstract
Convolutional neural networks are increasingly used to measure source amplitudes in survey maps, often with claims of outperforming the matched filter. That filter is the best linear unbiased estimator (BLUE) for any noise of a given covariance, and minimum-variance unbiased outright when that noise is Gaussian and known, so an advantage requires a covariance that varies from image to image, or noise that is non-Gaussian. We introduce a single number, the advantage ceiling eta >= 1, that quantifies both: the Fisher information for the amplitude in units of the matched filter's, computable from noise-only simulations before any network is trained, and a bound on any marginally unbiased estimator's variance. We compute eta for a taxonomy of millimeter/submillimeter survey noise with a variational score-matching ladder whose rungs are estimator classes of increasing statistical order. With an instrumental white-noise floor, Gaussian noise gives eta = 1 to within +- 0.04; covariance mixtures give exact ceilings of 10.2 (spectral tilt, extended source), 2.1 (leaked components) and 1.1-1.8 otherwise, of which a 2000-parameter mixture matched filter attains 70-81%. Source confusion, whose non-Gaussian component is the noise itself, gives the largest advantage, eta >= 3.8 (extended) and >= 2.4 (compact), reachable only above the bispectrum rung and calibrated at 0.9 against a known answer. Read as observing time, eta multiplies a survey's integration time wherever the noise integrates down, excluding confusion. Unmodelled numerical channels can manufacture spurious advantages of up to two orders of magnitude. A ResNet regressor is 6-15% less efficient than the matched filter on Gaussian noise once prior shrinkage is divided out, and realizes 1.8 of the 10.2 available on the spectral tilt; a companion paper tests such regressors against these ceilings.
Related papers
- A signal dedispersion algorithm for imaging-based transient searches
- AVICA: A fully automated CASA pipeline for large volume VLBI data calibration
- Spectral Map Making with SPHEREx
- Long-Integration Magnetar Burst Observatory (LIMBO): Instrument Summary and Early FRB Rate Constraints
- Towards independent event horizon imaging of the supermassive black holes in M87 and the Milky Way
- A PINK update: Improvements to the CELEBI fast radio burst data reduction and analysis pipeline