AVICA: A fully automated CASA pipeline for large volume VLBI data calibration
summary
The gist
Calibrating large volumes of Very Long Baseline Interferometry (VLBI) data is traditionally a time-consuming process requiring significant human intervention, but this work introduces AVICA, a fully
In short
AVICA is a fully automated CASA pipeline designed to calibrate large volumes of heterogeneous archival VLBA data without manual parameter input. It extends the rPICARD framework by automating preprocessing, source selection, and calibration steps using Python and ALFRD. This makes large-scale VLBI processing practical for community use.
Key concepts
- AVICA
- A fully automated CASA pipeline that handles the entire calibration workflow for VLBA data. It automates complex tasks like data preprocessing, source selection, and calibration, allowing users to process large datasets without needing to manually input parameters.
- rPICARD
- The core calibration framework that AVICA extends. It executes a sequence of steps including amplitude calibration, fringe-fitting for instrumental effects, atmospheric phase correction using multi-band fitting, and complex bandpass calibration.
- ALFRD
- Automated Logical Framework for executing Dynamic scripts. This in-house module manages the scheduling and workflow orchestration of AVICA. It allows the pipeline to run dynamically with minimal dependency on the CASA software stack, serving as the backend for automated execution.
- Blind Calibration
- The ability to calibrate data without manual input of parameters like calibrator sources or reference antennas. AVICA achieves this by automatically ranking and selecting optimal calibrators and reference antennas based on signal-to-noise ratios and antenna availability.
Terminology used across episodes
This episode discusses
The paper
AVICA: A fully automated CASA pipeline for large volume VLBI data calibration · Read on arXiv
A. Kumar, C. Casadio, M. Janssen, D. Álvarez-Ortega, F. M. Pötzl
Institute of Astrophysics, Foundation for Research and Technology – Hellas · Department of Physics, University of Crete · Institute for Mathematics, Astrophysics and Particle Physics (IMAPP), Radboud University
Calibrating large volumes of Very Long Baseline Interferometry (VLBI) data traditionally requires significant human intervention at every stage. While the Common Astronomy Software Applications (CASA) package is the standard data reduction tool across major radio observatories, no existing CASA-based pipeline operates in a fully automated manner across the heterogeneous data formats produced by the Very Long Baseline Array (VLBA) over three decades of operations. The Search for Milli-Lenses (SMILE) project, requiring the calibration of 5000 VLBA sources, makes such blind automation a practical necessity. We introduce the Automated VLBI pipeline in CASA (AVICA), which automates the calibration of archival VLBA data. AVICA extends the CASA-based rPICARD framework by automating preprocessing of FITS-IDI and Measurement Set data formats, calibrator and reference antenna selection via FFT-based fringe detection, and execution of the full calibration workflow. Progress tracking is handled by ALFRD (Automated Logical Framework for executing Dynamic scripts), which orchestrates pipeline execution and records results in real time. AVICA was validated on 1000 NRAO archival sources spanning 1995-2023, covering 1372 band-separated observations across the S, C, X, U, and K bands. Calibrated output was produced for 978 sources (97.8%), with 22 failures due to corrupted or incomplete data. Mean per-source execution time was 30 minutes using MPI parallelization with up to 20 cores. AVICA demonstrates that fully blind calibration of heterogeneous archival VLBA data is achievable with CASA. The automated calibrator and reference antenna selection will be incorporated into a future rPICARD release, extending blind calibration to any supported array. AVICA and ALFRD are available as open-source Python packages.
DOI: 10.1051/0004-6361/202660469
Transcript
Introduction to the show: ident: Astrophysics Radio. Generated commentary on the latest astrophysics papers.
Vera: Today's paper: "AVICA: A fully automated CASA pipeline for large volume VLBI data calibration".
Jocelyn: Calibrating large volumes of Very Long Baseline Interferometry (VLBI) data is traditionally a time-consuming process requiring significant human intervention, but this work introduces AVICA,
Vera: First, who's behind it and why it matters.
Paper summary: Vera: We’ve discussed how AVICA automates the calibration of large volumes of Very Long Baseline Interferometry data, focusing on handling heterogeneous formats and automated antenna selection to remove manual input from the process. The authors have presented this fully automated CASA pipeline as a way to make large-scale VLBA data processing accessible.
Jocelyn: It’s clear that the work by A. Kumar et al., titled "AVICA: A fully automated CASA pipeline for large volume VLBI data calibration," aims to address the practical limitations of current pipelines, particularly concerning the manual intervention needed when dealing with decades of evolving correlator formats and file structures.
Subrahmanyan: From a theoretical perspective, the significance lies in proving that complex calibration tasks can be managed robustly across highly varied datasets without needing bespoke configurations for every single run.
Vera: It’s about taking a traditionally time-consuming process and making it runnable for a wider community of researchers who might not have the expertise to manually tune all those parameters.
Jocelyn: I think the implication is that we can start leveraging much larger, older VLBA archives more effectively than previously possible because the barrier to entry for processing them has been significantly lowered.
Subrahmanyan: This capability means we can conduct more comprehensive studies on phenomena like Supermassive Compact Objects using these diverse datasets, as it removes calibration as a primary bottleneck in our analysis.
Vera: So, in simple terms, AVICA provides a tool that handles the heavy lifting of calibration automatically so we spend less time babysitting the software and more time looking at the actual astronomical signals.
Jocelyn: And that’s what makes it impactful for pulsar and sky surveys too; having reliable, automated pipelines means we can deliver cleaner results from those long-term observations more consistently.
Subrahmanyan: Ultimately, this paper demonstrates a way to scale VLBI data calibration using existing tools like CASA in a way that doesn't require extensive manual input at every stage of the workflow.
Conclusion: Vera: So, we've just been walking through the technical details of AVICA, and now we need to wrap up by talking about what this paper actually is and why it matters for us as a community.
Jocelyn: I think focusing on the title, "AVICA: A fully automated CASA pipeline for large volume VLBI data calibration," really gets to the heart of what they did—it’s about taking a massive manual chore and turning it into something that runs itself.
Subrahmanyan: From my end, it speaks to the feasibility of applying standard software like CASA to tackle datasets that were previously too big or too messy for routine analysis. It shows a path forward for handling the sheer volume we're seeing in modern VLBI surveys.
Vera: Exactly, and when you look at the authors, they’ve managed to integrate several complex components—Python libraries, workflow managers like ALFRD—into one cohesive system that handles everything from file formats to source selection automatically.
Jocelyn: That automation aspect is what really excites me; it means we can process archival data from decades ago without needing a specialist just to set up the initial calibration parameters for every single run.
Subrahmanyan: That level of automation has real implications for theoretical work because it lowers the barrier to entry for using these deep historical datasets, which feeds into our models about galactic structure and compact objects.
Vera: It really means that the bottleneck isn't just having a big telescope or a large archive anymore; it’s about how efficiently we can extract and calibrate that data, and AVICA seems to solve that extraction problem.
Jocelyn: For pulsar surveys specifically, this pipeline suggests we can get much more consistent results across different observational epochs because the calibration steps are performed identically every time.
Subrahmanyan: If we can reliably process these heterogeneous datasets at scale, we gain a much richer statistical sample to test our astrophysical theories about how matter behaves in extreme environments.
Vera: So, looking ahead, I think the real impact of AVICA is making large-scale VLBI analysis something that the general research community can actually do without needing a dedicated calibration team for every project.
Jocelyn: It’s a big step toward democratizing high-quality VLBI data processing; we're moving away from highly customized manual pipelines toward robust, automated systems.
Subrahmanyan: This capability means we can finally analyze those faint, distant sources more thoroughly because the calibration noise isn't introducing systematic errors due to human input variability anymore.
Vera: And that’s the big picture—we’re not just calibrating images; we’re unlocking the potential of vast historical radio observations in a much more practical way.
More episodes
- 2605.15146-Matter Flavor Conversion Mediated by Pseudo-Sterile States as the Possible Origin of Neutrino Oscillation Anomalies
- 2503.19660-Effect of ultralight dark matter on compact binary mergers
- 2510.25383-Rapid bulge assembly in young galaxy disks at Cosmic Dawn
- 2505.02253-Infrared-Selected Active Galactic Nuclei in the Kepler Fields
- 2511.21627-New Signs Pointing Toward a Correlation Between Astrophysical Neutrinos and Radio Flares
- 2605.05327-Shape of the direct-method mass-metallicity relation with JWST: Fast-Track Nitrogen and Helium Enrichment
- 2605.28752-Inflation with vector fields revisited: non-Gaussianities
- 2605.11332-Reviving primordial black hole formation in slow first-order phase transitions
- 2606.04083-Studying the absorption signatures of H I Lyman-alpha in the warm-hot circumgalactic medium with TNG50
- 2605.13955-Exploring neutrino loss with diffuse astrophysical neutrino fluxes