Debiased Machine Learning for Conformal Prediction of Counterfactual Outcomes Under Runtime Confounding
stat.ML, cs.LG
Submitted: 2026-04-04
Updated: 2026-04-04
Journal ref: Proceedings of the Fifth Conference on Causal Learning and Reasoning, Proceedings of Machine Learning Research 323:1345-1379, 2026
License: http://creativecommons.org/licenses/by/4.0/
The gist: Data-driven decision making frequently relies on predicting counterfactual outcomes.
Terminology
Abstract
Data-driven decision making frequently relies on predicting counterfactual outcomes. In practice, researchers commonly train counterfactual prediction models on a source dataset to inform decisions on a possibly separate target population. Conformal prediction has arisen as a popular method for producing assumption-lean prediction intervals for counterfactual outcomes that would arise under different treatment decisions in the target population of interest. However, existing methods require that every confounding factor of the treatment-outcome relationship used for training on the source data is additionally measured in the target population, risking miscoverage if important confounders are unmeasured in the target population. In this paper, we introduce a computationally efficient debiased machine learning framework that allows for valid prediction intervals when only a subset of confounders is measured in the target population, a common challenge referred to as runtime confounding. Grounded in semiparametric efficiency theory, we show the resulting prediction intervals achieve desired coverage rates with faster convergence compared to standard methods. Through numerous synthetic and semi-synthetic experiments, we demonstrate the utility of our proposed method.
Sources
- Theoretical Foundations of Conformal Prediction
- Towards a Unified Theory for Semiparametric Data Fusion with Individual-Level Data
Related papers
- Behavior of prediction performance metrics with rare events
- Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs
- A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- One Permutation Is All You Need: Fast, Deterministic Feature Importance and Model Stress-Testing
- Online Conformal Prediction for Non-Exchangeable Panel Data
- Deep Time-Series Forecasting in 10 Years: A Survey