How Early Is Early Enough? Design-Dependent Observation-Window Sufficiency in Subscription Churn Prediction
cs.LG
Submitted: 2026-07-01
Updated: 2026-09-21
License: http://creativecommons.org/licenses/by/4.0/
The gist: How many days of early behavior suffice for subscription churn prediction? In the public KKBox dataset, the early indicator of churn is typically an indicator of someone's contract status; however,
Terminology
Abstract
How many days of early behavior suffice for subscription churn prediction? In the public KKBox dataset, the early indicator of churn is typically an indicator of someone's contract status; however, when looking in the heavily churned manual-renewal segment, having access to early behavior creates a substantial increase in prediction for that specific segment (PR +0.10 at 120 days). A nine-window sufficiency curve shows diminishing returns; descriptive inflection detectors place a knee between 30 and 120 days depending on the metric and model class. Stress-testing over three cohort/task designs shows that this curve is singular to the design being tested; for example, in our test with a moving target, the curve inverts and can shift depending on the feature set used. Therefore, any window-sufficiency claim should state its cohort construction, target definition, and feature families. A survival-filtered replication on educational-attrition data (OULAD) confirms the rising-curve shape in one behavior-dominated setting (floor ROC 0.56 vs. 0.88), though signal composition inverts.
Sources
- Rapid Prediction of Player Retention in Free-to-Play Mobile Games
- Early Churn Prediction from Large Scale User-Product Interaction Time Series
- Behavioral Modeling for Churn Prediction: Early Indicators and Accurate Predictors of Custom Defection and Loyalty
- The Efficiency Frontier: A Unified Framework for Cost-Performance Optimization in LLM Context Management
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks