English

Causal Parametric Drift Simulation: A Digital Twin Framework for Classifier Robustness Evaluation

Machine Learning 2026-05-12 v1 Artificial Intelligence

Abstract

Machine learning classifiers in dynamic environments face concept drift -- changes in the data-generating process that degrade performance. Conventional evaluation via static test sets or noise perturbations fails to preserve causal dependencies in tabular data, often producing causally invalid assessments. Post-hoc tools like SHAP and LIME offer correlational insights that may not reflect the causal mechanisms driving model failure. We propose a framework that complements existing drift detection by leveraging Structural Causal Models as "Digital Twins" of data-generating processes, enabling precise causal interventions while preserving structural dependencies. Our technique, Causal Parametric Drift Simulation, stress-tests classifiers to identify vulnerabilities before deployment. Experiments on the Open Sourcing Mental Illness (OSMH) dataset demonstrate that this approach exposes latent vulnerabilities invisible to standard statistical monitors.

Keywords

Cite

@article{arxiv.2605.09663,
  title  = {Causal Parametric Drift Simulation: A Digital Twin Framework for Classifier Robustness Evaluation},
  author = {Julien Lafrance and Richard Khoury and Véronique Tremblay},
  journal= {arXiv preprint arXiv:2605.09663},
  year   = {2026}
}

Comments

34 pages, 13 figures, 14 tables