English
Related papers

Related papers: Testing For Distribution Shifts with Conditional C…

200 papers

In this paper, we propose an easy-to-implement residual-based specification testing procedure for detecting structural changes in factor models, which is powerful against both smooth and abrupt structural changes with unknown break dates.…

Econometrics · Economics 2025-01-22 Bin Peng , Liangjun Su , Yayi Yan

Uncertainty is critical to reliable decision-making with machine learning. Conformal prediction (CP) handles uncertainty by predicting a set on a test input, hoping the set to cover the true label with at least $(1-\alpha)$ confidence. This…

Machine Learning · Computer Science 2024-03-25 Rui Xu , Yue Sun , Chao Chen , Parv Venkitasubramaniam , Sihong Xie

There is a growing interest in the so-called Bayesian Predictive Inference approach, which allows to perform Bayesian inference without specifying the likelihood and prior of the model, or the need of any MCMC. Instead, only a sequence of…

Statistics Theory · Mathematics 2025-09-30 Marco Battiston , Lorenzo Cappello

This article proposes a novel test for the martingale difference hypothesis based on the martingale difference divergence function, a recently developed dependence measure suitable for measuring the degree of conditional mean dependence of…

Applications · Statistics 2023-11-10 Luca Mattia Rolla

Novel significance tests are proposed for the quite general additive concurrent model formulation without the need of model, error structure preliminary estimation or the use of tuning parameters. Making use of the martingale difference…

We continue study of conformal testing in binary model situations. In this note we consider Markov alternatives to the null hypothesis of exchangeability. We propose two new classes of conformal test martingales; one class is statistically…

Statistics Theory · Mathematics 2021-11-04 Vladimir Vovk , Ilia Nouretdinov , Alex Gammerman

Conformal prediction is a flexible framework for calibrating machine learning predictions, providing distribution-free statistical guarantees. In outlier detection, this calibration relies on a reference set of labeled inlier data to…

Machine Learning · Statistics 2025-06-17 Meshi Bashari , Matteo Sesia , Yaniv Romano

Conformal prediction is a general distribution-free approach for constructing prediction sets combined with any machine learning algorithm that achieve valid marginal or conditional coverage in finite samples. Ordinal classification is…

Methodology · Statistics 2024-11-05 Subhrasish Chakraborty , Chhavi Tyagi , Haiyan Qiao , Wenge Guo

Variable screening has been a useful research area that deals with ultrahigh-dimensional data. When there exist both marginally and jointly dependent predictors to the response, existing methods such as conditional screening or iterative…

Methodology · Statistics 2023-07-10 Lei Fang , Qingcong Yuan , Xiangrong Yin , Chenglong Ye

Randomized Controlled Trials (RCT)s are relied upon to assess new treatments, but suffer from limited power to guide personalized treatment decisions. On the other hand, observational (i.e., non-experimental) studies have large and diverse…

Methodology · Statistics 2023-03-07 Zeshan Hussain , Ming-Chieh Shih , Michael Oberst , Ilker Demirel , David Sontag

Prediction sets provide a means of quantifying the uncertainty in predictive tasks. Using held out calibration data, conformal prediction and risk control can produce prediction sets that exhibit statistically valid error control in a…

Machine Learning · Statistics 2026-02-05 Bror Hultberg , Dave Zachariah , Antônio H. Ribeiro

When deployed in the real world, machine learning models inevitably encounter changes in the data distribution, and certain -- but not all -- distribution shifts could result in significant performance degradation. In practice, it may make…

Machine Learning · Statistics 2022-05-06 Aleksandr Podkopaev , Aaditya Ramdas

Spatial interaction between two or more classes or species has important implications in various fields and causes multivariate patterns such as segregation or association. Segregation occurs when members of a class or species are more…

Methodology · Statistics 2009-02-09 Elvan Ceyhan

Modern image classifiers are very accurate, but the predictions come without uncertainty estimates. Conformal predictors provide uncertainty estimates by computing a set of classes containing the correct class with a user-specified…

Machine Learning · Computer Science 2023-06-06 Fatih Furkan Yilmaz , Reinhard Heckel

This paper proposes new parametric model adequacy tests for possibly nonlinear and nonstationary time series models with noncontinuous data distribution, which is often the case in applied work. In particular, we consider the correct…

Statistics Theory · Mathematics 2021-08-10 Igor Kheifets , Carlos Velasco

We propose a sequential, anytime-valid method to test the conditional independence of a response $Y$ and a predictor $X$ given a random vector $Z$. The proposed test is based on e-statistics and test martingales, which generalize likelihood…

Methodology · Statistics 2023-02-22 Peter Grünwald , Alexander Henzi , Tyron Lardy

Multivariate time-series anomaly detection (MTSAD) aims to identify deviations from normality in multivariate time-series and is critical in real-world applications. However, in real-world deployments, distribution shifts are ubiquitous and…

Machine Learning · Computer Science 2026-04-03 HyunGi Kim , Jisoo Mok , Hyungyu Lee , Juhyeon Shin , Sungroh Yoon

We provide a new estimation method for conditional moment models via the martingale difference divergence (MDD).Our MDD-based estimation method is formed in the framework of a continuum of unconditional moment restrictions. Unlike the…

Econometrics · Economics 2024-04-18 Kunyang Song , Feiyu Jiang , Ke Zhu

The application of machine learning models can be significantly impeded by the occurrence of distributional shifts, as the assumption of homogeneity between the population of training and testing samples in machine learning and statistics…

Machine Learning · Statistics 2023-06-06 Wenlu Tang , Zicheng Liu

Quantum key distribution (QKD) security fundamentally relies on the ability to distinguish genuine quantum correlations from classical eavesdropper simulations, yet existing certification methods lack rigorous statistical guarantees under…

Quantum Physics · Physics 2025-12-04 Davut Emre Tasar , Ceren Ocal Tasar