English
Related papers

Related papers: Automating Data Monitoring: Detecting Structural B…

200 papers

Data quality monitoring is a core challenge in modern information processing systems. While many approaches to detect data errors or shifts have been proposed, few studies investigate the mechanisms governing error generation. We argue that…

Machine Learning · Computer Science 2025-12-05 Philipp Jung , Nicholas Chandler , Sebastian Jäger , Felix Biessmann

This paper addresses the problem of detecting and characterizing local variability in time series and other forms of sequential data. The goal is to identify and characterize statistically significant variations, at the same time…

Instrumentation and Methods for Astrophysics · Physics 2015-06-05 Jeffrey D. Scargle , Jay P. Norris , Brad Jackson , James Chiang

The Bradley-Terry-Luce (BTL) model is a classic and very popular statistical approach for eliciting a global ranking among a collection of items using pairwise comparison data. In applications in which the comparison outcomes are observed…

Methodology · Statistics 2022-11-30 Wanshan Li , Daren Wang , Alessandro Rinaldo

When deployed in the real world, machine learning models inevitably encounter changes in the data distribution, and certain -- but not all -- distribution shifts could result in significant performance degradation. In practice, it may make…

Machine Learning · Statistics 2022-05-06 Aleksandr Podkopaev , Aaditya Ramdas

Determining accurately when regime and structural changes occur in various time-series data is critical in many social and natural sciences. We develop and show further the equivalence of two consistent estimation techniques in locating the…

Statistics Theory · Mathematics 2017-05-31 Fuqi Chen , Rogemar Mamon , Severien Nkurunziza

Change-point processes are one flexible approach to model long time series. We propose a method to uncover which model parameter truly vary when a change-point is detected. Given a set of breakpoints, we use a penalized likelihood approach…

Econometrics · Economics 2024-02-09 Arnaud Dufays , Aristide Houndetoungan , Alain Coën

Detecting change points sequentially in a streaming setting, especially when both the mean and the variance of the signal can change, is often a challenging task. A key difficulty in this context often involves setting an appropriate…

Methodology · Statistics 2022-11-01 Nauman Ahad , Mark A. Davenport , Yao Xie

Change point detection in time series aims to identify moments when the probability distribution of time series changes. It is widely applied in many areas, such as human activity sensing and medical science. In the context of multivariate…

Machine Learning · Computer Science 2025-07-15 Shanyun Gao , Raghavendra Addanki , Tong Yu , Ryan A. Rossi , Murat Kocaoglu

We present a Bayesian method for multivariate changepoint detection that allows for simultaneous inference on the location of a changepoint and the coefficients of a logistic regression model for distinguishing pre-changepoint data from…

Methodology · Statistics 2025-03-11 Andrew M. Thomas , Michael Jauch , David S. Matteson

Structural break identification methods are an important tool for evaluating the effectiveness of climate change mitigation policies. In this paper, we introduce a unified probabilistic framework for detecting structural breaks with unknown…

Econometrics · Economics 2026-03-06 Lucas D. Konrad , Lukas Vashold , Jesus Crespo Cuaresma

This paper presents a statistical analysis of structural changes in the Central England temperature series, one of the longest surface temperature records available. A changepoint analysis is performed to detect abrupt changes, which can be…

Applications · Statistics 2022-10-19 Xueheng Shi , Claudie Beaulieu , Rebecca Killick , Robert Lund

In many change point problems it is reasonable to assume that compared to a benchmark at a given time point $t_0$ the properties of the observed stochastic process change gradually over time for $t >t_0$. Often, these gradual changes are…

Methodology · Statistics 2025-04-23 Patrick Bastian , Holger Dette

Testing for change points in sequences of covariance matrices is an important and equally challenging problem in statistical methodology with applications in various fields. Motivated by the observation that even in cases where the ratio…

Statistics Theory · Mathematics 2026-01-14 Nina Dörnemann , Holger Dette

In the multisensor sequential change detection problem, a disruption occurs in an environment monitored by multiple sensors. This disruption induces a change in the observations of an unknown subset of sensors. In the Byzantine version of…

Statistics Theory · Mathematics 2017-08-25 Georgios Fellouris , Erhan Bayraktar , Lifeng Lai

Change point detection is an important part of time series analysis, as the presence of a change point indicates an abrupt and significant change in the data generating process. While many algorithms for change point detection have been…

Machine Learning · Statistics 2022-02-15 Gerrit J. J. van den Burg , Christopher K. I. Williams

Identifying structural change is a crucial step in analysis of time series and panel data. The longer the time span, the higher the likelihood that the model parameters have changed as a result of major disruptive events, such as the…

Econometrics · Economics 2025-01-23 Jan Ditzen , Yiannis Karavias , Joakim Westerlund

The increasing automation in many areas of the Industry expressly demands to design efficient machine-learning solutions for the detection of abnormal events. With the ubiquitous deployment of sensors monitoring nearly continuously the…

We propose a novel family of test statistics to detect the presence of changepoints in a sequence of dependent, possibly multivariate, functional-valued observations. Our approach allows to test for a very general class of changepoints,…

Methodology · Statistics 2023-10-10 B. Cooper Boniece , Lajos Horváth , Lorenzo Trapani

Many experiments record sequential trajectories where each trajectory consists of oscillations and fluctuations around zero. Such trajectories can be viewed as zero-mean functional data. When there are structural breaks (on the sequence of…

Methodology · Statistics 2022-05-11 Shuhao Jiao , Ron D. Frostig , Hernando Ombao

Continuous soil-moisture measurements provide a direct lens on subsurface hydrological processes, notably the post-rainfall "drydown" phase. Because these records consist of distinct, segment-specific behaviours whose forms and scales vary…

Applications · Statistics 2025-09-17 Mengyi Gong , Christopher Nemeth , Rebecca Killick , Peter Strauss , John Quinton