English
Related papers

Related papers: Drift vs Shift: Decoupling Trends and Changepoint …

200 papers

Changepoint models typically assume the data within each segment are independent and identically distributed conditional on some parameters which change across segments. This construction may be inadequate when data are subject to local…

Methodology · Statistics 2021-11-10 Karl L. Hallgren , Nicholas A. Heard , Niall M. Adams

We introduce a framework for online changepoint detection and simultaneous model learning which is applicable to highly parametrized models, such as deep neural networks. It is based on detecting changepoints across time by sequentially…

Machine Learning · Computer Science 2020-10-08 Michalis K. Titsias , Jakub Sygnowski , Yutian Chen

In Continual Learning (CL) contexts, concept drift typically refers to the analysis of changes in data distribution. A drift in the input data can have negative consequences on a learning predictor and the system's stability. The majority…

Machine Learning · Computer Science 2024-10-23 Sebastian Basterrech

Change points in real-world systems mark significant regime shifts in system dynamics, possibly triggered by exogenous or endogenous factors. These points define regimes for the time evolution of the system and are crucial for understanding…

Machine Learning · Statistics 2025-09-30 Ioanna-Yvonni Tsaknaki , Fabrizio Lillo , Piero Mazzarisi

Distributed lag models (DLMs) express the cumulative and delayed dependence between pairs of time-indexed response and explanatory variables. In practical application, users of DLMs examine the estimated influence of a series of lagged…

Applications · Statistics 2018-01-23 Alastair Rushworth

A Bayesian data assimilation scheme is formulated for advection-dominated advective and diffusive evolutionary problems, based upon the Dynamic Likelihood (DLF) approach to filtering. The DLF was developed specifically for hyperbolic…

Dynamical Systems · Mathematics 2024-06-13 Johannes Krotz , Juan M. Restrepo , Jorge Ramirez

In this paper we provide a thorough, rigorous theoretical framework to assess optimality guarantees of sampling-based algorithms for drift control systems: systems that, loosely speaking, can not stop instantaneously due to momentum. We…

Robotics · Computer Science 2015-10-28 Edward Schmerling , Lucas Janson , Marco Pavone

A trained ML model is deployed on another `test' dataset where target feature values (labels) are unknown. Drift is distribution change between the training and deployment data, which is concerning if model performance changes. For a…

Applications · Statistics 2022-09-07 Samuel Ackerman , Eitan Farchi , Orna Raz , Marcel Zalmanovici , Parijat Dube

Motivated by an increasing demand for models that can effectively describe features of complex multivariate time series, e.g. from sensor data in biomechanics, motion analysis, and sports science, we introduce a novel state-space modeling…

Methodology · Statistics 2025-06-23 Alice Giampino , Bernardo Nipoti , Marina Vannucci , Michele Guindani

This paper addresses the issue of detecting change-points in multivariate time series. The proposed approach differs from existing counterparts by making only weak assumptions on both the change-points structure across series, and the…

Methodology · Statistics 2014-07-14 Flore Harlé , Florent Chatelain , Cédric Gouy-Pailler , Sophie Achard

Detecting concept drift in high-speed data streams remains challenging, particularly when models must operate on unlabeled data and avoid false alarms caused by benign shifts. While disagreement-based uncertainty has shown promise in neural…

Machine Learning · Computer Science 2026-05-14 Lara Sá Neves , Afonso Lourenço , Lizy K. John , Goreti Marreiros

Changepoints are abrupt variations in the generative parameters of a data sequence. Online detection of changepoints is useful in modelling and prediction of time series in application areas such as finance, biometrics, and robotics. While…

Machine Learning · Statistics 2007-10-22 Ryan Prescott Adams , David J. C. MacKay

Concept drift -- the change of the distribution over time -- poses significant challenges for learning systems and is of central interest for monitoring. Understanding drift is thus paramount, and drift localization -- determining which…

Machine Learning · Computer Science 2026-04-22 Fabian Hinder , Valerie Vaquet , Johannes Brinkrolf , Barbara Hammer

This paper proposes an online, provably robust, and scalable Bayesian approach for changepoint detection. The resulting algorithm has key advantages over previous work: it provides provable robustness by leveraging the generalised Bayesian…

Machine Learning · Statistics 2023-05-15 Matias Altamirano , François-Xavier Briol , Jeremias Knoblauch

We extend the work of Hahn and Carvalho (2015) and develop a doubly-regularized sparse regression estimator by synthesizing Bayesian regularization with penalized least squares within a decision-theoretic framework. In contrast to existing…

Methodology · Statistics 2025-02-04 Aihua Li , Surya T. Tokdar , Jason Xu

Online algorithms for detecting changepoints, or abrupt shifts in the behavior of a time series, are often deployed with limited resources, e.g., to edge computing settings such as mobile phones or industrial sensors. In these scenarios it…

Machine Learning · Statistics 2021-07-27 Gregory W. Gundersen , Diana Cai , Chuteng Zhou , Barbara E. Engelhardt , Ryan P. Adams

We present a novel method for generating sequential parameter estimates and quantifying epistemic uncertainty in dynamical systems within a data-consistent (DC) framework. The DC framework differs from traditional Bayesian approaches due to…

Methodology · Statistics 2024-05-15 Carlos del-Castillo-Negrete , Rylan Spence , Troy Butler , Clint Dawson

Changes in the timescales at which complex systems evolve are essential to predicting critical transitions and catastrophic failures. Disentangling the timescales of the dynamics governing complex systems remains a key challenge. With this…

Methodology · Statistics 2024-03-11 Giona Casiraghi , Georges Andres

A Bayesian data assimilation scheme is formulated for advection-dominated or hyperbolic evolutionary problems, and observations. The method is referred to as the dynamic likelihood filter because it exploits the model physics to dynamically…

Dynamical Systems · Mathematics 2017-04-26 Juan M. Restrepo

A change points detection aims to catch an abrupt disorder in data distribution. Common approaches assume that there are only two fixed distributions for data: one before and another after a change point. Real-world data are richer than…

Machine Learning · Computer Science 2022-04-18 Alexander Stepikin , Evgenia Romanenkova , Alexey Zaytsev