English
Related papers

Related papers: General Drift Analysis with Tail Bounds

200 papers

Concept drift is the phenomenon in which the underlying data distributions and statistical properties of a target domain change over time, leading to a degradation in model performance. Consequently, production models require continuous…

Machine Learning · Computer Science 2025-08-07 Salvatore Greco , Bartolomeo Vacchetti , Daniele Apiletti , Tania Cerquitelli

The notion of concept drift refers to the phenomenon that the data generating distribution changes over time; as a consequence machine learning models may become inaccurate and need adjustment. In this paper we consider the problem of…

Machine Learning · Computer Science 2022-05-16 Fabian Hinder , André Artelt , Valerie Vaquet , Barbara Hammer

A common bottleneck in evaluating extremal performance measures is that, due to their very nature, tail data are often very limited. The conventional approach selects the best probability distribution from tail data using parametric…

Computation · Statistics 2018-01-03 Henry Lam , Clementine Mottet

The change in data distribution over time, also known as concept drift, poses a significant challenge to the reliability of online learning methods. Existing methods typically require model retraining or drift detection, both of which…

Machine Learning · Computer Science 2025-06-11 Songqiao Hu , Zeyi Liu , Xiao He

In the last decade remarkable progress has been made in development of suitable proof techniques for analysing randomised search heuristics. The theoretical investigation of these algorithms on classes of functions is essential to the…

Neural and Evolutionary Computing · Computer Science 2020-10-22 Frank Neumann , Mojgan Pourhassan , Carsten Witt

We present upper and lower bounds for the tail distribution of the stationary waiting time $D$ in the stable $GI/GI/s$ FCFS queue. These bounds depend on the value of the traffic load $\rho$ which is the ratio of mean service and mean…

Probability · Mathematics 2013-03-20 Sergey Foss , Dmitry Korshunov

Climate models are often affected by long-term drift that is revealed by the evolution of global variables such as the ocean temperature or the surface air temperature. This spurious trend reduces the fidelity to initial conditions and has…

Atmospheric and Oceanic Physics · Physics 2017-09-20 Maura Brunetti , Christian Vérard

Consider the problem of learning the drift coefficient of a $p$-dimensional stochastic differential equation from a sample path of length $T$. We assume that the drift is parametrized by a high-dimensional vector, and study the support…

Information Theory · Computer Science 2013-08-21 Jose Bento , Morteza Ibrahimi

We introduce a new approach for decoupling trends (drift) and changepoints (shifts) in time series. Our locally adaptive model-based approach for robustly decoupling combines Bayesian trend filtering and machine learning based…

Methodology · Statistics 2024-01-09 Haoxuan Wu , Toryn L. J. Schafer , Sean Ryan , David S. Matteson

National statistical institutes currently investigate how to improve the output quality of official statistics based on machine learning algorithms. A key obstacle is concept drift, i.e., when the joint distribution of independent variables…

Methodology · Statistics 2021-03-02 Quinten Meertens , Cees Diks , Jaap van den Herik , Frank Takes

We study nonparametric density estimation in non-stationary drift settings. Given a sequence of independent samples taken from a distribution that gradually changes in time, the goal is to compute the best estimate for the current…

Machine Learning · Computer Science 2023-10-31 Alessio Mazzetto , Eli Upfal

Data Drift is the phenomenon where the generating model behind the data changes over time. Due to data drift, any model built on the past training data becomes less relevant and inaccurate over time. Thus, detecting and controlling for data…

Machine Learning · Computer Science 2025-04-29 Subhadip Bandyopadhyay , Joy Bose , Sujoy Roy Chowdhury

We propose a novel approach for detecting change points in high-dimensional linear regression models. Unlike previous research that relied on strict Gaussian/sub-Gaussian error assumptions and had prior knowledge of change points, we…

Methodology · Statistics 2024-05-22 Bin Liu , Zhengling Qi , Xinsheng Zhang , Yufeng Liu

A fundamental problem in machine learning is understanding the effect of early stopping on the parameters obtained and the generalization capabilities of the model. Even for linear models, the effect is not fully understood for arbitrary…

Machine Learning · Computer Science 2024-06-10 Rishi Sonthalia , Jackie Lok , Elizaveta Rebrova

Adaptive multilevel splitting algorithms have been introduced rather recently for estimating tail distributions in a fast and efficient way. In particular, they can be used for computing the so-called reactive trajectories corresponding to…

Numerical Analysis · Mathematics 2014-12-25 Joran Rolland , Eric Simonnet

Urban time series data forecasting featuring significant contributions to sustainable development is widely studied as an essential task of the smart city. However, with the dramatic and rapid changes in the world environment, the…

Machine Learning · Computer Science 2023-11-27 Zekun Cai , Renhe Jiang , Xinyu Yang , Zhaonan Wang , Diansheng Guo , Hiroki Kobayashi , Xuan Song , Ryosuke Shibasaki

The main objective of the paper is to improve the Round Robin (RR) algorithm using dynamic ITS by coalescing it with Shortest Remaining Time Next (SRTN) algorithm thus reducing the average waiting time, average turnaround time and the…

Operating Systems · Computer Science 2011-03-22 H. S. Behera , Simpi Patel , Bijayalakshmi Panda

Learning the tail behavior of a distribution is a notoriously difficult problem. By definition, the number of samples from the tail is small, and deep generative models, such as normalizing flows, tend to concentrate on learning the body of…

Machine Learning · Computer Science 2022-06-28 Mike Laszkiewicz , Johannes Lederer , Asja Fischer

Data distributions in streaming environments are usually not stationary. In order to maintain a high predictive quality at all times, online learning models need to adapt to distributional changes, which are known as concept drift. The…

Machine Learning · Computer Science 2022-03-31 Johannes Haug , Gjergji Kasneci

Recently, a new paradigm named \emph{drifting model} has been proposed for mapping distributions, which achieves the SOTA image generation performance over ImageNet via one-step neural functional evaluation (NFE). The basic idea is to…

Machine Learning · Computer Science 2026-05-07 Guoqiang Zhang , Kenta Niwa , W. Bastiaan Kleijn