English
Related papers

Related papers: Minimax Classification under Concept Drift with Mu…

200 papers

Prediction models frequently face the challenge of concept drift, in which the underlying data distribution changes over time, weakening performance. Examples can include models which predict loan default, or those used in healthcare…

Machine Learning · Computer Science 2024-12-16 Louis Chislett , Catalina A. Vallejos , Timothy I. Cannings , James Liley

We generalize the notion of minimax convergence rate. In contrast to the standard definition, we do not assume that the sample size is fixed in advance. Allowing for varying sample size results in time-robust minimax rates and estimators.…

Statistics Theory · Mathematics 2021-06-01 Alisa Kirichenko , Peter Grünwald

Concept drift, i.e., the change of the data generating distribution, can render machine learning models inaccurate. Several works address the phenomenon of concept drift in the streaming context usually assuming that consecutive data points…

Machine Learning · Computer Science 2023-12-19 Fabian Hinder , Valerie Vaquet , Barbara Hammer

This paper addresses the problem of unsupervised domain adaption from theoretical and algorithmic perspectives. Existing domain adaptation theories naturally imply minimax optimization algorithms, which connect well with the domain…

Machine Learning · Computer Science 2019-07-24 Yuchen Zhang , Tianle Liu , Mingsheng Long , Michael I. Jordan

In this correspondence, we will point out a problem with testing adaptive classifiers on autocorrelated data. In such a case random change alarms may boost the accuracy figures. Hence, we cannot be sure if the adaptation is working well.

Machine Learning · Computer Science 2013-01-17 Indre Zliobaite

Data-driven predictive analytics are in use today across a number of industrial applications, but further integration is hindered by the requirement of similarity among model training and test data distributions. This paper addresses the…

Machine Learning · Computer Science 2017-10-20 Yunwen Xu , Rui Xu , Weizhong Yan , Paul Ardis

Transfer learning for nonparametric regression is considered. We first study the non-asymptotic minimax risk for this problem and develop a novel estimator called the confidence thresholding estimator, which is shown to achieve the minimax…

Machine Learning · Statistics 2024-01-24 T. Tony Cai , Hongming Pu

The deployment of multimodal models in high-stakes domains, such as self-driving vehicles and medical diagnostics, demands not only strong predictive performance but also reliable mechanisms for detecting failures. In this work, we address…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Moru Liu , Hao Dong , Olga Fink , Mario Trapp

Recent development in computing, sensing and crowd-sourced data have resulted in an explosion in the availability of quantitative information. The possibilities of analyzing this so-called Big Data to inform research and the decision-making…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-09 Nguyen Ho , Huy Vo , Mai Vu , Torben Bach Pedersen

Modern analytical systems must be ready to process streaming data and correctly respond to data distribution changes. The phenomenon of changes in data distributions is called concept drift, and it may harm the quality of the used models.…

Machine Learning · Computer Science 2021-10-26 Jędrzej Kozal , Filip Guzy , Michał Woźniak

A fundamental issue for statistical classification models in a streaming environment is that the joint distribution between predictor and response variables changes over time (a phenomenon also known as concept drifts), such that their…

Machine Learning · Statistics 2019-02-11 Shujian Yu , Zubin Abraham , Heng Wang , Mohak Shah , Yantao Wei , José C. Príncipe

Machine learning models are often brittle under distribution shift, i.e., when data distributions at test time differ from those during training. Understanding this failure mode is central to identifying and mitigating safety risks of mass…

Machine Learning · Statistics 2025-07-04 Alex Nguyen , David J. Schwab , Vudtiwat Ngampruetikorn

Click-through rate (CTR) prediction is a crucial task in web search, recommender systems, and online advertisement displaying. In practical application, CTR models often serve with high-speed user-generated data streams, whose underlying…

Information Retrieval · Computer Science 2023-02-24 Congcong Liu , Yuejiang Li , Fei Teng , Xiwei Zhao , Changping Peng , Zhangang Lin , Jinghe Hu , Jingping Shao

Conventional techniques for supervised classification constrain the classification rules considered and use surrogate losses for classification 0-1 loss. Favored families of classification rules are those that enjoy parametric…

Machine Learning · Statistics 2019-06-03 Santiago Mazuelas , Andrea Zanoni , Aritz Perez

Adaptive Risk Control (ARC) is an online calibration strategy based on set prediction that offers worst-case deterministic long-term risk control, as well as statistical marginal coverage guarantees. ARC adjusts the size of the prediction…

Machine Learning · Statistics 2024-10-11 Matteo Zecchin , Osvaldo Simeone

We consider exact asymptotics of the minimax risk for global testing against sparse alternatives in the context of high dimensional linear regression. Our results characterize the leading order behavior of this minimax risk in several…

Statistics Theory · Mathematics 2020-03-03 Rajarshi Mukherjee , Subhabrata Sen

The goal of model reference adaptive control (MRAC) is to ensure that the trajectories of an unknown dynamical system track those of a given reference model. This is done by means of a feedback controller that adaptively changes its gains…

Optimization and Control · Mathematics 2026-03-16 Jiwei Wang , Simone Baldi , Henk J. van Waarde

Given the rapidly evolving nature of social media and people's views, word usage changes over time. Consequently, the performance of a classifier trained on old textual data can drop dramatically when tested on newer data. While research in…

Computation and Language · Computer Science 2021-08-31 Rabab Alkhalifa , Elena Kochkina , Arkaitz Zubiaga

Transfer learning aims to improve inference in a target domain by leveraging information from related source domains, but its effectiveness critically depends on how cross-domain heterogeneity is modeled and controlled. When the conditional…

Statistics Theory · Mathematics 2026-02-23 Hanxiao Chen , Debarghya Mukherjee

This paper develops a new model reference adaptive control (MRAC) framework using partial-state feedback for solving a multivariable adaptive output tracking problem. The developed MRAC scheme has full capability to deal with plant…

Systems and Control · Electrical Eng. & Systems 2020-05-05 Ge Song , Gang Tao