English
Related papers

Related papers: Minimax Classification under Concept Drift with Mu…

200 papers

This paper investigates the problem of designing data-driven stochastic Model Predictive Control (MPC) for linear time-invariant systems under additive stochastic disturbance, whose probability distribution is unknown but can be partially…

Optimization and Control · Mathematics 2020-12-29 Chao Ning , Fengqi You

New data acquisition technologies allow one to gather huge amounts of data that are best represented as functional data. In this setting, profile monitoring assesses the stability over time of both univariate and multivariate functional…

Methodology · Statistics 2025-04-15 Fabio Centofanti , Antonio Lepore , Biagio Palumbo

The last decade has seen a surge of interest in adaptive learning algorithms for data stream classification, with applications ranging from predicting ozone level peaks, learning stock market indicators, to detecting computer security…

Machine Learning · Statistics 2018-08-13 Ali Pesaranghader , Herna Viktor , Eric Paquet

In-Context Reinforcement Learning (ICRL) enables agents to learn automatically and on-the-fly from their interactive experiences. However, a major challenge in scaling up ICRL is the lack of scalable task collections. To address this, we…

Machine Learning · Computer Science 2025-11-04 Fan Wang , Pengtao Shao , Yiming Zhang , Bo Yu , Shaoshan Liu , Ning Ding , Yang Cao , Yu Kang , Haifeng Wang

Mini-batch stochastic gradient descent and variants thereof have become standard for large-scale empirical risk minimization like the training of neural networks. These methods are usually used with a constant batch size chosen by simple…

Machine Learning · Computer Science 2017-06-29 Lukas Balles , Javier Romero , Philipp Hennig

Advanced classification algorithms are being increasingly used in safety-critical applications like health-care, engineering, etc. In such applications, miss-classifications made by ML algorithms can result in substantial financial or…

Machine Learning · Computer Science 2024-12-06 Disha Ghandwani , Neeraj Sarna , Yuanyuan Li , Yang Lin

Explanation faithfulness of model predictions in natural language processing is typically evaluated on held-out data from the same temporal distribution as the training data (i.e. synchronous settings). While model performance often…

Computation and Language · Computer Science 2022-10-18 Zhixue Zhao , George Chrysostomou , Kalina Bontcheva , Nikolaos Aletras

Machine reading comprehension (MRC) has become a core component in a variety of natural language processing (NLP) applications such as question answering and dialogue systems. It becomes a practical challenge that an MRC model needs to…

Information Retrieval · Computer Science 2020-08-26 Lixin Su , Jiafeng Guo , Ruqing Zhang , Yixing Fan , Yanyan Lan , Xueqi Cheng

Stochastic optimization in learning and inference often relies on Markov chain Monte Carlo (MCMC) to approximate gradients when exact computation is intractable. However, finite-time MCMC estimators are biased, and reducing this bias…

Statistics Theory · Mathematics 2026-02-02 Antoine Godichon-Baggioni , Gabriel Lang , Sylvain Le Corff , Julien Stoehr , Sobihan Surendran

Despite the enormous success of machine learning models in various applications, most of these models lack resilience to (even small) perturbations in their input data. Hence, new methods to robustify machine learning models seem very…

Machine Learning · Computer Science 2020-10-30 Fariborz Salehi , Babak Hassibi

Adapting to drifting data streams is a significant challenge in online learning. Concept drift must be detected for effective model adaptation to evolving data properties. Concept drift can impact the data distribution entirely or…

Machine Learning · Computer Science 2023-12-12 Gabriel J. Aguiar , Alberto Cano

This paper studies the model selection problem in a large class of causal time series models, which includes both the ARMA or AR($\infty$) processes, as well as the GARCH or ARCH($\infty$), APARCH, ARMA-GARCH and many others processes. We…

Statistics Theory · Mathematics 2021-10-20 Jean-Marc Bardet , Kamila Kare , William Kengne

Initially designed for independent datas, low-rank matrix completion was successfully applied in many domains to the reconstruction of partially observed high-dimensional time series. However, there is a lack of theory to support the…

Statistics Theory · Mathematics 2022-05-05 Pierre Alquier , Nicolas Marie , Amélie Rosier

We study methods for aggregating pairwise comparison data in order to estimate outcome probabilities for future comparisons among a collection of n items. Working within a flexible framework that imposes only a form of strong stochastic…

Machine Learning · Computer Science 2016-03-23 Nihar B. Shah , Sivaraman Balakrishnan , Martin J. Wainwright

Resource-constrained classification tasks are common in real-world applications such as allocating tests for disease diagnosis, hiring decisions when filling a limited number of positions, and defect detection in manufacturing settings…

Machine Learning · Computer Science 2023-11-22 Danit Shifman Abukasis , Izack Cohen , Xiaochen Xian , Kejun Huang , Gonen Singer

Modern data analytics take advantage of ensemble learning and transfer learning approaches to tackle some of the most relevant issues in data analysis, such as lack of labeled data to use to train the analysis models, sparsity of the…

Theoretical studies on transfer learning or domain adaptation have so far focused on situations with a known hypothesis class or model; however in practice, some amount of model selection is usually involved, often appearing under the…

Machine Learning · Statistics 2023-10-13 Steve Hanneke , Samory Kpotufe , Yasaman Mahdaviyeh

The cubic regularization method (CR) and its adaptive version (ARC) are popular Newton-type methods in solving unconstrained non-convex optimization problems, due to its global convergence to local minima under mild conditions. The main aim…

Optimization and Control · Mathematics 2022-10-13 Yihang Gao , Michael K. Ng

This study presents the Adaptive Minimum-Variance Portfolio (AMVP) framework and the Adaptive Minimum-Risk Rate (AMRR) metric, innovative tools designed to optimize portfolios dynamically in volatile and nonstationary financial markets.…

Econometrics · Economics 2025-01-28 Ayush Jha , Abootaleb Shirvani , Ali Jaffri , Svetlozar T. Rachev , Frank J. Fabozzi

In this work we study the semi-supervised framework of confidence set classification with controlled expected size in minimax settings. We obtain semi-supervised minimax rates of convergence under the margin assumption and a H{\"o}lder…

Statistics Theory · Mathematics 2019-04-30 Evgenii Chzhen , Christophe Denis , Mohamed Hebiri