English
Related papers

Related papers: Robust Regression via Online Feature Selection und…

200 papers

Machine-learning models demand periodic updates to improve their average accuracy, exploiting novel architectures and additional data. However, a newly updated model may commit mistakes the previous model did not make. Such…

Machine Learning · Computer Science 2025-05-30 Daniele Angioni , Luca Demetrio , Maura Pintor , Luca Oneto , Davide Anguita , Battista Biggio , Fabio Roli

Randomized smoothing has shown promising certified robustness against adversaries in classification tasks. Despite such success with only zeroth-order access to base models, randomized smoothing has not been extended to a general form of…

Machine Learning · Computer Science 2024-05-16 Aref Miri Rekavandi , Olga Ohrimenko , Benjamin I. P. Rubinstein

As predictive models are increasingly being deployed in high-stakes decision making (e.g., loan approvals), there has been growing interest in post hoc techniques which provide recourse to affected individuals. These techniques generate…

Machine Learning · Computer Science 2021-07-14 Sohini Upadhyay , Shalmali Joshi , Himabindu Lakkaraju

Streaming feature selection techniques have become essential in processing real-time data streams, as they facilitate the identification of the most relevant attributes from continuously updating information. Despite their performance,…

Machine Learning · Computer Science 2024-06-21 Zhangling Duan , Tianci Li , Xingyu Wu , Zhaolong Ling , Jingye Yang , Zhaohong Jia

Algorithms are increasingly common components of high-impact decision-making, and a growing body of literature on adversarial examples in laboratory settings indicates that standard machine learning models are not robust. This suggests that…

Machine Learning · Statistics 2018-11-28 Suproteem K. Sarkar , Kojin Oshiba , Daniel Giebisch , Yaron Singer

We study episodic reinforcement learning under unknown adversarial corruptions in both the rewards and the transition probabilities of the underlying system. We propose new algorithms which, compared to the existing results in (Lykouris et…

Machine Learning · Computer Science 2021-03-09 Yifang Chen , Simon S. Du , Kevin Jamieson

Online-learning literature has focused on designing algorithms that ensure sub-linear growth of the cumulative long-term constraint violations. The drawback of this guarantee is that strictly feasible actions may cancel out constraint…

Optimization and Control · Mathematics 2019-10-22 Ezra Tampubolon , Holger Boche

Modern stochastic optimization methods often rely on uniform sampling which is agnostic to the underlying characteristics of the data. This might degrade the convergence by yielding estimates that suffer from a high variance. A possible…

Machine Learning · Statistics 2018-06-07 Zalán Borsos , Andreas Krause , Kfir Y. Levy

Fully robust versions of the elastic net estimator are introduced for linear and logistic regression. The algorithms to compute the estimators are based on the idea of repeatedly applying the non-robust classical estimators to data subsets…

Methodology · Statistics 2017-03-16 Fatma Sevinc Kurnaz , Irene Hoffmann , Peter Filzmoser

Learning policy from offline datasets through offline reinforcement learning (RL) holds promise for scaling data-driven decision-making while avoiding unsafe and costly online interactions. However, real-world data collected from sensors or…

Machine Learning · Computer Science 2025-03-04 Jiawei Xu , Rui Yang , Shuang Qiu , Feng Luo , Meng Fang , Baoxiang Wang , Lei Han

The online portfolio selection (OLPS) problem differs from classical portfolio model problems, as it involves making sequential investment decisions. Many OLPS strategies described in the literature capture market movement based on various…

Portfolio Management · Quantitative Finance 2022-06-03 Man Yiu Tsang , Tony Sit , Hoi Ying Wong

This paper considers the problem of supervised learning with linear methods when both features and labels can be corrupted, either in the form of heavy tailed data and/or corrupted rows. We introduce a combination of coordinate gradient…

Machine Learning · Statistics 2022-02-01 Stéphane Gaïffas , Ibrahim Merad

Invariance to a broad array of image corruptions, such as warping, noise, or color shifts, is an important aspect of building robust models in computer vision. Recently, several new data augmentations have been proposed that significantly…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Eric Mintun , Alexander Kirillov , Saining Xie

We study the linear contextual bandit problem in the presence of adversarial corruption, where the reward at each round is corrupted by an adversary, and the corruption level (i.e., the sum of corruption magnitudes over the horizon) is…

Machine Learning · Computer Science 2022-07-12 Jiafan He , Dongruo Zhou , Tong Zhang , Quanquan Gu

We study the problem of conformal prediction in a novel online framework that directly optimizes efficiency. In our problem, we are given a target miscoverage rate $\alpha > 0$, and a time horizon $T$. On each day $t \le T$ an algorithm…

Machine Learning · Computer Science 2025-10-23 Vaidehi Srinivas

We study the problem of Robust Least Squares Regression (RLSR) where several response variables can be adversarially corrupted. More specifically, for a data matrix X \in R^{p x n} and an underlying model w*, the response vector is…

Machine Learning · Computer Science 2015-06-09 Kush Bhatia , Prateek Jain , Purushottam Kar

A robust estimator for a wide family of mixtures of linear regression is presented. Robustness is based on the joint adoption of the Cluster Weighted Model and of an estimator based on trimming and restrictions. The selected model provides…

Methodology · Statistics 2015-02-05 L. A. Garcia-Escudero , A. Gordaliza , F. Greselin , S. Ingrassia , A. Mayo-Iscar

We adopt the statistical framework on robustness proposed by Watson and Holmes in 2016 and then tackle the practical challenges that hinder its applicability to network models. The goal is to evaluate how the quality of an inference for a…

Methodology · Statistics 2020-12-08 Marios Papamichalis , Simon Lunagomez , Patrick J. Wolfe

We are interested in probabilistic prediction in online settings in which data does not follow a probability distribution. Our work seeks to achieve two goals: (1) producing valid probabilities that accurately reflect model confidence; and…

Machine Learning · Computer Science 2024-06-06 Shachi Deshpande , Charles Marx , Volodymyr Kuleshov

This paper presents a fast methodology, called ROBOUT, to identify outliers in a response variable conditional on a set of linearly related predictors, retrieved from a large granular dataset. ROBOUT is shown to be effective and…

Methodology · Statistics 2021-04-27 Matteo Farnè , Angelos Vouldis