English
Related papers

Related papers: Online Robust Mean Estimation

200 papers

The presence of data corruption in user-generated streaming data, such as social media, motivates a new fundamental problem that learns reliable regression coefficient when features are not accessible entirely at one time. Until now,…

Machine Learning · Computer Science 2019-02-06 Xuchao Zhang , Shuo Lei , Liang Zhao , Arnold P. Boedihardjo , Chang-Tien Lu

In this paper the accuracy and robustness of quality measures for the assessment of machine learning models are investigated. The prediction quality of a machine learning model is evaluated model-independent based on a cross-validation…

Machine Learning · Statistics 2024-10-07 Thomas Most , Lars Gräning , Sebastian Wolff

We investigate online convex optimization in non-stationary environments and choose dynamic regret as the performance measure, defined as the difference between cumulative loss incurred by the online algorithm and that of any feasible…

Machine Learning · Computer Science 2024-04-09 Peng Zhao , Yu-Jie Zhang , Lijun Zhang , Zhi-Hua Zhou

In recent years, functional linear models have attracted growing attention in statistics and machine learning, with the aim of recovering the slope function or its functional predictor. This paper considers online regularized learning…

Machine Learning · Statistics 2022-11-28 Yuan Mao , Zheng-Chu Guo

We study online control of an unknown nonlinear dynamical system that is approximated by a time-invariant linear system with model misspecification. Our study focuses on robustness, a measure of how much deviation from the assumed linear…

Optimization and Control · Mathematics 2022-04-06 Xinyi Chen , Udaya Ghai , Elad Hazan , Alexandre Megretski

We study the task of high-dimensional entangled mean estimation in the subset-of-signals model. Specifically, given $N$ independent random points $x_1,\ldots,x_N$ in $\mathbb{R}^D$ and a parameter $\alpha \in (0, 1)$ such that each $x_i$ is…

Data Structures and Algorithms · Computer Science 2025-01-10 Ilias Diakonikolas , Daniel M. Kane , Sihan Liu , Thanasis Pittas

The true online TD({\lambda}) algorithm has recently been proposed (van Seijen and Sutton, 2014) as a universal replacement for the popular TD({\lambda}) algorithm, in temporal-difference learning and reinforcement learning. True online…

Artificial Intelligence · Computer Science 2015-07-03 Harm van Seijen , A. Rupam Mahmood , Patrick M. Pilarski , Richard S. Sutton

We are interested in the problem of robust parametric estimation of a density from $n$ i.i.d. observations. By using a practice-oriented procedure based on robust tests, we build an estimator for which we establish non-asymptotic risk…

Statistics Theory · Mathematics 2016-03-31 Mathieu Sart

Algorithmic stability is a central concept in statistics and learning theory that measures how sensitive an algorithm's output is to small changes in the training data. Stability plays a crucial role in understanding generalization,…

Statistics Theory · Mathematics 2026-01-21 Abhinav Chakraborty , Yuetian Luo , Rina Foygel Barber

Predictive Process Monitoring aims to forecast the future progress of process instances using historical event data. As predictive process monitoring is increasingly applied in online settings to enable timely interventions, evaluating the…

Machine Learning · Computer Science 2023-10-16 Suhwan Lee , Marco Comuzzi , Xixi Lu , Hajo A. Reijers

The problem of distributed dynamic state estimation in wireless sensor networks is studied. Two important properties of local estimates, namely, the consistency and confidence, are emphasized. On one hand, the consistency, which means that…

Information Theory · Computer Science 2016-11-15 Shaocheng Wang , Wei Ren

Most existing distance metric learning methods assume perfect side information that is usually given in pairwise or triplet constraints. Instead, in many real-world applications, the constraints are derived from side information, such as…

Machine Learning · Computer Science 2012-03-19 Kaizhu Huang , Rong Jin , Zenglin Xu , Cheng-Lin Liu

Accurate uncertainty estimates are important in sequential model-based decision-making tasks such as Bayesian optimization. However, these estimates can be imperfect if the data violates assumptions made by the model (e.g., Gaussianity).…

Machine Learning · Computer Science 2024-06-27 Shachi Deshpande , Charles Marx , Volodymyr Kuleshov

We study the problem of high-dimensional linear regression in a robust model where an $\epsilon$-fraction of the samples can be adversarially corrupted. We focus on the fundamental setting where the covariates of the uncorrupted samples are…

Machine Learning · Computer Science 2018-06-04 Ilias Diakonikolas , Weihao Kong , Alistair Stewart

We consider the problem of online active learning to collect data for regression modeling. Specifically, we consider a decision maker with a limited experimentation budget who must efficiently learn an underlying linear population model.…

Machine Learning · Statistics 2016-12-22 Carlos Riquelme , Ramesh Johari , Baosen Zhang

We study a new variant of consensus problems, termed `local average consensus', in networks of agents. We consider the task of using sensor networks to perform distributed measurement of a parameter which has both spatial (in this paper 1D)…

Systems and Control · Computer Science 2013-09-02 Kai Cai , Brian D. O. Anderson , Changbin Yu , Guoqiang Mao

We study the problem of robust estimation under heterogeneous corruption rates, where each sample may be independently corrupted with a known but non-identical probability. This setting arises naturally in distributed and federated…

Machine Learning · Computer Science 2025-10-02 Syomantak Chaudhuri , Jerry Li , Thomas A. Courtade

In this work we revisit two classic high-dimensional online learning problems, namely linear regression and contextual bandits, from the perspective of adversarial robustness. Existing works in algorithmic robust statistics make strong…

Machine Learning · Computer Science 2021-06-14 Sitan Chen , Frederic Koehler , Ankur Moitra , Morris Yau

This paper is devoted to the estimators of the mean that provide strong non-asymptotic guarantees under minimal assumptions on the underlying distribution. The main ideas behind proposed techniques are based on bridging the notions of…

Statistics Theory · Mathematics 2019-05-07 Stanislav Minsker

Currently, reinforcement learning (RL), especially deep RL, has received more and more attention in the research area. However, the security of RL has been an obvious problem due to the attack manners becoming mature. In order to defend…

Machine Learning · Computer Science 2023-10-04 Jiarui Yao , Simon Shaolei Du
‹ Prev 1 3 4 5 6 7 10 Next ›