中文
相关论文

相关论文: Trimmed Maximum Likelihood Estimation for Robust L…

200 篇论文

We propose self-adaptive training---a new training algorithm that dynamically corrects problematic training labels by model predictions without incurring extra computational cost---to improve generalization of deep learning for potentially…

机器学习 · 计算机科学 2020-10-01 Lang Huang , Chao Zhang , Hongyang Zhang

We investigate the problem of learning Bayesian networks in a robust model where an $\epsilon$-fraction of the samples are adversarially corrupted. In this work, we study the fully observable discrete case where the structure of the network…

数据结构与算法 · 计算机科学 2018-10-30 Yu Cheng , Ilias Diakonikolas , Daniel Kane , Alistair Stewart

Many modern datasets are collected automatically and are thus easily contaminated by outliers. This led to a regain of interest in robust estimation, including new notions of robustness such as robustness to adversarial contamination of the…

统计理论 · 数学 2023-05-05 Pierre Alquier , Mathieu Gerber

We develop a model selection approach to tackle reinforcement learning with adversarial corruption in both transition and reward. For finite-horizon tabular MDPs, without prior knowledge on the total amount of corruption, our algorithm…

机器学习 · 计算机科学 2024-12-31 Chen-Yu Wei , Christoph Dann , Julian Zimmert

In linear bandits, how can a learner effectively learn when facing corrupted rewards? While significant work has explored this question, a holistic understanding across different adversarial models and corruption measures is lacking, as is…

机器学习 · 计算机科学 2024-10-21 Haolin Liu , Artin Tajdini , Andrew Wagenmaker , Chen-Yu Wei

Quantifying the data uncertainty in learning tasks is often done by learning a prediction interval or prediction set of the label given the input. Two commonly desired properties for learned prediction sets are \emph{valid coverage} and…

机器学习 · 计算机科学 2022-05-31 Yu Bai , Song Mei , Huan Wang , Yingbo Zhou , Caiming Xiong

Machine learning models have exhibited exceptional results in various domains. The most prevalent approach for learning is the empirical risk minimizer (ERM), which adapts the model's weights to reduce the loss on a training set and…

机器学习 · 计算机科学 2024-12-11 Koby Bibas

The best subset selection (or "best subsets") estimator is a classic tool for sparse regression, and developments in mathematical optimization over the past decade have made it more computationally tractable than ever. Notwithstanding its…

统计方法学 · 统计学 2022-01-11 Ryan Thompson

One of the most basic problems in reinforcement learning (RL) is policy evaluation: estimating the long-term return, i.e., value function, corresponding to a given fixed policy. The celebrated Temporal Difference (TD) learning algorithm…

机器学习 · 计算机科学 2025-02-10 Sreejeet Maity , Aritra Mitra

We study the implicit bias of optimization in robust empirical risk minimization (robust ERM) and its connection with robust generalization. In classification settings under adversarial perturbations with linear models, we study what type…

机器学习 · 计算机科学 2024-06-10 Nikolaos Tsilivis , Natalie Frank , Nathan Srebro , Julia Kempe

Distributed gradient descent algorithms have come to the fore in modern machine learning, especially in parallelizing the handling of large datasets that are distributed across several workers. However, scant attention has been paid to…

信号处理 · 电气工程与系统科学 2025-02-06 Shuche Wang , Vincent Y. F. Tan

The phenomenon of adversarial examples in deep learning models has caused substantial concern over their reliability. While many deep neural networks have shown impressive performance in terms of predictive accuracy, it has been shown that…

机器学习 · 计算机科学 2021-06-28 Sadia Chowdhury , Ruth Urner

We consider the structured-output prediction problem through probabilistic approaches and generalize the "perturb-and-MAP" framework to more challenging weighted Hamming losses, which are crucial in applications. While in principle our…

机器学习 · 统计学 2018-11-22 Tatiana Shpakova , Francis Bach , Anton Osokin

We consider robust low rank matrix estimation as a trace regression when outputs are contaminated by adversaries. The adversaries are allowed to add arbitrary values to arbitrary outputs. Such values can depend on any samples. We deal with…

机器学习 · 统计学 2024-05-27 Takeyuki Sasai , Hironori Fujisawa

We study the problem of robust learning under clean-label data-poisoning attacks, where the attacker injects (an arbitrary set of) correctly-labeled examples to the training set to fool the algorithm into making mistakes on specific test…

机器学习 · 计算机科学 2021-07-08 Avrim Blum , Steve Hanneke , Jian Qian , Han Shao

In this paper, we study the problem of sparse mean estimation under adversarial corruptions, where the goal is to estimate the $k$-sparse mean of a heavy-tailed distribution from samples contaminated by adversarial noise. Existing methods…

机器学习 · 计算机科学 2025-08-26 Jianhao Ma , Rui Ray Chen , Yinghui He , Salar Fattahi , Wei Hu

We provide a new computationally-efficient class of estimators for risk minimization. We show that these estimators are robust for general statistical models: in the classical Huber epsilon-contamination model and in heavy-tailed settings.…

机器学习 · 统计学 2018-04-23 Adarsh Prasad , Arun Sai Suggala , Sivaraman Balakrishnan , Pradeep Ravikumar

Adversarially robust learning aims to design algorithms that are robust to small adversarial perturbations on input variables. Beyond the existing studies on the predictive performance to adversarial samples, our goal is to understand…

机器学习 · 统计学 2020-12-21 Yue Xing , Ruizhi Zhang , Guang Cheng

This paper considers the problem of matrix completion when some number of the columns are completely and arbitrarily corrupted, potentially by a malicious adversary. It is well-known that standard algorithms for matrix completion can return…

机器学习 · 统计学 2016-04-26 Yudong Chen , Huan Xu , Constantine Caramanis , Sujay Sanghavi

Given a linear regression setting, Iterative Least Trimmed Squares (ILTS) involves alternating between (a) selecting the subset of samples with lowest current loss, and (b) re-fitting the linear model only on that subset. Both steps are…

机器学习 · 计算机科学 2019-11-13 Yanyao Shen , Sujay Sanghavi