English
Related papers

Related papers: Robust Structured Statistical Estimation via Condi…

200 papers

Conformal prediction (CP) converts any model's output to prediction sets with a guarantee to cover the true label with (adjustable) high probability. Robust CP extends this guarantee to worst-case (adversarial) inputs. Existing baselines…

Machine Learning · Computer Science 2025-03-10 Soroush H. Zargarbashi , Aleksandar Bojchevski

The requirement to generate robust robotic platforms is a critical enabling step to allow such platforms to permeate safety-critical applications (i.e., the localization of autonomous platforms in urban environments). One of the primary…

Signal Processing · Electrical Eng. & Systems 2019-08-14 Ryan M. Watson , Jason N. Gross , Clark N. Taylor , Robert C. Leishman

Many biological high-throughput data sets, such as targeted amplicon-based and metagenomic sequencing data, are compositional in nature. A common exploratory data analysis task is to infer statistical associations between the…

Methodology · Statistics 2020-07-28 Aditya Mishra , Christian L. Muller

Gradient methods are experiencing a growth in methodological and theoretical developments owing to the challenges posed by optimization problems arising in data science. However, such gradient methods face diverging optimality gaps or…

Optimization and Control · Mathematics 2024-04-17 Christian Varner , Vivak Patel

In this paper we initiate the study of whether or not sparse estimation tasks can be performed efficiently in high dimensions, in the robust setting where an $\eps$-fraction of samples are corrupted adversarially. We study the natural…

Machine Learning · Computer Science 2017-03-02 Jerry Li

We consider the stochastic gradient method with random reshuffling ($\mathsf{RR}$) for tackling smooth nonconvex optimization problems. $\mathsf{RR}$ finds broad applications in practice, notably in training neural networks. In this work,…

Optimization and Control · Mathematics 2026-04-17 Hengxu Yu , Xiao Li

This paper examines the phenomenon of probabilistic robustness overestimation in TRADES, a prominent adversarial training method. Our study reveals that TRADES sometimes yields disproportionately high PGD validation accuracy compared to the…

Machine Learning · Computer Science 2024-10-11 Jonathan Weiping Li , Ren-Wei Liang , Cheng-Han Yeh , Cheng-Chang Tsai , Kuanchun Yu , Chun-Shien Lu , Shang-Tse Chen

Robustness is a key requirement for widespread deployment of machine learning algorithms, and has received much attention in both statistics and computer science. We study a natural model of robustness for high-dimensional statistical…

Machine Learning · Computer Science 2020-06-03 Pranjal Awasthi , Xue Chen , Aravindan Vijayaraghavan

Recent progress in robust statistical learning has mainly tackled convex problems, like mean estimation or linear regression, with non-convex challenges receiving less attention. Phase retrieval exemplifies such a non-convex problem,…

Machine Learning · Statistics 2024-10-15 Alex Buna , Patrick Rebeschini

Robust statistics aims to compute quantities to represent data where a fraction of it may be arbitrarily corrupted. The most essential statistic is the mean, and in recent years, there has been a flurry of theoretical advancement for…

Machine Learning · Statistics 2025-02-18 Cullen Anderson , Jeff M. Phillips

We study algorithmic approaches for recovering from the failure of several compute nodes in the parallel preconditioned conjugate gradient (PCG) solver on large-scale parallel computers. In particular, we analyze and extend an exact state…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-21 Carlos Pachajoa , Markus Levonyak , Wilfried N. Gansterer , Jesper Larsson Träff

Missing data is frequently encountered in many areas of statistics. Propensity score weighting is a popular method for handling missing data. The propensity score method employs a response propensity model, but correct specification of the…

Methodology · Statistics 2024-03-28 Hengfang Wang , Jae Kwang Kim , Jeongseop Han , Youngjo Lee

We study the fundamental problem of high-dimensional mean estimation in a robust model where a constant fraction of the samples are adversarially corrupted. Recent work gave the first polynomial time algorithms for this problem with…

Machine Learning · Computer Science 2018-11-26 Yu Cheng , Ilias Diakonikolas , Rong Ge

We present theory and practice for robust implementations of bivariate Jacobi set and Reeb space algorithms. Robustness is a fundamental topic in computational geometry that deals with the issues of numerical errors and degenerate cases in…

Computational Geometry · Computer Science 2025-10-10 Petar Hristov , Ingrid Hotz , Talha Bin Masood

We propose and investigate probabilistic guarantees for the adversarial robustness of classification algorithms. While traditional formal verification approaches for robustness are intractable and sampling-based approaches do not provide…

Machine Learning · Computer Science 2025-11-11 Peter Blohm , Patrick Indri , Thomas Gärtner , Sagar Malhotra

Several authors have recently developed risk-sensitive policy gradient methods that augment the standard expected cost minimization problem with a measure of variability in cost. These studies have focused on specific risk-measures, such as…

Artificial Intelligence · Computer Science 2015-06-09 Aviv Tamar , Yinlam Chow , Mohammad Ghavamzadeh , Shie Mannor

We give a polynomial-time algorithm for the problem of robustly estimating a mixture of $k$ arbitrary Gaussians in $\mathbb{R}^d$, for any fixed $k$, in the presence of a constant fraction of arbitrary corruptions. This resolves the main…

Data Structures and Algorithms · Computer Science 2021-06-08 Ainesh Bakshi , Ilias Diakonikolas , He Jia , Daniel M. Kane , Pravesh K. Kothari , Santosh S. Vempala

We investigate adversarial robustness of Gaussian Process Classification (GPC) models. Given a compact subset of the input space $T\subseteq \mathbb{R}^d$ enclosing a test point $x^*$ and a GPC trained on a dataset $\mathcal{D}$, we aim to…

Machine Learning · Statistics 2020-03-12 Arno Blaas , Andrea Patane , Luca Laurenti , Luca Cardelli , Marta Kwiatkowska , Stephen Roberts

While the traditional viewpoint in machine learning and statistics assumes training and testing samples come from the same population, practice belies this fiction. One strategy -- coming from robust statistics and optimization -- is thus…

Machine Learning · Statistics 2024-07-08 Maxime Cauchois , Suyash Gupta , Alnur Ali , John C. Duchi

In this paper, we present a robust adaptive model predictive control (MPC) scheme for linear systems subject to parametric uncertainty and additive disturbances. The proposed approach provides a computationally efficient formulation with…

Systems and Control · Electrical Eng. & Systems 2020-03-12 Johannes Köhler , Elisa Andina , Raffaele Soloperto , Matthias A. Müller , Frank Allgöwer