中文
相关论文

相关论文: Calibrated Surrogate Losses for Adversarially Robu…

200 篇论文

Solving optimization problems with unknown parameters often requires learning a predictive model to predict the values of the unknown parameters and then solving the problem using these values. Recent work has shown that including the…

机器学习 · 计算机科学 2020-10-23 Kai Wang , Bryan Wilder , Andrew Perrault , Milind Tambe

We analyze the properties of adversarial training for learning adversarially robust halfspaces in the presence of agnostic label noise. Denoting $\mathsf{OPT}_{p,r}$ as the best robust classification error achieved by a halfspace that is…

机器学习 · 计算机科学 2021-04-20 Difan Zou , Spencer Frei , Quanquan Gu

This paper proposes an attack-independent (non-adversarial training) technique for improving adversarial robustness of neural network models, with minimal loss of standard accuracy. We suggest creating a neighborhood around each training…

机器学习 · 计算机科学 2021-07-28 Bronya Roni Chernyak , Bhiksha Raj , Tamir Hazan , Joseph Keshet

This paper presents a novel learning-based approach to construct a surrogate problem that approximates a given parametric nonconvex optimization problem. The surrogate function is designed to be the minimum of a finite set of functions,…

最优化与控制 · 数学 2026-04-08 Renzi Wang , Panagiotis Patrinos , Alberto Bemporad

State-of-the-art machine learning models can be vulnerable to very small input perturbations that are adversarially constructed. Adversarial training is an effective approach to defend against it. Formulated as a min-max problem, it…

机器学习 · 统计学 2023-10-18 Antônio H. Ribeiro , Dave Zachariah , Francis Bach , Thomas B. Schön

We study a model for adversarial classification based on distributionally robust chance constraints. We show that under Wasserstein ambiguity, the model aims to minimize the conditional value-at-risk of the distance to misclassification,…

机器学习 · 计算机科学 2021-11-05 Nam Ho-Nguyen , Stephen J. Wright

Recent work has shown that, when integrated with adversarial training, self-supervised pre-training can lead to state-of-the-art robustness In this work, we improve robustness-aware self-supervised pre-training by learning representations…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Ziyu Jiang , Tianlong Chen , Ting Chen , Zhangyang Wang

Matching the performance of conditional Generative Adversarial Networks with little supervision is an important task, especially in venturing into new domains. We design a new training algorithm, which is robust to missing or ambiguous…

机器学习 · 统计学 2019-06-11 Kiran Koshy Thekumparampil , Sewoong Oh , Ashish Khetan

As they have a vital effect on social decision makings, AI algorithms should be not only accurate and but also fair. Among various algorithms for fairness AI, learning a prediction model by minimizing the empirical risk (e.g.,…

机器学习 · 统计学 2025-05-26 Kunwoong Kim , Ilsang Ohn , Sara Kim , Yongdai Kim

We present a more general analysis of $H$-calibration for adversarially robust classification. By adopting a finer definition of calibration, we can cover settings beyond the restricted hypothesis sets studied in previous work. In…

机器学习 · 计算机科学 2021-05-07 Pranjal Awasthi , Anqi Mao , Mehryar Mohri , Yutao Zhong

Recent works on adversarial perturbations show that there is an inherent trade-off between standard test accuracy and adversarial accuracy. Specifically, they show that no classifier can simultaneously be robust to adversarial perturbations…

机器学习 · 统计学 2019-03-26 Arun Sai Suggala , Adarsh Prasad , Vaishnavh Nagarajan , Pradeep Ravikumar

Recent research shows the susceptibility of machine learning models to adversarial attacks, wherein minor but maliciously chosen perturbations of the input can significantly degrade model performance. In this paper, we theoretically analyse…

统计理论 · 数学 2025-05-14 Jingfu Peng , Yuhong Yang

This paper investigates recently proposed approaches for defending against adversarial examples and evaluating adversarial robustness. We motivate 'adversarial risk' as an objective for achieving models robust to worst-case inputs. We then…

机器学习 · 计算机科学 2018-06-13 Jonathan Uesato , Brendan O'Donoghue , Aaron van den Oord , Pushmeet Kohli

Machine learning models are vulnerable to adversarial attacks that can often cause misclassification by introducing small but well designed perturbations. In this paper, we explore, in the setting of classical composite hypothesis testing,…

机器学习 · 统计学 2020-11-17 Bhagyashree Puranik , Upamanyu Madhow , Ramtin Pedarsani

In many applications, the training data, from which one needs to learn a classifier, is corrupted with label noise. Many standard algorithms such as SVM perform poorly in presence of label noise. In this paper we investigate the robustness…

机器学习 · 计算机科学 2015-09-11 Aritra Ghosh , Naresh Manwani , P. S. Sastry

There has been great interest in enhancing the robustness of neural network classifiers to defend against adversarial perturbations through adversarial training, while balancing the trade-off between robust accuracy and standard accuracy.…

机器学习 · 计算机科学 2022-10-24 Chester Holtz , Tsui-Wei Weng , Gal Mishne

Modern statistical applications often involve minimizing an objective function that may be nonsmooth and/or nonconvex. This paper focuses on a broad Bregman-surrogate algorithm framework including the local linear approximation, mirror…

最优化与控制 · 数学 2021-12-20 Yiyuan She , Zhifeng Wang , Jiuwu Jin

We initiate the study of a new notion of adversarial loss which we call distributional adversarial loss. In this notion, we assume for each original example, the allowed adversarial perturbation set is a family of distributions, and the…

机器学习 · 计算机科学 2025-06-23 Saba Ahmadi , Siddharth Bhandari , Avrim Blum , Chen Dan , Prabhav Jain

Recent research has introduced a key notion of $H$-consistency bounds for surrogate losses. These bounds offer finite-sample guarantees, quantifying the relationship between the zero-one estimation error (or other target loss) and the…

机器学习 · 计算机科学 2025-12-30 Anqi Mao , Mehryar Mohri , Yutao Zhong

In adversarial training, a set of models learn together by pursuing competing goals, usually defined on single data instances. However, in relational learning and other non-i.i.d domains, goals can also be defined over sets of instances.…

人工智能 · 计算机科学 2017-07-25 Pasquale Minervini , Thomas Demeester , Tim Rocktäschel , Sebastian Riedel