中文
相关论文

相关论文: Certifying Some Distributional Robustness with Pri…

200 篇论文

We propose a principled framework that combines adversarial training and provable robustness verification for training certifiably robust neural networks. We formulate the training problem as a joint optimization problem with both empirical…

机器学习 · 计算机科学 2021-06-08 Jiameng Fan , Wenchao Li

This paper proposes a distributionally robust approach to logistic regression. We use the Wasserstein distance to construct a ball in the space of probability distributions centered at the uniform distribution on the training samples. If…

最优化与控制 · 数学 2015-12-02 Soroosh Shafieezadeh-Abadeh , Peyman Mohajerin Esfahani , Daniel Kuhn

Neural networks are vulnerable to small adversarial perturbations. Existing literature largely focused on understanding and mitigating the vulnerability of learned models. In this paper, we demonstrate an intriguing phenomenon about the…

机器学习 · 计算机科学 2019-02-25 Gavin Weiguang Ding , Kry Yik Chau Lui , Xiaomeng Jin , Luyu Wang , Ruitong Huang

We propose a distributionally robust approach to learning hyperparameters for first-order methods in convex optimization. Given a dataset of problem instances, we minimize a Wasserstein distributionally robust version of the performance…

机器学习 · 计算机科学 2026-05-08 Vinit Ranjan , Jisun Park , Bartolomeo Stellato

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

机器学习 · 统计学 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu

Recent works show that adversarial examples exist for random neural networks [Daniely and Schacham, 2020] and that these examples can be found using a single step of gradient ascent [Bubeck et al., 2021]. In this work, we extend this line…

机器学习 · 计算机科学 2022-10-19 Yunjuan Wang , Enayat Ullah , Poorya Mianjy , Raman Arora

In this work we develop a novel Bayesian neural network methodology to achieve strong adversarial robustness without the need for online adversarial training. Unlike previous efforts in this direction, we do not rely solely on the…

机器学习 · 计算机科学 2020-03-25 Christopher M. Bender , Yang Li , Yifeng Shi , Michael K. Reiter , Junier B. Oliva

Despite the efficacy on a variety of computer vision tasks, deep neural networks (DNNs) are vulnerable to adversarial attacks, limiting their applications in security-critical systems. Recent works have shown the possibility of generating…

计算机视觉与模式识别 · 计算机科学 2018-12-21 Ziang Yan , Yiwen Guo , Changshui Zhang

We study a model for adversarial classification based on distributionally robust chance constraints. We show that under Wasserstein ambiguity, the model aims to minimize the conditional value-at-risk of the distance to misclassification,…

机器学习 · 计算机科学 2021-11-05 Nam Ho-Nguyen , Stephen J. Wright

Wasserstein distributionally robust optimization (WDRO) optimizes against worst-case distributional shifts within a specified uncertainty set, leading to enhanced generalization on unseen adversarial examples, compared to standard…

机器学习 · 计算机科学 2025-03-07 Shuang Liu , Yihan Wang , Yifan Zhu , Yibo Miao , Xiao-Shan Gao

Robust risk minimisation has several advantages: it has been studied with regards to improving the generalisation properties of models and robustness to adversarial perturbation. We bound the distributionally robust risk for a model class…

机器学习 · 统计学 2018-09-06 Zac Cranko , Simon Kornblith , Zhan Shi , Richard Nock

Neural networks are very successful at detecting patterns in noisy data, and have become the technology of choice in many fields. However, their usefulness is hampered by their susceptibility to adversarial attacks. Recently, many methods…

机器学习 · 计算机科学 2022-07-14 Marco Casadio , Ekaterina Komendantskaya , Matthew L. Daggitt , Wen Kokke , Guy Katz , Guy Amir , Idan Refaeli

Distributionally Robust Optimization (DRO) provides a framework for decision-making under distributional uncertainty, yet its effectiveness can be compromised by outliers in the training data. This paper introduces a principled approach to…

机器学习 · 计算机科学 2025-11-04 Shuyao Li , Ilias Diakonikolas , Jelena Diakonikolas

While existing work in robust deep learning has focused on small pixel-level norm-based perturbations, this may not account for perturbations encountered in several real-world settings. In many such cases although test data might not be…

计算机视觉与模式识别 · 计算机科学 2021-04-09 Tejas Gokhale , Rushil Anirudh , Bhavya Kailkhura , Jayaraman J. Thiagarajan , Chitta Baral , Yezhou Yang

Many decision problems in science, engineering and economics are affected by uncertain parameters whose distribution is only indirectly observable through samples. The goal of data-driven decision-making is to learn a decision from finitely…

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

机器学习 · 计算机科学 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

Deep Neural Networks, despite their great success in diverse domains, are provably sensitive to small perturbations on correctly classified examples and lead to erroneous predictions. Recently, it was proposed that this behavior can be…

机器学习 · 计算机科学 2020-09-29 Nan Xu , Oluwaseyi Feyisetan , Abhinav Aggarwal , Zekun Xu , Nathanael Teissier

Deep Neural Networks (DNN) have been shown to be vulnerable to adversarial examples. Adversarial training (AT) is a popular and effective strategy to defend against adversarial attacks. Recent works (Benz et al., 2020; Xu et al., 2021; Tian…

机器学习 · 计算机科学 2023-02-09 Boqi Li , Weiwei Liu

Machine learning algorithms with empirical risk minimization are vulnerable under distributional shifts due to the greedy adoption of all the correlations found in training data. There is an emerging literature on tackling this problem by…

机器学习 · 计算机科学 2022-11-22 Jiashuo Liu , Zheyan Shen , Peng Cui , Linjun Zhou , Kun Kuang , Bo Li

In many real-world applications of Machine Learning it is of paramount importance not only to provide accurate predictions, but also to ensure certain levels of robustness. Adversarial Training is a training procedure aiming at providing…

机器学习 · 计算机科学 2019-10-09 Matteo Terzi , Gian Antonio Susto , Pratik Chaudhari