中文
相关论文

相关论文: ROBY: Evaluating the Robustness of a Deep Model by…

200 篇论文

Deep neural networks have been known to be vulnerable to adversarial examples, which are inputs that are modified slightly to fool the network into making incorrect predictions. This has led to a significant amount of research on evaluating…

机器学习 · 计算机科学 2024-12-10 Alireza Abdollahpoorrostam , Mahed Abroshan , Seyed-Mohsen Moosavi-Dezfooli

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

机器学习 · 计算机科学 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

To ensure trust in AI models, it is becoming increasingly apparent that evaluation of models must be extended beyond traditional performance metrics, like accuracy, to other dimensions, such as fairness, explainability, adversarial…

机器学习 · 计算机科学 2021-10-01 Moninder Singh , Gevorg Ghalachyan , Kush R. Varshney , Reginald E. Bryant

Deep image classification models trained on vast amounts of web-scraped data are susceptible to data poisoning - a mechanism for backdooring models. A small number of poisoned samples seen during training can severely undermine a model's…

密码学与安全 · 计算机科学 2023-06-30 Nils Lukas , Florian Kerschbaum

The function or performance of a network is strongly dependent on its robustness, quantifying the ability of the network to continue functioning under perturbations. While a wide variety of robustness metrics have been proposed, they have…

社会与信息网络 · 计算机科学 2023-06-16 Liwang Zhu , Qi Bao , Zhongzhi Zhang

We consider a model of robust learning in an adversarial environment. The learner gets uncorrupted training data with access to possible corruptions that may be affected by the adversary during testing. The learner's goal is to build a…

机器学习 · 计算机科学 2022-07-04 Idan Attias , Aryeh Kontorovich , Yishay Mansour

While additional training data improves the robustness of deep neural networks against adversarial examples, it presents the challenge of curating a large number of specific real-world samples. We circumvent this challenge by using…

机器学习 · 计算机科学 2022-03-04 Vikash Sehwag , Saeed Mahloujifar , Tinashe Handina , Sihui Dai , Chong Xiang , Mung Chiang , Prateek Mittal

Recent research studies revealed that neural networks are vulnerable to adversarial attacks. State-of-the-art defensive techniques add various adversarial examples in training to improve models' adversarial robustness. However, these…

机器学习 · 计算机科学 2019-09-13 Chang Song , Zuoguan Wang , Hai Li

"Effective robustness" measures the extra out-of-distribution (OOD) robustness beyond what can be predicted from the in-distribution (ID) performance. Existing effective robustness evaluations typically use a single test set such as…

机器学习 · 计算机科学 2023-10-31 Zhouxing Shi , Nicholas Carlini , Ananth Balashankar , Ludwig Schmidt , Cho-Jui Hsieh , Alex Beutel , Yao Qin

Robustness estimation is critical for the design and maintenance of resilient networks, one of the global challenges of the 21st century. Existing studies exploit network metrics to generate attack strategies, which simulate intentional…

社会与信息网络 · 计算机科学 2016-08-16 Sebastian Wandelt , Xiaoqian Sun

This paper revisits the robust overfitting phenomenon of adversarial training. Observing that models with better robust generalization performance are less certain in predicting adversarially generated training inputs, we argue that…

机器学习 · 计算机科学 2025-01-15 Minxing Zhang , Michael Backes , Xiao Zhang

We introduce a novel validation framework to measure the true robustness of learning models for real-world applications by creating source-inclusive and source-exclusive partitions in a dataset via clustering. We develop a robustness metric…

机器学习 · 计算机科学 2017-04-04 Ozsel Kilinc , Ismail Uysal

What fundamentally distinguishes an adversarial attack from a misclassification due to limited model expressivity or finite data? In this work, we investigate this question in the setting of high-dimensional binary classification, where…

机器学习 · 统计学 2025-06-17 Matteo Vilucchio , Lenka Zdeborová , Bruno Loureiro

With the introduction of machine learning in high-stakes decision making, ensuring algorithmic fairness has become an increasingly important problem to solve. In response to this, many mathematical definitions of fairness have been…

机器学习 · 计算机科学 2024-06-04 Edward Small , Wei Shao , Zeliang Zhang , Peihan Liu , Jeffrey Chan , Kacper Sokol , Flora Salim

In this paper we study leveraging confidence information induced by adversarial training to reinforce adversarial robustness of a given adversarially trained model. A natural measure of confidence is $\|F({\bf x})\|_\infty$ (i.e. how…

机器学习 · 计算机科学 2018-10-16 Xi Wu , Uyeong Jang , Jiefeng Chen , Lingjiao Chen , Somesh Jha

Over the last decade, the development of deep image classification networks has mostly been driven by the search for the best performance in terms of classification accuracy on standardized benchmarks like ImageNet. More recently, this…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Kalun Ho , Franz-Josef Pfreundt , Janis Keuper , Margret Keuper

The robust $\phi$-regularized Markov Decision Process (RRMDP) framework focuses on designing control policies that are robust against parameter uncertainties due to mismatches between the simulator (nominal) model and real-world settings.…

机器学习 · 计算机科学 2024-05-10 Kishan Panaganti , Adam Wierman , Eric Mazumdar

Robustness in terms of outliers is an important topic and has been formally studied for a variety of problems in machine learning and computer vision. Generalized median computation is a special instance of consensus learning and a common…

机器学习 · 计算机科学 2025-03-10 Andreas Nienkötter , Sandro Vega-Pons , Xiaoyi Jiang

Recently, RobustBench (Croce et al. 2020) has become a widely recognized benchmark for the adversarial robustness of image classification networks. In its most commonly reported sub-task, RobustBench evaluates and ranks the adversarial…

计算机视觉与模式识别 · 计算机科学 2024-02-21 Peter Lorenz , Dominik Strassel , Margret Keuper , Janis Keuper

Most of the regularization methods such as the LASSO have one (or more) regularization parameter(s), and to select the value of the regularization parameter is essentially equal to select a model. Thus, to obtain a model suitable for the…

统计方法学 · 统计学 2025-11-07 Sumito Kurata , Kei Hirose