English
Related papers

Related papers: Randomization matters. How to defend against stron…

200 papers

Adversarial attacks pose significant threats to the reliability and safety of deep learning models, especially in critical domains such as medical imaging. This paper introduces a novel framework that integrates conformal prediction with…

Machine Learning · Computer Science 2025-03-05 Rui Luo , Jie Bao , Zhixin Zhou , Chuangyin Dang

A wide range of defenses have been proposed to harden neural networks against adversarial attacks. However, a pattern has emerged in which the majority of adversarial defenses are quickly broken by new attacks. Given the lack of success at…

Machine Learning · Computer Science 2020-02-05 Ali Shafahi , W. Ronny Huang , Christoph Studer , Soheil Feizi , Tom Goldstein

Adversarial deep learning is to train robust DNNs against adversarial attacks, which is one of the major research focuses of deep learning. Game theory has been used to answer some of the basic questions about adversarial deep learning such…

Machine Learning · Computer Science 2022-07-19 Xiao-Shan Gao , Shuang Liu , Lijia Yu

This paper investigates the theory of robustness against adversarial attacks. It focuses on the family of randomization techniques that consist in injecting noise in the network at inference time. These techniques have proven effective in…

Machine Learning · Computer Science 2019-06-12 Rafael Pinot , Laurent Meunier , Alexandre Araujo , Hisashi Kashima , Florian Yger , Cédric Gouy-Pailler , Jamal Atif

In multiple domains such as malware detection, automated driving systems, or fraud detection, classification algorithms are susceptible to being attacked by malicious agents willing to perturb the value of instance covariates to pursue…

Machine Learning · Statistics 2025-07-10 Victor Gallego , Roi Naveiro , Alberto Redondo , David Rios Insua , Fabrizio Ruggeri

One prominent approach toward resolving the adversarial vulnerability of deep neural networks is the two-player zero-sum paradigm of adversarial training, in which predictors are trained against adversarially chosen perturbations of data.…

Machine Learning · Computer Science 2024-03-20 Alexander Robey , Fabian Latorre , George J. Pappas , Hamed Hassani , Volkan Cevher

Adversarial examples pose a threat to deep neural network models in a variety of scenarios, from settings where the adversary has complete knowledge of the model and to the opposite "black box" setting. Black box attacks are particularly…

Machine Learning · Computer Science 2019-05-27 Haidar Khan , Daniel Park , Azer Khan , Bülent Yener

We investigate the problem of designing optimal classifiers in the strategic classification setting, where the classification is part of a game in which players can modify their features to attain a favorable classification outcome (while…

Machine Learning · Computer Science 2020-05-19 Mark Braverman , Sumegha Garg

Randomization as a mean to improve the adversarial robustness of machine learning models has recently attracted significant attention. Unfortunately, much of the theoretical analysis so far has focused on binary classification, providing…

This paper investigates the theory of robustness against adversarial attacks. We focus on randomized classifiers (\emph{i.e.} classifiers that output random variables) and provide a thorough analysis of their behavior through the lens of…

Machine Learning · Computer Science 2021-02-23 Rafael Pinot , Laurent Meunier , Florian Yger , Cédric Gouy-Pailler , Yann Chevaleyre , Jamal Atif

We consider the problem of strategic classification, where a learner must build a model to classify agents based on features that have been strategically modified. Previous work in this area has concentrated on the case when the learner is…

Machine Learning · Computer Science 2025-05-19 Jack Geary , Henry Gouk

Randomized smoothing is a recent and celebrated solution to certify the robustness of any classifier. While it indeed provides a theoretical robustness against adversarial attacks, the dimensionality of current classifiers necessarily…

Cryptography and Security · Computer Science 2022-05-02 Thibault Maho , Teddy Furon , Erwan Le Merrer

Recent breakthroughs in the field of deep learning have led to advancements in a broad spectrum of tasks in computer vision, audio processing, natural language processing and other areas. In most instances where these tasks are deployed in…

Machine Learning · Computer Science 2019-05-28 Daanish Ali Khan , Linhong Li , Ninghao Sha , Zhuoran Liu , Abelino Jimenez , Bhiksha Raj , Rita Singh

We consider a model of robust learning in an adversarial environment. The learner gets uncorrupted training data with access to possible corruptions that may be affected by the adversary during testing. The learner's goal is to build a…

Machine Learning · Computer Science 2022-07-04 Idan Attias , Aryeh Kontorovich , Yishay Mansour

This study investigates a counterintuitive phenomenon in adversarial machine learning: the potential for noise-based defenses to inadvertently aid evasion attacks in certain scenarios. While randomness is often employed as a defensive…

Cryptography and Security · Computer Science 2024-11-01 Steve Bakos , Pooria Madani , Heidar Davoudi

Adversarial risk quantifies the performance of classifiers on adversarially perturbed data. Numerous definitions of adversarial risk -- not all mathematically rigorous and differing subtly in the details -- have appeared in the literature.…

Machine Learning · Statistics 2022-01-25 Muni Sreenivas Pydi , Varun Jog

Adversarial robustness is a critical property in a variety of modern machine learning applications. While it has been the subject of several recent theoretical studies, many important questions related to adversarial robustness are still…

Machine Learning · Computer Science 2023-08-30 Pranjal Awasthi , Natalie S. Frank , Mehryar Mohri

We theoretically analyse the limits of robustness to test-time adversarial and noisy examples in classification. Our work focuses on deriving bounds which uniformly apply to all classifiers (i.e all measurable functions from features to…

Machine Learning · Statistics 2020-11-13 Elvis Dohmatob

Motivated by authentication, intrusion and spam detection applications we consider single-class classification (SCC) as a two-person game between the learner and an adversary. In this game the learner has a sample from a target distribution…

Machine Learning · Computer Science 2010-10-22 Ran El-Yaniv , Mordechai Nisenson

Randomized smoothing has established state-of-the-art provable robustness against $\ell_2$ norm adversarial attacks with high probability. However, the introduced Gaussian data augmentation causes a severe decrease in natural accuracy. We…

Machine Learning · Computer Science 2020-12-01 Ching-Chia Kao , Jhe-Bang Ko , Chun-Shien Lu