English
Related papers

Related papers: Black-box Certification and Learning under Adversa…

200 papers

In this work, we consider a binary classification problem and cast it into a binary hypothesis testing framework, where the observations can be perturbed by an adversary. To improve the adversarial robustness of a classifier, we include an…

Machine Learning · Computer Science 2021-10-01 Abed AlRahman Al Makdah , Vaibhav Katewa , Fabio Pasqualetti

Researchers have repeatedly shown that it is possible to craft adversarial attacks on deep classifiers (small perturbations that significantly change the class label), even in the "black-box" setting where one only has query access to the…

Machine Learning · Computer Science 2021-02-02 Devin Willmott , Anit Kumar Sahu , Fatemeh Sheikholeslami , Filipe Condessa , Zico Kolter

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

Machine Learning · Statistics 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu

Neural networks have been widely applied in security applications such as spam and phishing detection, intrusion prevention, and malware detection. This black-box method, however, often has uncertainty and poor explainability in…

Cryptography and Security · Computer Science 2022-10-12 Mark Huasong Meng , Guangdong Bai , Sin Gee Teo , Zhe Hou , Yan Xiao , Yun Lin , Jin Song Dong

Many defenses have recently been proposed at venues like NIPS, ICML, ICLR and CVPR. These defenses are mainly focused on mitigating white-box attacks. They do not properly examine black-box attacks. In this paper, we expand upon the…

Machine Learning · Computer Science 2021-11-03 Kaleel Mahmood , Deniz Gurevin , Marten van Dijk , Phuong Ha Nguyen

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

We investigate the challenge of establishing stochastic-like guarantees when sequentially learning from a stream of i.i.d. data that includes an unknown quantity of clean-label adversarial samples. We permit the learner to abstain from…

Machine Learning · Computer Science 2025-04-22 Carolin Heinzler

Current techniques in machine learning are so far are unable to learn classifiers that are robust to adversarial perturbations. However, they are able to learn non-robust classifiers with very high accuracy, even in the presence of random…

Machine Learning · Computer Science 2019-01-04 Preetum Nakkiran

It is becoming increasingly important to understand the vulnerability of machine learning models to adversarial attacks. In this paper we study the feasibility of robust learning from the perspective of computational learning theory,…

Machine Learning · Computer Science 2019-09-13 Pascale Gourdeau , Varun Kanade , Marta Kwiatkowska , James Worrell

Adversarial approach has been widely used for data generation in the last few years. However, this approach has not been extensively utilized for classifier training. In this paper, we propose an adversarial framework for classifier…

Machine Learning · Computer Science 2018-11-22 Ehsan Montahaei , Mahsa Ghorbani , Mahdieh Soleymani Baghshah , Hamid R. Rabiee

The field of adversarial machine learning has experienced a near exponential growth in the amount of papers being produced since 2018. This massive information output has yet to be properly processed and categorized. In this paper, we seek…

Cryptography and Security · Computer Science 2021-10-01 Kaleel Mahmood , Rigel Mahmood , Ethan Rathbun , Marten van Dijk

Patch-based adversarial attacks introduce a perceptible but localized change to the input that induces misclassification. While progress has been made in defending against imperceptible attacks, it remains unclear how patch-based attacks…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Christian Cosgrove , Adam Kortylewski , Chenglin Yang , Alan Yuille

Robustness is critical for machine learning (ML) classifiers to ensure consistent performance in real-world applications where models may encounter corrupted or adversarial inputs. In particular, assessing the robustness of classifiers to…

Machine Learning · Computer Science 2024-09-06 Georg Siedel , Ekagra Gupta , Andrey Morozov

Randomized smoothing is a recent and celebrated solution to certify the robustness of any classifier. While it indeed provides a theoretical robustness against adversarial attacks, the dimensionality of current classifiers necessarily…

Cryptography and Security · Computer Science 2022-05-02 Thibault Maho , Teddy Furon , Erwan Le Merrer

In this paper we propose a novel method for detecting adversarial examples by training a binary classifier with both origin data and saliency data. In the case of image classification model, saliency simply explain how the model make…

Machine Learning · Computer Science 2018-03-26 Chiliang Zhang , Zhimou Yang , Zuochang Ye

Adversarial or test time robustness measures the susceptibility of a classifier to perturbations to the test input. While there has been a flurry of recent work on designing defenses against such perturbations, the theory of adversarial…

Machine Learning · Computer Science 2020-04-29 Pranjal Awasthi , Natalie Frank , Mehryar Mohri

Adversarial attacks are widely used to identify model vulnerabilities; however, their validity as proxies for robustness to random perturbations remains debated. We ask whether an adversarial example provides a representative estimate of…

Machine Learning · Computer Science 2026-01-27 Giulio Rossolini

Advances in Machine Learning (ML) have led to its adoption as an integral component in many applications, including banking, medical diagnosis, and driverless cars. To further broaden the use of ML models, cloud-based services offered by…

Machine Learning · Computer Science 2017-03-14 Hossein Hosseini , Yize Chen , Sreeram Kannan , Baosen Zhang , Radha Poovendran

An adversary who aims to steal a black-box model repeatedly queries the model via a prediction API to learn a function that approximates its decision boundary. Adversarial approximation is non-trivial because of the enormous combinations of…

Cryptography and Security · Computer Science 2020-06-30 Abdullah Ali , Birhanu Eshete

We consider a model of robust learning in an adversarial environment. The learner gets uncorrupted training data with access to possible corruptions that may be affected by the adversary during testing. The learner's goal is to build a…

Machine Learning · Computer Science 2022-07-04 Idan Attias , Aryeh Kontorovich , Yishay Mansour