English
Related papers

Related papers: Robustness of classifiers: from adversarial to ran…

200 papers

Recently deep neural networks have shown their capacity to memorize training data, even with noisy labels, which hurts generalization performance. To mitigate this issue, we provide a simple but effective baseline method that is robust to…

Machine Learning · Computer Science 2019-09-30 Yucen Luo , Jun Zhu , Tomas Pfister

Robustness and generalization ability of machine learning models are of utmost importance in various application domains. There is a wide interest in efficient ways to analyze those properties. One important direction is to analyze…

Machine Learning · Computer Science 2025-04-29 Khoat Than , Dat Phan , Giang Vu

Among the different possible strategies for evaluating the reliability of individual predictions of classifiers, robustness quantification stands out as a method that evaluates how much uncertainty a classifier could cope with before…

Machine Learning · Computer Science 2026-03-25 Rodrigo F. L. Lassance , Jasper De Bock

It is widely known in the machine learning community that class noise can be (and often is) detrimental to inducing a model of the data. Many current approaches use a single, often biased, measurement to determine if an instance is noisy. A…

Machine Learning · Statistics 2014-03-11 Michael R. Smith , Tony Martinez

We introduce a new approach for designing computationally efficient learning algorithms that are tolerant to noise, and demonstrate its effectiveness by designing algorithms with improved noise tolerance guarantees for learning linear…

Machine Learning · Computer Science 2018-06-05 Pranjal Awasthi , Maria Florina Balcan , Philip M. Long

Randomized classifiers have been shown to provide a promising approach for achieving certified robustness against adversarial attacks in deep learning. However, most existing methods only leverage Gaussian smoothing noise and only work for…

Machine Learning · Computer Science 2020-10-21 Dinghuai Zhang , Mao Ye , Chengyue Gong , Zhanxing Zhu , Qiang Liu

Recent breakthroughs in the field of deep learning have led to advancements in a broad spectrum of tasks in computer vision, audio processing, natural language processing and other areas. In most instances where these tasks are deployed in…

Machine Learning · Computer Science 2019-05-28 Daanish Ali Khan , Linhong Li , Ninghao Sha , Zhuoran Liu , Abelino Jimenez , Bhiksha Raj , Rita Singh

There are a number of hypotheses underlying the existence of adversarial examples for classification problems. These include the high-dimensionality of the data, high codimension in the ambient space of the data manifolds of interest, and…

Machine Learning · Computer Science 2024-04-15 Brian Bell , Michael Geyer , David Glickenstein , Keaton Hamm , Carlos Scheidegger , Amanda Fernandez , Juston Moore

Although deep learning has shown great success in recent years, researchers have discovered a critical flaw where small, imperceptible changes in the input to the system can drastically change the output classification. These attacks are…

Machine Learning · Computer Science 2018-11-21 Jacob M. Springer , Charles S. Strauss , Austin M. Thresher , Edward Kim , Garrett T. Kenyon

Foundation models (FMs) pretrained on large datasets have become fundamental for various downstream machine learning tasks, in particular in scenarios where obtaining perfectly labeled data is prohibitively expensive. In this paper, we…

Machine Learning · Computer Science 2025-08-04 Ecem Bozkurt , Antonio Ortega

Recently, techniques have been developed to provably guarantee the robustness of a classifier to adversarial perturbations of bounded L_1 and L_2 magnitudes by using randomized smoothing: the robust classification is a consensus of base…

Machine Learning · Computer Science 2019-11-22 Alexander Levine , Soheil Feizi

In this work, we consider a binary classification problem and cast it into a binary hypothesis testing framework, where the observations can be perturbed by an adversary. To improve the adversarial robustness of a classifier, we include an…

Machine Learning · Computer Science 2021-10-01 Abed AlRahman Al Makdah , Vaibhav Katewa , Fabio Pasqualetti

Recent work has extensively shown that randomized perturbations of neural networks can improve robustness to adversarial attacks. The literature is, however, lacking a detailed compare-and-contrast of the latest proposals to understand what…

Machine Learning · Computer Science 2020-06-09 Adam Dziedzic , Sanjay Krishnan

Adversarial examples are inevitable on the road of pervasive applications of deep neural networks (DNN). Imperceptible perturbations applied on natural samples can lead DNN-based classifiers to output wrong prediction with fair confidence…

Machine Learning · Computer Science 2020-11-04 Tao Bai , Jinqi Luo , Jun Zhao

Recent works have shown the effectiveness of randomized smoothing as a scalable technique for building neural network-based classifiers that are provably robust to $\ell_2$-norm adversarial perturbations. In this paper, we employ…

Machine Learning · Computer Science 2020-01-13 Hadi Salman , Greg Yang , Jerry Li , Pengchuan Zhang , Huan Zhang , Ilya Razenshteyn , Sebastien Bubeck

Adversarial training (AT) is currently one of the most effective ways to obtain the robustness of deep neural networks against adversarial attacks. However, most AT methods suffer from robust overfitting, i.e., a significant generalization…

Machine Learning · Computer Science 2024-03-15 Daiwei Yu , Zhuorong Li , Lina Wei , Canghong Jin , Yun Zhang , Sixian Chan

End-to-end (geometric) deep learning has seen first successes in approximating the solution of combinatorial optimization problems. However, generating data in the realm of NP-hard/-complete tasks brings practical and theoretical…

Machine Learning · Computer Science 2022-03-22 Simon Geisler , Johanna Sommer , Jan Schuchardt , Aleksandar Bojchevski , Stephan Günnemann

Robust loss functions are designed to combat the adverse impacts of label noise, whose robustness is typically supported by theoretical bounds agnostic to the training dynamics. However, these bounds may fail to characterize the empirical…

Machine Learning · Computer Science 2023-05-04 Zebin Ou , Yue Zhang

Recurrent Neural networks (RNN) have shown promising potential for learning dynamics of sequential data. However, artificial neural networks are known to exhibit poor robustness in presence of input noise, where the sequential architecture…

Machine Learning · Computer Science 2021-05-05 Arash Amini , Guangyi Liu , Nader Motee

Recent works have shown that deep neural networks are vulnerable to adversarial examples that find samples close to the original image but can make the model misclassify. Even with access only to the model's output, an attacker can employ…

Machine Learning · Computer Science 2023-10-03 Quang H. Nguyen , Yingjie Lao , Tung Pham , Kok-Seng Wong , Khoa D. Doan