English
Related papers

Related papers: Mixing Classifiers to Alleviate the Accuracy-Robus…

200 papers

Recent research has highlighted a critical issue known as ``robust fairness", where robust accuracy varies significantly across different classes, undermining the reliability of deep neural networks (DNNs). A common approach to address this…

Machine Learning · Computer Science 2025-01-24 Gaojie Jin , Sihao Wu , Jiaxu Liu , Tianjin Huang , Ronghui Mu

Adversarially robust training has been shown to reduce the susceptibility of learned models to targeted input data perturbations. However, it has also been observed that such adversarially robust models suffer a degradation in accuracy when…

Systems and Control · Electrical Eng. & Systems 2023-02-07 Thomas T. C. K. Zhang , Bruce D. Lee , Hamed Hassani , Nikolai Matni

Several recent works have shown that state-of-the-art classifiers are vulnerable to worst-case (i.e., adversarial) perturbations of the datapoints. On the other hand, it has been empirically observed that these same classifiers are…

Machine Learning · Computer Science 2016-09-02 Alhussein Fawzi , Seyed-Mohsen Moosavi-Dezfooli , Pascal Frossard

Validation accuracy is a necessary, but not sufficient, measure of a neural network classifier's quality. High validation accuracy during development does not guarantee that a model is free of serious flaws, such as vulnerability to…

Machine Learning · Computer Science 2019-10-08 John S. Hyatt , Michael S. Lee

Recently smoothing deep neural network based classifiers via isotropic Gaussian perturbation is shown to be an effective and scalable way to provide state-of-the-art probabilistic robustness guarantee against $\ell_2$ norm bounded…

Machine Learning · Statistics 2020-02-19 Huijie Feng , Chunpeng Wu , Guoyang Chen , Weifeng Zhang , Yang Ning

Over the last decade, the development of deep image classification networks has mostly been driven by the search for the best performance in terms of classification accuracy on standardized benchmarks like ImageNet. More recently, this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Kalun Ho , Franz-Josef Pfreundt , Janis Keuper , Margret Keuper

Deep neural networks bring in impressive accuracy in various applications, but the success often relies on the heavy network architecture. Taking well-trained heavy networks as teachers, classical teacher-student learning paradigm aims to…

Machine Learning · Computer Science 2018-08-01 Tianyu Guo , Chang Xu , Shiyi He , Boxin Shi , Chao Xu , Dacheng Tao

Deep neural networks (DNNs) are vulnerable to adversarial examples where inputs with imperceptible perturbations mislead DNNs to incorrect results. Despite the potential risk they bring, adversarial examples are also valuable for providing…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Chongzhi Zhang , Aishan Liu , Xianglong Liu , Yitao Xu , Hang Yu , Yuqing Ma , Tianlin Li

Integrating the outputs of multiple classifiers via combiners or meta-learners has led to substantial improvements in several difficult pattern recognition problems. In the typical setting investigated till now, each classifier is trained…

Machine Learning · Computer Science 2007-05-23 Kagan Tumer , Joydeep Ghosh

Convolutional neural networks (CNNs) have made significant advancement, however, they are widely known to be vulnerable to adversarial attacks. Adversarial training is the most widely used technique for improving adversarial robustness to…

Machine Learning · Computer Science 2021-10-12 Philipp Benz , Chaoning Zhang , Adil Karjauv , In So Kweon

In the Mixup training paradigm, a model is trained using convex combinations of data points and their associated labels. Despite seeing very few true data points during training, models trained using Mixup seem to still minimize the…

Machine Learning · Computer Science 2022-02-22 Muthu Chidambaram , Xiang Wang , Yuzheng Hu , Chenwei Wu , Rong Ge

Deep neural networks (DNNs) have achieved state-of-the-art results in various pattern recognition tasks. However, they perform poorly on out-of-distribution adversarial examples i.e. inputs that are specifically crafted by an adversary to…

Cryptography and Security · Computer Science 2019-05-09 Chirag Agarwal , Anh Nguyen , Dan Schonfeld

The success of neural networks across most machine learning tasks and the persistence of adversarial examples have made the verification of such models an important quest. Several techniques have been successfully developed to verify…

Machine Learning · Computer Science 2019-10-14 Nathanaël Fijalkow , Mohit Kumar Gupta

Recent work has shown that state-of-the-art classifiers are quite brittle, in the sense that a small adversarial change of an originally with high confidence correctly classified input leads to a wrong classification again with high…

Machine Learning · Computer Science 2017-11-07 Matthias Hein , Maksym Andriushchenko

This chapter introduces and investigates some fundamental questions on the relationship between accuracy and robustness in both classical and quantum classification algorithms under noisy and adversarial conditions. We introduce and clarify…

Quantum Physics · Physics 2026-02-18 Nana Liu

This paper delves into the critical area of deep learning robustness, challenging the conventional belief that classification robustness and explanation robustness in image classification systems are inherently correlated. Through a novel…

Machine Learning · Computer Science 2024-03-12 Tiejin Chen , Wenwang Huang , Linsey Pang , Dongsheng Luo , Hua Wei

Deep learning models are vulnerable to adversarial perturbations, raising important concerns for safety-critical deployment. Empirical defenses can achieve strong robustness in practice, but lack formal guarantees, motivating the need for…

Machine Learning · Computer Science 2026-05-26 Konstantinos Emmanouilidis , Tianjiao Ding , Nghia Nguyen , Nicolas Loizou , René Vidal

Deep image classification models trained on vast amounts of web-scraped data are susceptible to data poisoning - a mechanism for backdooring models. A small number of poisoned samples seen during training can severely undermine a model's…

Cryptography and Security · Computer Science 2023-06-30 Nils Lukas , Florian Kerschbaum

Deep Learning has revolutionized machine learning and artificial intelligence, achieving superhuman performance in several standard benchmarks. It is well-known that deep learning models are inefficient to train; they learn by processing…

Machine Learning · Computer Science 2021-12-03 Fartash Faghri

We show that combining human prior knowledge with end-to-end learning can improve the robustness of deep neural networks by introducing a part-based model for object classification. We believe that the richer form of annotation helps guide…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Chawin Sitawarin , Kornrapat Pongmala , Yizheng Chen , Nicholas Carlini , David Wagner