English
Related papers

Related papers: Linking average- and worst-case perturbation robus…

200 papers

While modern deep networks have demonstrated remarkable versatility, their training dynamics remain poorly understood--often driven more by empirical tweaks than architectural insight. This paper investigates how internal structural choices…

Machine Learning · Computer Science 2025-08-26 Saleh Nikooroo , Thomas Engel

With the great capabilities of deep classifiers for radar data processing come the risks of learning dataset-specific features that do not generalize well. In this work, the robustness of two deep convolutional architectures, trained and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Mikolaj Czerkawski , Carmine Clemente , Craig Michie , Christos Tachtatzis

Learning from raw high dimensional data via interaction with a given environment has been effectively achieved through the utilization of deep neural networks. Yet the observed degradation in policy performance caused by imperceptible…

Machine Learning · Computer Science 2023-01-19 Ezgi Korkmaz

When training deep neural networks with gradient descent, sharpness often increases -- a phenomenon known as progressive sharpening -- before saturating at the edge of stability. Although commonly observed in practice, the underlying…

Machine Learning · Computer Science 2025-06-10 Geonhui Yoo , Minhak Song , Chulhee Yun

Deep learning models have proven to be successful in a wide range of machine learning tasks. Yet, they are often highly sensitive to perturbations on the input data which can lead to incorrect decisions with high confidence, hampering their…

Machine Learning · Computer Science 2023-06-13 Steffen Jung , Jovita Lukasik , Margret Keuper

Classic results establish that encouraging predictive diversity improves performance in ensembles of low-capacity models, e.g. through bagging or boosting. Here we demonstrate that these intuitions do not apply to high-capacity neural…

Machine Learning · Computer Science 2024-01-11 Taiga Abe , E. Kelly Buchanan , Geoff Pleiss , John P. Cunningham

While deep learning has led to remarkable results on a number of challenging problems, researchers have discovered a vulnerability of neural networks in adversarial settings, where small but carefully chosen perturbations to the input can…

Neural and Evolutionary Computing · Computer Science 2018-11-26 Edward Grefenstette , Robert Stanforth , Brendan O'Donoghue , Jonathan Uesato , Grzegorz Swirszcz , Pushmeet Kohli

Adversarial robustness refers to a model's ability to resist perturbation of inputs, while distribution robustness evaluates the performance of the model under data shifts. Although both aim to ensure reliable performance, prior work has…

Machine Learning · Computer Science 2026-01-26 Yipei Wang , Zhaoying Pan , Xiaoqian Wang

Making learners robust to adversarial perturbation at test time (i.e., evasion attacks) or training time (i.e., poisoning attacks) has emerged as a challenging task. It is known that for some natural settings, sublinear perturbations in the…

Machine Learning · Computer Science 2018-11-07 Saeed Mahloujifar , Mohammad Mahmoody

Despite the remarkable success of deep neural networks, significant concerns have emerged about their robustness to adversarial perturbations to inputs. While most attacks aim to ensure that these are imperceptible, physical perturbation…

Machine Learning · Computer Science 2020-10-09 Liang Tong , Minzhe Guo , Atul Prakash , Yevgeniy Vorobeychik

Neural networks are vulnerable to small adversarial perturbations. Existing literature largely focused on understanding and mitigating the vulnerability of learned models. In this paper, we demonstrate an intriguing phenomenon about the…

Machine Learning · Computer Science 2019-02-25 Gavin Weiguang Ding , Kry Yik Chau Lui , Xiaomeng Jin , Luyu Wang , Ruitong Huang

The vulnerability to adversarial perturbations is a major flaw of Deep Neural Networks (DNNs) that raises question about their reliability when in real-world scenarios. On the other hand, human perception, which DNNs are supposed to…

Machine Learning · Computer Science 2023-08-09 Muhammad Ahmed Shah , Bhiksha Raj

The vulnerability of deep neural networks (DNNs) to adversarial attack, which is an attack that can mislead state-of-the-art classifiers into making an incorrect classification with high confidence by deliberately perturbing the original…

Machine Learning · Computer Science 2021-06-18 Lina Wang , Rui Tang , Yawei Yue , Xingshu Chen , Wei Wang , Yi Zhu , Xuemei Zeng

Deep neural networks are highly expressive models that have recently achieved state of the art performance on speech and visual recognition tasks. While their expressiveness is the reason they succeed, it also causes them to learn…

Computer Vision and Pattern Recognition · Computer Science 2014-02-20 Christian Szegedy , Wojciech Zaremba , Ilya Sutskever , Joan Bruna , Dumitru Erhan , Ian Goodfellow , Rob Fergus

Machine learning models are vulnerable to tiny adversarial input perturbations optimized to cause a very large output error. To measure this vulnerability, we need reliable methods that can find such adversarial perturbations. For image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Levente Halmosi , Bálint Mohos , Márk Jelasity

In practice it is often found that large over-parameterized neural networks generalize better than their smaller counterparts, an observation that appears to conflict with classical notions of function complexity, which typically favor…

Machine Learning · Statistics 2018-06-20 Roman Novak , Yasaman Bahri , Daniel A. Abolafia , Jeffrey Pennington , Jascha Sohl-Dickstein

Training machine learning models that are robust against adversarial inputs poses seemingly insurmountable challenges. To better understand adversarial robustness, we consider the underlying problem of learning robust representations. We…

Machine Learning · Computer Science 2020-07-07 Sicheng Zhu , Xiao Zhang , David Evans

Given the rapid changes in telecommunication systems and their higher dependence on artificial intelligence, it is increasingly important to have models that can perform well under different, possibly adverse, conditions. Deep Neural…

Signal Processing · Electrical Eng. & Systems 2021-03-30 Javier Maroto , Gérôme Bovet , Pascal Frossard

Adversarial training is widely acknowledged as the most effective defense against adversarial attacks. However, it is also well established that achieving both robustness and generalization in adversarially trained models involves a…

Computation and Language · Computer Science 2023-12-12 Enes Altinisik , Hassan Sajjad , Husrev Taha Sencar , Safa Messaoud , Sanjay Chawla

The study of adversarial robustness has so far largely focused on perturbations bound in p-norms. However, state-of-the-art models turn out to be also vulnerable to other, more natural classes of perturbations such as translations and…

Machine Learning · Computer Science 2019-09-17 Logan Engstrom , Brandon Tran , Dimitris Tsipras , Ludwig Schmidt , Aleksander Madry
‹ Prev 1 3 4 5 6 7 10 Next ›