English
Related papers

Related papers: A practical approach to evaluating the adversarial…

200 papers

We introduce a two-player contest for evaluating the safety and robustness of machine learning systems, with a large prize pool. Unlike most prior work in ML robustness, which studies norm-constrained adversaries, we shift our focus to…

Machine Learning · Statistics 2018-09-25 Tom B. Brown , Nicholas Carlini , Chiyuan Zhang , Catherine Olsson , Paul Christiano , Ian Goodfellow

Machine learning (ML) models are increasingly deployed in cybersecurity applications such as phishing detection and network intrusion prevention. However, these models remain vulnerable to adversarial perturbations small, deliberate input…

Cryptography and Security · Computer Science 2026-02-09 Mona Rajhans , Vishal Khawarey

DL-based automatic modulation classification (AMC) models are highly susceptible to adversarial attacks, where even minimal input perturbations can cause severe misclassifications. While adversarially training an AMC model based on an…

Machine Learning · Computer Science 2025-01-06 Amirmohammad Bamdad , Ali Owfi , Fatemeh Afghah

The incremental diffusion of machine learning algorithms in supporting cybersecurity is creating novel defensive opportunities but also new types of risks. Multiple researches have shown that machine learning methods are vulnerable to…

Cryptography and Security · Computer Science 2021-06-18 Giovanni Apruzzese , Mauro Andreolini , Luca Ferretti , Mirco Marchetti , Michele Colajanni

Machine learning classifiers with high test accuracy often perform poorly under adversarial attacks. It is commonly believed that adversarial training alleviates this issue. In this paper, we demonstrate that, surprisingly, the opposite may…

Machine Learning · Computer Science 2022-03-30 Jacob Clarysse , Julia Hörrmann , Fanny Yang

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

Machine Learning · Computer Science 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

Current neural-network-based classifiers are susceptible to adversarial examples. The most empirically successful approach to defending against such adversarial examples is adversarial training, which incorporates a strong self-attack…

Machine Learning · Computer Science 2020-06-08 Bai Li , Shiqi Wang , Suman Jana , Lawrence Carin

Textual adversarial attacks can discover models' weaknesses by adding semantic-preserved but misleading perturbations to the inputs. The long-lasting adversarial attack-and-defense arms race in Natural Language Processing (NLP) is…

Computation and Language · Computer Science 2023-05-31 Yangyi Chen , Hongcheng Gao , Ganqu Cui , Lifan Yuan , Dehan Kong , Hanlu Wu , Ning Shi , Bo Yuan , Longtao Huang , Hui Xue , Zhiyuan Liu , Maosong Sun , Heng Ji

Machine learning algorithms are used to construct a mathematical model for a system based on training data. Such a model is capable of making highly accurate predictions without being explicitly programmed to do so. These techniques have a…

Cryptography and Security · Computer Science 2022-02-22 Cato Pauling , Michael Gimson , Muhammed Qaid , Ahmad Kida , Basel Halak

We introduce a metric for evaluating the robustness of a classifier, with particular attention to adversarial perturbations, in terms of expected functionality with respect to possible adversarial perturbations. A classifier is assumed to…

Machine Learning · Computer Science 2023-09-19 Ryan McCoppin , Colin Dawson , Sean M. Kennedy , Leslie M. Blaha

Machine Learning (ML) techniques can facilitate the automation of malicious software (malware for short) detection, but suffer from evasion attacks. Many studies counter such attacks in heuristic manners, lacking theoretical guarantees and…

Cryptography and Security · Computer Science 2023-04-07 Deqiang Li , Shicheng Cui , Yun Li , Jia Xu , Fu Xiao , Shouhuai Xu

While state-of-the-art Deep Neural Network (DNN) models are considered to be robust to random perturbations, it was shown that these architectures are highly vulnerable to deliberately crafted perturbations, albeit being…

Machine Learning · Computer Science 2021-06-03 Omer Faruk Tuna , Ferhat Ozgur Catak , M. Taner Eskil

Machine learning (ML) systems have introduced significant advances in various fields, due to the introduction of highly complex models. Despite their success, it has been shown multiple times that machine learning models are prone to…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Mehmet Kerim Yucel , Ramazan Gokberk Cinbis , Pinar Duygulu

Machine-learning architectures, such as Convolutional Neural Networks (CNNs) are vulnerable to adversarial attacks: inputs crafted carefully to force the system output to a wrong label. Since machine-learning is being deployed in…

Cryptography and Security · Computer Science 2022-11-03 Amira Guesmi , Ihsen Alouani , Khaled N. Khasawneh , Mouna Baklouti , Tarek Frikha , Mohamed Abid , Nael Abu-Ghazaleh

Benefiting from the rapid development of deep learning, 2D and 3D computer vision applications are deployed in many safe-critical systems, such as autopilot and identity authentication. However, deep learning models are not trustworthy…

Machine Learning · Computer Science 2023-10-03 Yanjie Li , Bin Xie , Songtao Guo , Yuanyuan Yang , Bin Xiao

As cyber-attacks become more sophisticated, improving the robustness of Machine Learning (ML) models must be a priority for enterprises of all sizes. To reliably compare the robustness of different ML models for cyber-attack detection in…

Cryptography and Security · Computer Science 2025-05-20 João Vitorino , Miguel Silva , Eva Maia , Isabel Praça

Adversarial training is one of the most effective approaches defending against adversarial examples for deep learning models. Unlike other defense strategies, adversarial training aims to promote the robustness of models intrinsically.…

Machine Learning · Computer Science 2021-04-22 Tao Bai , Jinqi Luo , Jun Zhao , Bihan Wen , Qian Wang

Neural networks are susceptible to artificially designed adversarial perturbations. Recent efforts have shown that imposing certain modifications on classification layer can improve the robustness of the neural networks. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Cong Xu , Xiang Li , Min Yang

This paper investigates recently proposed approaches for defending against adversarial examples and evaluating adversarial robustness. We motivate 'adversarial risk' as an objective for achieving models robust to worst-case inputs. We then…

Machine Learning · Computer Science 2018-06-13 Jonathan Uesato , Brendan O'Donoghue , Aaron van den Oord , Pushmeet Kohli

Machine learning models are vulnerable to adversarial attacks. One approach to addressing this vulnerability is certification, which focuses on models that are guaranteed to be robust for a given perturbation size. A drawback of recent…

Machine Learning · Computer Science 2020-10-07 Ryan Campbell , Chris Finlay , Adam M Oberman