English
Related papers

Related papers: Mischief: A Simple Black-Box Attack Against Transf…

200 papers

Large-scale language models achieved state-of-the-art performance over a number of language tasks. However, they fail on adversarial language examples, which are sentences optimized to fool the language models but with similar semantic…

Computation and Language · Computer Science 2023-10-31 Noah Thomas McDermott , Junfeng Yang , Chengzhi Mao

Neural networks are vulnerable to adversarial examples, malicious inputs crafted to fool trained models. Adversarial examples often exhibit black-box transfer, meaning that adversarial examples for one model can fool another model. However,…

Machine Learning · Computer Science 2018-11-22 Qian Huang , Zeqi Gu , Isay Katsman , Horace He , Pian Pawakapan , Zhiqiu Lin , Serge Belongie , Ser-Nam Lim

Adversarial examples in machine learning are typically generated using gradients, obtained either directly through access to the model or approximated via queries to it. In this paper, we propose a much simpler approach to craft adversarial…

Machine Learning · Computer Science 2026-05-05 Alexander Warnecke , Konrad Rieck

Language Models today provide a high accuracy across a large number of downstream tasks. However, they remain susceptible to adversarial attacks, particularly against those where the adversarial examples maintain considerable similarity to…

Computation and Language · Computer Science 2023-07-25 Neel Bhandari , Pin-Yu Chen

Adversarial examples are small and often imperceptible perturbations crafted to fool machine learning models. These attacks seriously threaten the reliability of deep neural networks, especially in security-sensitive domains. Evasion…

Cryptography and Security · Computer Science 2025-06-24 Francesco Marchiori , Marco Alecci , Luca Pajola , Mauro Conti

Machine learning models are powerful but fallible. Generating adversarial examples - inputs deliberately crafted to cause model misclassification or other errors - can yield important insight into model assumptions and vulnerabilities.…

Machine Learning · Computer Science 2017-12-18 Catherine Wong

We propose a new, simple framework for crafting adversarial examples for black box attacks. The idea is to simulate the substitution model with a non-trainable model compounded of just one layer of handcrafted convolutional kernels and then…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Petr Dvořáček , Petr Hurtik , Petra Števuliáková

Robustness to adversarial examples of machine learning models remains an open topic of research. Attacks often succeed by repeatedly probing a fixed target model with adversarial examples purposely crafted to fool it. In this paper, we…

Machine Learning · Computer Science 2022-02-21 Abderrahmen Amich , Birhanu Eshete

The ability to deploy neural networks in real-world, safety-critical systems is severely limited by the presence of adversarial examples: slightly perturbed inputs that are misclassified by the network. In recent years, several techniques…

Machine Learning · Computer Science 2018-02-21 Nicholas Carlini , Guy Katz , Clark Barrett , David L. Dill

Adversarial attacks expose vulnerabilities of deep learning models by introducing minor perturbations to the input, which lead to substantial alterations in the output. Our research focuses on the impact of such adversarial attacks on…

Computation and Language · Computer Science 2023-09-14 Pavel Burnyshev , Elizaveta Kostenok , Alexey Zaytsev

Adversarial attacks dramatically change the output of an otherwise accurate learning system using a seemingly inconsequential modification to a piece of input data. Paradoxically, empirical evidence indicates that even systems which are…

Machine Learning · Computer Science 2024-09-13 Oliver J. Sutton , Qinghua Zhou , Ivan Y. Tyukin , Alexander N. Gorban , Alexander Bastounis , Desmond J. Higham

Deep neural networks are susceptible to adversarial attacks, which pose a significant threat to their security and reliability in real-world applications. The most notable adversarial attacks are transfer-based attacks, where an adversary…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Kunyu Wang , Juluan Shi , Wenxuan Wang

The growth of highly advanced Large Language Models (LLMs) constitutes a huge dual-use problem, making it necessary to create dependable AI-generated text detection systems. Modern detectors are notoriously vulnerable to adversarial…

Cryptography and Security · Computer Science 2025-10-06 Lekkala Sai Teja , Annepaka Yadagiri , Sangam Sai Anish , Siva Gopala Krishna Nuthakki , Partha Pakray

More capable language models increasingly saturate existing task benchmarks, in some cases outperforming humans. This has left little headroom with which to measure further progress. Adversarial dataset creation has been proposed as a…

Computation and Language · Computer Science 2021-11-17 Jason Phang , Angelica Chen , William Huang , Samuel R. Bowman

Advances in Machine Learning (ML) have led to its adoption as an integral component in many applications, including banking, medical diagnosis, and driverless cars. To further broaden the use of ML models, cloud-based services offered by…

Machine Learning · Computer Science 2017-03-14 Hossein Hosseini , Yize Chen , Sreeram Kannan , Baosen Zhang , Radha Poovendran

Deepfakes utilise Artificial Intelligence (AI) techniques to create synthetic media where the likeness of one person is replaced with another. There are growing concerns that deepfakes can be maliciously used to create misleading and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Nyee Thoang Lim , Meng Yi Kuan , Muxin Pu , Mei Kuan Lim , Chun Yong Chong

We propose an efficient method to generate white-box adversarial examples to trick a character-level neural classifier. We find that only a few manipulations are needed to greatly decrease the accuracy. Our method relies on an atomic flip…

Computation and Language · Computer Science 2018-05-25 Javid Ebrahimi , Anyi Rao , Daniel Lowd , Dejing Dou

Adversarial examples are perturbed inputs which can cause a serious threat for machine learning models. Finding these perturbations is such a hard task that we can only use the iterative methods to traverse. For computational efficiency,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Xiaofeng Mao , Yuefeng Chen , Yuhong Li , Yuan He , Hui Xue

Neural networks are vulnerable to adversarial examples, malicious inputs crafted to fool trained models. Adversarial examples often exhibit black-box transfer, meaning that adversarial examples for one model can fool another model. However,…

Machine Learning · Computer Science 2020-03-02 Qian Huang , Isay Katsman , Horace He , Zeqi Gu , Serge Belongie , Ser-Nam Lim

Deep neural networks are at the forefront of machine learning research. However, despite achieving impressive performance on complex tasks, they can be very sensitive: Small perturbations of inputs can be sufficient to induce incorrect…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Alex Serban , Erik Poll , Joost Visser