English
Related papers

Related papers: RedHerring Attack: Testing the Reliability of Atta…

200 papers

Adversarial examples pose a significant challenge to deep neural networks (DNNs) across both image and text domains, with the intent to degrade model performance through meticulously altered inputs. Adversarial texts, however, are distinct…

Machine Learning · Computer Science 2025-01-24 Shakila Mahjabin Tonni , Pedro Faustini , Mark Dras

Machine Learning models have been shown to be vulnerable to adversarial examples, ie. the manipulation of data by a attacker to defeat a defender's classifier at test time. We present a novel probabilistic definition of adversarial examples…

Machine Learning · Statistics 2018-01-09 Martin Gubri

Adversarial attacks on deep-learning models pose a serious threat to their reliability and security. Existing defense mechanisms are narrow addressing a specific type of attack or being vulnerable to sophisticated attacks. We propose a new…

Machine Learning · Computer Science 2023-06-22 Mouna Rabhi , Roberto Di Pietro

In the past decades, the rise of artificial intelligence has given us the capabilities to solve the most challenging problems in our day-to-day lives, such as cancer prediction and autonomous navigation. However, these applications might…

Cryptography and Security · Computer Science 2022-09-13 Ehsan Nowroozi , Mohammadreza Mohammadi , Pargol Golmohammadi , Yassine Mekdad , Mauro Conti , Selcuk Uluagac

Recent NLP literature pays little attention to the robustness of toxicity language predictors, while these systems are most likely to be used in adversarial contexts. This paper presents a novel adversarial attack, \texttt{ToxicTrap},…

Computation and Language · Computer Science 2024-04-16 Dmitriy Bespalov , Sourav Bhabesh , Yi Xiang , Liutong Zhou , Yanjun Qi

Motivated by safety-critical classification problems, we investigate adversarial attacks against cost-sensitive classifiers. We use current state-of-the-art adversarially-resistant neural network classifiers [1] as the underlying models.…

Machine Learning · Statistics 2019-10-08 Gavin S. Hartnett , Andrew J. Lohn , Alexander P. Sedlack

Detecting text generated by large language models (LLMs) is of great recent interest. With zero-shot methods like DetectGPT, detection capabilities have reached impressive levels. However, the reliability of existing detectors in real-world…

Computation and Language · Computer Science 2025-03-13 Junchao Wu , Runzhe Zhan , Derek F. Wong , Shu Yang , Xinyi Yang , Yulin Yuan , Lidia S. Chao

With an ever-increasing reliance on machine learning (ML) models in the real world, adversarial examples threaten the safety of AI-based systems such as autonomous vehicles. In the image domain, they represent maliciously perturbed data…

Artificial Intelligence · Computer Science 2024-04-22 Dren Fazlija , Arkadij Orlov , Johanna Schrader , Monty-Maximilian Zühlke , Michael Rohs , Daniel Kudenko

An adversarial attack paradigm explores various scenarios for the vulnerability of deep learning models: minor changes of the input can force a model failure. Most of the state of the art frameworks focus on adversarial attacks for images…

Machine Learning · Computer Science 2020-06-22 I. Fursov , A. Zaytsev , N. Kluchnikov , A. Kravchenko , E. Burnaev

Current neural network-based classifiers are susceptible to adversarial examples even in the black-box setting, where the attacker only has query access to the model. In practice, the threat model for real-world systems is often more…

Computer Vision and Pattern Recognition · Computer Science 2018-07-12 Andrew Ilyas , Logan Engstrom , Anish Athalye , Jessy Lin

Neural networks are susceptible to data inference attacks such as the membership inference attack, the adversarial model inversion attack and the attribute inference attack, where the attacker could infer useful information such as the…

Machine Learning · Computer Science 2022-12-02 Ziqi Yang , Lijin Wang , Da Yang , Jie Wan , Ziming Zhao , Ee-Chien Chang , Fan Zhang , Kui Ren

There has been recently a growing interest in studying adversarial examples on natural language models in the black-box setting. These methods attack natural language classifiers by perturbing certain important words until the classifier…

Machine Learning · Computer Science 2021-05-04 Mahmoud Hossam , Trung Le , He Zhao , Viet Huynh , Dinh Phung

Many Machine Learning models are vulnerable to adversarial attacks: There exist methodologies that add a small (imperceptible) perturbation to an input such that the model comes up with a wrong prediction. Better understanding of such…

Cryptography and Security · Computer Science 2023-06-13 Paul Stahlhofen , André Artelt , Luca Hermes , Barbara Hammer

Machine Learning is becoming a pivotal aspect of many systems today, offering newfound performance on classification and prediction tasks, but this rapid integration also comes with new unforeseen vulnerabilities. To harden these systems…

Cryptography and Security · Computer Science 2022-02-22 Ahmed Abdou , Ryan Sheatsley , Yohan Beugin , Tyler Shipp , Patrick McDaniel

Natural Language Processing (NLP) models are used for text-related tasks such as classification and generation. To complete these tasks, input data is first tokenized from human-readable text into a format the model can understand, enabling…

Machine Learning · Computer Science 2025-06-10 Kasimir Schulz , Kenneth Yeung , Kieran Evans

Modern applications of artificial neural networks have yielded remarkable performance gains in a wide range of tasks. However, recent studies have discovered that such modelling strategy is vulnerable to Adversarial Examples, i.e. examples…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 João Monteiro , Isabela Albuquerque , Zahid Akhtar , Tiago H. Falk

Machine learning systems based on deep neural networks, being able to produce state-of-the-art results on various perception tasks, have gained mainstream adoption in many applications. However, they are shown to be vulnerable to…

Machine Learning · Computer Science 2018-01-16 Bo Luo , Yannan Liu , Lingxiao Wei , Qiang Xu

Following the recent adoption of deep neural networks (DNN) accross a wide range of applications, adversarial attacks against these models have proven to be an indisputable threat. Adversarial samples are crafted with a deliberate intention…

Machine Learning · Computer Science 2017-08-31 Valentina Zantedeschi , Maria-Irina Nicolae , Ambrish Rawat

Recent studies have shown that state-of-the-art deep learning models are vulnerable to the inputs with small perturbations (adversarial examples). We observe two critical obstacles in adversarial examples: (i) Strong adversarial attacks…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Xiaoyong Yuan , Pan He , Xiaolin Andy Li , Dapeng Oliver Wu

Deep Neural Networks (DNNs) are notoriously vulnerable to adversarial input designs with limited noise budgets. While numerous successful attacks with subtle modifications to original input have been proposed, defense techniques against…

Machine Learning · Computer Science 2025-06-27 Furkan Mumcu , Yasin Yilmaz