English
Related papers

Related papers: Adversarial Over-Sensitivity and Over-Stability St…

200 papers

Dialogue systems play an increasingly important role in various aspects of our daily life. It is evident from recent research that dialogue systems trained on human conversation data are biased. In particular, they can produce responses…

Computation and Language · Computer Science 2020-11-03 Haochen Liu , Wentao Wang , Yiqi Wang , Hui Liu , Zitao Liu , Jiliang Tang

Adversarial Training is proved to be an efficient method to defend against adversarial examples, being one of the few defenses that withstand strong attacks. However, traditional defense mechanisms assume a uniform attack over the examples…

Machine Learning · Computer Science 2020-10-27 Huimin Zeng , Chen Zhu , Tom Goldstein , Furong Huang

The escalating threat of adversarial attacks on deep learning models, particularly in security-critical fields, has underscored the need for robust deep learning systems. Conventional robustness evaluations have relied on adversarial…

Cryptography and Security · Computer Science 2024-11-19 Ping Guo , Cheng Gong , Xi Lin , Zhiyuan Yang , Qingfu Zhang

Open domain neural dialogue models, despite their successes, are known to produce responses that lack relevance, diversity, and in many cases coherence. These shortcomings stem from the limited ability of common training objectives to…

Computation and Language · Computer Science 2019-09-06 Oluwatobi Olabiyi , Erik T. Mueller , Christopher Larson , Tarek Lahlou

Adversarial examples are a pervasive phenomenon of machine learning models where seemingly imperceptible perturbations to the input lead to misclassifications for otherwise statistically accurate models. In this paper we study how the…

Machine Learning · Computer Science 2020-02-11 Marc Khoury

Adversarial attack research in natural language processing (NLP) has made significant progress in designing powerful attack methods and defence approaches. However, few efforts have sought to identify which source samples are the most…

Computation and Language · Computer Science 2023-06-26 Vyas Raina , Mark Gales

Generative Adversarial Networks (GANs) are a type of generative model which have received much attention due to their ability to model complex real-world data. Despite their recent successes, the process of training GANs remains…

Machine Learning · Computer Science 2020-03-26 Maciej Wiatrak , Stefano V. Albrecht , Andrew Nystrom

We propose algorithms to create adversarial attacks to assess model robustness in text classification problems. They can be used to create white box attacks and black box attacks while at the same time preserving the semantics and syntax of…

Computation and Language · Computer Science 2020-08-17 Rahul Singh , Tarun Joshi , Vijayan N. Nair , Agus Sudjianto

Neural networks are vulnerable to adversarial attacks -- small visually imperceptible crafted noise which when added to the input drastically changes the output. The most effective method of defending against these adversarial attacks is to…

Recent advancements in natural language processing have highlighted the vulnerability of deep learning models to adversarial attacks. While various defence mechanisms have been proposed, there is a lack of comprehensive benchmarks that…

Computation and Language · Computer Science 2025-01-23 Yang Wang , Chenghua Lin

Domain Adaptation arises when we aim at learning from source domain a model that can per- form acceptably well on a different target domain. It is especially crucial for Natural Language Generation (NLG) in Spoken Dialogue Systems when…

Computation and Language · Computer Science 2018-08-09 Van-Khanh Tran , Le-Minh Nguyen

As Large Language Models (LLMs) become increasingly integrated into real-world decision-making systems, understanding their behavioural vulnerabilities remains a critical challenge for AI safety and alignment. While existing evaluation…

Artificial Intelligence · Computer Science 2025-05-20 Lili Zhang , Haomiaomiao Wang , Long Cheng , Libao Deng , Tomas Ward

Neural networks are vulnerable to adversarial examples, i.e. inputs that are imperceptibly perturbed from natural data and yet incorrectly classified by the network. Adversarial training, a heuristic form of robust optimization that…

Machine Learning · Computer Science 2019-11-12 Ruiqi Gao , Tianle Cai , Haochuan Li , Liwei Wang , Cho-Jui Hsieh , Jason D. Lee

In this paper, we study the robustness of classical deep hedging strategies under distributional shifts by leveraging the concept of adversarial attacks. We first demonstrate that standard deep hedging models are highly vulnerable to small…

Optimization and Control · Mathematics 2025-10-24 Guangyi He , Tobias Sutter , Lukas Gonon

Adversarial robustness refers to a model's ability to resist perturbation of inputs, while distribution robustness evaluates the performance of the model under data shifts. Although both aim to ensure reliable performance, prior work has…

Machine Learning · Computer Science 2026-01-26 Yipei Wang , Zhaoying Pan , Xiaoqian Wang

Adversarial machine learning concerns situations in which learners face attacks from active adversaries. Such scenarios arise in applications such as spam email filtering, malware detection and fake image generation, where security methods…

Machine Learning · Computer Science 2025-10-07 David Benfield , Stefano Coniglio , Phan Tu Vuong , Alain Zemkoho

Recent works have illustrated that modern NLP models trained for diverse tasks ranging from sentiment analysis to language generation succumb to universal adversarial attacks, a class of input-agnostic attacks where a common trigger…

Computation and Language · Computer Science 2026-05-19 Benedict Florance Arockiaraj , Alexander Feng , Jianxiong Cai , Xiaoyu Cheng

DL-based automatic modulation classification (AMC) models are highly susceptible to adversarial attacks, where even minimal input perturbations can cause severe misclassifications. While adversarially training an AMC model based on an…

Machine Learning · Computer Science 2025-01-06 Amirmohammad Bamdad , Ali Owfi , Fatemeh Afghah

Increasing model size has unlocked a dazzling array of capabilities in modern language models. At the same time, even frontier models remain vulnerable to jailbreaks and prompt injections, despite concerted efforts to make them robust. As…

Machine Learning · Computer Science 2025-06-06 Nikolaus Howe , Ian McKenzie , Oskar Hollinsworth , Michał Zajac , Tom Tseng , Aaron Tucker , Pierre-Luc Bacon , Adam Gleave

Despite strong performance in numerous applications, the fragility of deep learning to input perturbations has raised serious questions about its use in safety-critical domains. While adversarial training can mitigate this issue in…

Machine Learning · Statistics 2021-11-01 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani , Alejandro Ribeiro