English
Related papers

Related papers: Adversarial Cheap Talk

200 papers

We introduce two tactics to attack agents trained by deep reinforcement learning algorithms using adversarial examples, namely the strategically-timed attack and the enchanting attack. In the strategically-timed attack, the adversary aims…

Machine Learning · Computer Science 2019-11-14 Yen-Chen Lin , Zhang-Wei Hong , Yuan-Hong Liao , Meng-Li Shih , Ming-Yu Liu , Min Sun

Adversarial training aims to defend against adversaries: malicious opponents whose sole aim is to harm predictive performance in any way possible. This presents a rather harsh perspective, which we assert results in unnecessarily…

Machine Learning · Computer Science 2025-06-10 Maayan Ehrenberg , Roy Ganz , Nir Rosenfeld

In recent years, many efforts have demonstrated that modern machine learning algorithms are vulnerable to adversarial attacks, where small, but carefully crafted, perturbations on the input can make them fail. While these attack methods are…

Cryptography and Security · Computer Science 2019-06-25 Yuan Gong , Boyang Li , Christian Poellabauer , Yiyu Shi

Adversarial attacks constitute a notable threat to machine learning systems, given their potential to induce erroneous predictions and classifications. However, within real-world contexts, the essential specifics of the deployed model are…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Jingwen Ye , Ruonan Yu , Songhua Liu , Xinchao Wang

Adversarial attacks are a type of attack on machine learning models where an attacker deliberately modifies the inputs to cause the model to make incorrect predictions. Adversarial attacks can have serious consequences, particularly in…

Machine Learning · Computer Science 2025-09-15 Prathyusha Devabhakthini , Sasmita Parida , Raj Mani Shukla , Suvendu Chandan Nayak , Tapadhir Das

Adversarial attacks, e.g., adversarial perturbations of the input and adversarial samples, pose significant challenges to machine learning and deep learning techniques, including interactive recommendation systems. The latent embedding…

Machine Learning · Computer Science 2021-12-03 Siyu Wang , Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Quan Z. Sheng

Deep Reinforcement Learning (DRL) is a subfield of machine learning for training autonomous agents that take sequential actions across complex environments. Despite its significant performance in well-known environments, it remains…

In targeted poisoning attacks, an attacker manipulates an agent-environment interaction to force the agent into adopting a policy of interest, called target policy. Prior work has primarily focused on attacks that modify standard MDP…

Machine Learning · Computer Science 2023-02-28 Mohammad Mohammadi , Jonathan Nöther , Debmalya Mandal , Adish Singla , Goran Radanovic

In this work, we propose an adversarial learning method for reward estimation in reinforcement learning (RL) based task-oriented dialog models. Most of the current RL based task-oriented dialog systems require the access to a reward signal…

Computation and Language · Computer Science 2018-05-31 Bing Liu , Ian Lane

Adversarial training (AT) is among the most effective techniques to improve model robustness by augmenting training data with adversarial examples. However, most existing AT methods adopt a specific attack to craft adversarial examples,…

Machine Learning · Computer Science 2020-11-20 Yinpeng Dong , Zhijie Deng , Tianyu Pang , Hang Su , Jun Zhu

Deep neural networks have been proven to be vulnerable to adversarial examples and various methods have been proposed to defend against adversarial attacks for natural language processing tasks. However, previous defense methods have…

Machine Learning · Computer Science 2024-03-01 Fangyuan Zhang , Huichi Zhou , Shuangjiao Li , Hongtao Wang

To ensure the usefulness of Reinforcement Learning (RL) in real systems, it is crucial to ensure they are robust to noise and adversarial attacks. In adversarial RL, an external attacker has the power to manipulate the victim agent's…

Machine Learning · Computer Science 2024-06-18 Jeremy McMahan , Young Wu , Xiaojin Zhu , Qiaomin Xie

In several reinforcement learning (RL) scenarios, mainly in security settings, there may be adversaries trying to interfere with the reward generating process. In this paper, we introduce Threatened Markov Decision Processes (TMDPs), which…

Machine Learning · Computer Science 2019-10-28 Victor Gallego , Roi Naveiro , David Rios Insua

A key component of modern conversational systems is the Dialogue State Tracker (or DST), which models a user's goals and needs. Toward building more robust and reliable DSTs, we introduce a prompt-based learning approach to automatically…

Computation and Language · Computer Science 2023-06-08 Xiangjue Dong , Yun He , Ziwei Zhu , James Caverlee

Recent work has shown the possibility of adversarial attacks on automatic speechrecognition (ASR) systems. However, in the vast majority of work in this area, theattacks have been executed only in the digital space, or have involved short…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-18 Joseph Szurley , J. Zico Kolter

Adversarial training (AT) is one of the most reliable methods for defending against adversarial attacks in machine learning. Variants of this method have been used as regularization mechanisms to achieve SOTA results on NLP benchmarks, and…

Computation and Language · Computer Science 2021-09-30 Javid Ebrahimi , Hao Yang , Wei Zhang

Pre-trained language models (PLMs) have been widely used to underpin various downstream tasks. However, the adversarial attack task has found that PLMs are vulnerable to small perturbations. Mainstream methods adopt a detached two-stage…

Computation and Language · Computer Science 2023-05-30 Xuanjie Fang , Sijie Cheng , Yang Liu , Wei Wang

Machine Learning (ML) models are known to be vulnerable to adversarial inputs and researchers have demonstrated that even production systems, such as self-driving cars and ML-as-a-service offerings, are susceptible. These systems represent…

Machine Learning · Computer Science 2021-01-11 Marissa Dotter , Sherry Xie , Keith Manville , Josh Harguess , Colin Busho , Mikel Rodriguez

This paper presents a controlled study of adversarial reinforcement learning in network security through a custom OpenAI Gym environment that models brute-force attacks and reactive defenses on multi-port services. The environment captures…

Machine Learning · Computer Science 2025-10-08 Abrar Shahid , Ibteeker Mahir Ishum , AKM Tahmidul Haque , M Sohel Rahman , A. B. M. Alim Al Islam

Adversarial attacks on Natural Language Processing (NLP) models expose vulnerabilities by introducing subtle perturbations to input text, often leading to misclassification while maintaining human readability. Existing methods typically…

Cryptography and Security · Computer Science 2025-06-12 Hetvi Waghela , Jaydip Sen , Sneha Rakshit , Subhasis Dasgupta