English
Related papers

Related papers: Instruct2Attack: Language-Guided Semantic Adversar…

200 papers

Recent studies have revealed the vulnerability of pre-trained language models to adversarial attacks. Existing adversarial defense techniques attempt to reconstruct adversarial examples within feature or text spaces. However, these methods…

Computation and Language · Computer Science 2024-04-02 Heng Yang , Ke Li

Language-conditioned robotic learning has significantly enhanced robot adaptability by enabling a single model to execute diverse tasks in response to verbal commands. Despite these advancements, security vulnerabilities within this domain…

Machine Learning · Computer Science 2024-11-26 Ke Zhao , Huayang Huang , Miao Li , Yu Wu

We introduce TESS 2, a general instruction-following diffusion language model that outperforms contemporary instruction-tuned diffusion models, as well as matches and sometimes exceeds strong autoregressive (AR) models. We train TESS 2 by…

Computation and Language · Computer Science 2025-06-03 Jaesung Tae , Hamish Ivison , Sachin Kumar , Arman Cohan

Large Language Models (LLMs) are susceptible to generating harmful content when prompted with carefully crafted inputs, a vulnerability known as LLM jailbreaking. As LLMs become more powerful, studying jailbreak methods is critical to…

Computation and Language · Computer Science 2025-01-07 Hao Wang , Hao Li , Junda Zhu , Xinyuan Wang , Chengwei Pan , MinLie Huang , Lei Sha

In this paper, we tackle the emerging challenge of unintended harmful content generation in Large Language Models (LLMs) with a novel dual-stage optimisation technique using adversarial fine-tuning. Our two-pronged approach employs an…

Computation and Language · Computer Science 2023-08-29 Charles O'Neill , Jack Miller , Ioana Ciuca , Yuan-Sen Ting , Thang Bui

Diffusion-based policies have recently achieved remarkable success in robotics by formulating action prediction as a conditional denoising process. However, the standard practice of sampling from random Gaussian noise often requires…

Robotics · Computer Science 2026-05-08 Jindou Jia , Gen Li , Xiangyu Chen , Tuo An , Yuxuan Hu , Jingliang Li , Xinying Guo , Jianfei Yang

Text adversarial attack methods are typically designed for static scenarios with fixed numbers of output labels and a predefined label space, relying on extensive querying of the victim model (query-based attacks) or the surrogate model…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Wenqiang Wang , Siyuan Liang , Xiao Yan , Xiaochun Cao

The fast advancements in Large Language Models (LLMs) are driving an increasing number of applications. Together with the growing number of users, we also see an increasing number of attackers who try to outsmart these systems. They want…

Cryptography and Security · Computer Science 2024-05-31 Patrick Levi , Christoph P. Neumann

We introduce Imagination-Augmented Agents (I2As), a novel architecture for deep reinforcement learning combining model-free and model-based aspects. In contrast to most existing model-based reinforcement learning and planning methods, which…

Deep neural networks are vulnerable to small input perturbations known as adversarial attacks. Inspired by the fact that these adversaries are constructed by iteratively minimizing the confidence of a network for the true class label, we…

Machine Learning · Computer Science 2021-12-17 Motasem Alfarra , Juan C. Pérez , Ali Thabet , Adel Bibi , Philip H. S. Torr , Bernard Ghanem

An adversarial attack is an exploitative process in which minute alterations are made to natural inputs, causing the inputs to be misclassified by neural models. In the field of speech recognition, this has become an issue of increasing…

Sound · Computer Science 2018-09-13 Krishan Rajaratnam , Kunal Shah , Jugal Kalita

Text-to-image diffusion models have recently become highly capable, yet their behavior in multi-object scenes remains unreliable: models often produce an incorrect number of instances and exhibit semantics leaking across objects. We trace…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Sanghyun Jo , Wooyeol Lee , Ziseok Lee , Kyungsu Kim

Deep neural networks were significantly vulnerable to adversarial examples manipulated by malicious tiny perturbations. Although most conventional adversarial attacks ensured the visual imperceptibility between adversarial examples and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Shuai Li , Xiaoyu Jiang , Xiaoguang Ma

Autonomous agentic AI systems powered by vision-language models (VLMs) are rapidly advancing toward real-world deployment, yet their cross-modal reasoning capabilities introduce new attack surfaces for adversarial manipulation that exploit…

Artificial Intelligence · Computer Science 2025-11-25 Hangoo Kang , Jehyeok Yeon , Gagandeep Singh

Adversarial attacks for discrete data (such as texts) have been proved significantly more challenging than continuous data (such as images) since it is difficult to generate adversarial samples with gradient-based methods. Current…

Computation and Language · Computer Science 2020-10-05 Linyang Li , Ruotian Ma , Qipeng Guo , Xiangyang Xue , Xipeng Qiu

Written language contains stylistic cues that can be exploited to automatically infer a variety of potentially sensitive author information. Adversarial stylometry intends to attack such models by rewriting an author's text. Our research…

Computation and Language · Computer Science 2021-01-28 Chris Emmery , Ákos Kádár , Grzegorz Chrupała

Advances in the development of adversarial attacks have been fundamental to the progress of adversarial defense research. Efficient and effective attacks are crucial for reliable evaluation of defenses, and also for developing robust…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Gaurang Sriramanan , Sravanti Addepalli , Arya Baburaj , R. Venkatesh Babu

Image editing aims to edit the given synthetic or real image to meet the specific requirements from users. It is widely studied in recent years as a promising and challenging field of Artificial Intelligence Generative Content (AIGC).…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xincheng Shuai , Henghui Ding , Xingjun Ma , Rongcheng Tu , Yu-Gang Jiang , Dacheng Tao

Neural Machine Translation (NMT) systems are used in various applications. However, it has been shown that they are vulnerable to very small perturbations of their inputs, known as adversarial attacks. In this paper, we propose a new…

Computation and Language · Computer Science 2023-03-03 Sahar Sadrizadeh , AmirHossein Dabiri Aghdam , Ljiljana Dolamic , Pascal Frossard

Generating relevant responses in a dialog is challenging, and requires not only proper modeling of context in the conversation but also being able to generate fluent sentences during inference. In this paper, we propose a two-step framework…

Computation and Language · Computer Science 2020-11-04 Kashif Khan , Gaurav Sahu , Vikash Balasubramanian , Lili Mou , Olga Vechtomova