English
Related papers

Related papers: BAGM: A Backdoor Attack for Manipulating Text-to-I…

200 papers

When a small number of poisoned samples are injected into the training dataset of a deep neural network, the network can be induced to exhibit malicious behavior during inferences, which poses potential threats to real-world applications.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Haoheng Lan , Jindong Gu , Philip Torr , Hengshuang Zhao

We investigate a new threat to neural sequence-to-sequence (seq2seq) models: training-time attacks that cause models to "spin" their output and support a certain sentiment when the input contains adversary-chosen trigger words. For example,…

Cryptography and Security · Computer Science 2022-10-12 Eugene Bagdasaryan , Vitaly Shmatikov

While text-to-image diffusion models demonstrate impressive generation capabilities, they also exhibit vulnerability to backdoor attacks, which involve the manipulation of model outputs through malicious triggers. In this paper, for the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Zhongqi Wang , Jie Zhang , Shiguang Shan , Xilin Chen

Backdoor attacks pose a serious security threat to large language models (LLMs), which are increasingly deployed as general-purpose assistants in safety- and privacy-critical applications. Existing LLM backdoors rely primarily on…

Cryptography and Security · Computer Science 2026-05-15 Rui Wen , Mark Russinovich , Andrew Paverd , Jun Sakuma , Ahmed Salem

Backdoor attacks have become an emerging threat to NLP systems. By providing poisoned training data, the adversary can embed a "backdoor" into the victim model, which allows input instances satisfying certain textual patterns (e.g.,…

Computation and Language · Computer Science 2023-05-30 Jun Yan , Vansh Gupta , Xiang Ren

In recent years, machine learning models have been shown to be vulnerable to backdoor attacks. Under such attacks, an adversary embeds a stealthy backdoor into the trained model such that the compromised models will behave normally on clean…

Cryptography and Security · Computer Science 2022-10-18 Khoa D. Doan , Yingjie Lao , Ping Li

Graphical User Interface (GUI) agents powered by Large Vision-Language Models (LVLMs) have emerged as a revolutionary approach to automating human-machine interactions, capable of autonomously operating personal devices (e.g., mobile…

Computation and Language · Computer Science 2025-09-25 Ziang Ye , Yang Zhang , Wentao Shi , Xiaoyu You , Fuli Feng , Tat-Seng Chua

Training multimodal generative models on large, uncurated datasets can result in users being exposed to harmful, unsafe and controversial or culturally-inappropriate outputs. While model editing has been proposed to remove or filter…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Jordan Vice , Naveed Akhtar , Mubarak Shah , Richard Hartley , Ajmal Mian

Machine Learning as a Service (MLaaS) has gained popularity due to advancements in Deep Neural Networks (DNNs). However, untrusted third-party platforms have raised concerns about AI security, particularly in backdoor attacks. Recent…

Cryptography and Security · Computer Science 2024-03-12 Zhe Ye , Diqun Yan , Li Dong , Kailai Shen

Diffusion Models (DMs) are state-of-the-art generative models that learn a reversible corruption process from iterative noise addition and denoising. They are the backbone of many generative AI applications, such as text-to-image…

Cryptography and Security · Computer Science 2024-01-01 Sheng-Yen Chou , Pin-Yu Chen , Tsung-Yi Ho

In this paper, we present an empirical study introducing a nuanced evaluation framework for text-to-image (T2I) generative models, applied to human image synthesis. Our framework categorizes evaluations into two distinct groups: first,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Muxi Chen , Yi Liu , Jian Yi , Changran Xu , Qiuxia Lai , Hongliang Wang , Tsung-Yi Ho , Qiang Xu

In recent years, text-to-image (T2I) diffusion models have gained significant attention for their ability to generate high quality images reflecting text prompts. However, their growing popularity has also led to the emergence of backdoor…

Cryptography and Security · Computer Science 2025-08-05 Shengfang Zhai , Jiajun Li , Yue Liu , Huanran Chen , Zhihua Tian , Wenjie Qu , Qingni Shen , Ruoxi Jia , Yinpeng Dong , Jiaheng Zhang

Deep neural networks are vulnerable to adversarial attacks, such as backdoor attacks in which a malicious adversary compromises a model during training such that specific behaviour can be triggered at test time by attaching a specific word…

Cryptography and Security · Computer Science 2022-10-21 You Guo , Jun Wang , Trevor Cohn

The tremendous recent advances in generative artificial intelligence techniques have led to significant successes and promise in a wide range of different applications ranging from conversational agents and textual content generation to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Hossein Aboutalebi , Dayou Mao , Rongqi Fan , Carol Xu , Chris He , Alexander Wong

With the success of deep learning algorithms in various domains, studying adversarial attacks to secure deep models in real world applications has become an important research topic. Backdoor attacks are a form of adversarial attacks on…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Aniruddha Saha , Akshayvarun Subramanya , Hamed Pirsiavash

Generative Artificial Intelligence (AI) has created unprecedented opportunities for creative expression, education, and research. Text-to-image systems such as DALL.E, Stable Diffusion, and Midjourney can now convert ideas into visuals…

Artificial Intelligence · Computer Science 2025-12-16 Dang Phuong Nam , Nguyen Kieu , Pham Thanh Hieu

Growing applications of large language models (LLMs) trained by a third party raise serious concerns on the security vulnerability of LLMs.It has been demonstrated that malicious actors can covertly exploit these vulnerabilities in LLMs…

Cryptography and Security · Computer Science 2023-12-11 Shuli Jiang , Swanand Ravindra Kadhe , Yi Zhou , Ling Cai , Nathalie Baracaldo

Diffusion language models (DLMs) have recently emerged as an alternative modeling paradigm to autoregressive (AR) language models, enabling parallel generation and bidirectional context modeling. Yet their security implications,…

Cryptography and Security · Computer Science 2026-05-12 Shengfang Zhai , Xiaoyang Ji , Yuling Shi , Haoran Gao , Fanyu Meng , Yan Zeng , Yuejian Fang , Yinpeng Dong , Jiaheng Zhang

With the growing popularity of Large Language Models (LLMs) and vector databases, private textual data is increasingly processed and stored as numerical embeddings. However, recent studies have proven that such embeddings are vulnerable to…

Cryptography and Security · Computer Science 2025-02-19 Yiyi Chen , Qiongkai Xu , Johannes Bjerva

Deep neural networks (DNNs) have achieved tremendous success in various applications including video action recognition, yet remain vulnerable to backdoor attacks (Trojans). The backdoor-compromised model will mis-classify to the target…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xi Li , Songhe Wang , Ruiquan Huang , Mahanth Gowda , George Kesidis