English
Related papers

Related papers: BlackMirror: Black-Box Backdoor Detection for Text…

200 papers

Diffusion models have achieved notable success in image generation, but they remain highly vulnerable to backdoor attacks, which compromise their integrity by producing specific undesirable outputs when presented with a pre-defined trigger.…

Cryptography and Security · Computer Science 2024-09-10 Yichuan Mo , Hui Huang , Mingjie Li , Ang Li , Yisen Wang

In response to adversarial text attacks, attack detection models have been proposed and shown to successfully identify text modified by adversaries. Attack detection models can be leveraged to provide an additional check for NLP models and…

Computation and Language · Computer Science 2025-09-26 Jonathan Rusert

Backdoor attacks compromise the integrity and reliability of machine learning models by embedding a hidden trigger during the training process, which can later be activated to cause unintended misbehavior. We propose a novel backdoor…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Felix Hsieh , Huy H. Nguyen , AprilPyone MaungMaung , Dmitrii Usynin , Isao Echizen

Large language models (LLMs) have seen significant advancements, achieving superior performance in various Natural Language Processing (NLP) tasks, from understanding to reasoning. However, they remain vulnerable to backdoor attacks, where…

Computation and Language · Computer Science 2024-11-28 Chen Chen , Yuchen Sun , Xueluan Gong , Jiaxin Gao , Kwok-Yan Lam

While image-to-text models have demonstrated significant advancements in various vision-language tasks, they remain susceptible to adversarial attacks. Existing white-box attacks on image-to-text models require access to the architecture,…

Artificial Intelligence · Computer Science 2024-08-20 Qingyuan Zeng , Zhenzhong Wang , Yiu-ming Cheung , Min Jiang

Machine unlearning aims to remove specific concepts from pretrained text-to-image diffusion models, yet several white- and black-box attacks have been introduced to make the model generate such unlearned concepts. These attacks,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Arian Komaei Koma , Seyed Amir Kasaei , AmirMahdi Sadeghzadeh , Mohammad Hossein Rohban

The ability to distinguish whether an image is generated by artificial intelligence (AI) is a crucial ingredient in human intelligence, usually accompanied by a complex and dialectical forensic and reasoning process. However, current fake…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yixuan Li , Xuelin Liu , Xiaoyang Wang , Bu Sung Lee , Shiqi Wang , Anderson Rocha , Weisi Lin

Supervised fine-tuning has become the predominant method for adapting large pretrained models to downstream tasks. However, recent studies have revealed that these models are vulnerable to backdoor attacks, where even a small number of…

Cryptography and Security · Computer Science 2025-01-08 Peihai Jiang , Xixiang Lyu , Yige Li , Jing Ma

Deep learning models are being integrated into a wide range of high-impact, security-critical systems, from self-driving cars to medical diagnosis. However, recent research has demonstrated that many of these deep learning architectures are…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Scott Freitas , Shang-Tse Chen , Zijie J. Wang , Duen Horng Chau

While text-to-image synthesis currently enjoys great popularity among researchers and the general public, the security of these models has been neglected so far. Many text-guided image generation models rely on pre-trained text encoders…

Machine Learning · Computer Science 2023-08-10 Lukas Struppek , Dominik Hintersdorf , Kristian Kersting

Text-to-image diffusion models can generate realistic images based on textual inputs, enabling users to convey their opinions visually through language. Meanwhile, within language, emotion plays a crucial role in expressing personal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Tianyu Wei , Shanmin Pang , Qi Guo , Yizhuo Ma , Xiaofeng Cao , Qing Guo

Deep neural networks have been demonstrated to be vulnerable to backdoor attacks. Specifically, by injecting a small number of maliciously constructed inputs into the training set, an adversary is able to plant a backdoor into the trained…

Machine Learning · Statistics 2019-12-10 Alexander Turner , Dimitris Tsipras , Aleksander Madry

This paper addresses the challenge of generating Counterfactual Explanations (CEs), involving the identification and modification of the fewest necessary features to alter a classifier's prediction for a given image. Our proposed method,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Guillaume Jeanneret , Loïc Simon , Frédéric Jurie

Many software engineering tasks, such as testing, and anomaly detection can benefit from the ability to infer a behavioral model of the software.Most existing inference approaches assume access to code to collect execution sequences. In…

Machine Learning · Computer Science 2021-10-13 Foozhan Ataiefard , Mohammad Jafar Mashhadi , Hadi Hemmati , Niel Walkinshaw

In a backdoor attack, an adversary inserts maliciously constructed backdoor examples into a training set to make the resulting model vulnerable to manipulation. Defending against such attacks typically involves viewing these inserted…

Cryptography and Security · Computer Science 2023-07-20 Alaa Khaddaj , Guillaume Leclerc , Aleksandar Makelov , Kristian Georgiev , Hadi Salman , Andrew Ilyas , Aleksander Madry

A backdoor attack in deep learning inserts a hidden backdoor in the model to trigger malicious behavior upon specific input patterns. Existing detection approaches assume a metric space (for either the original inputs or their latent…

Cryptography and Security · Computer Science 2023-12-06 Xiaoxing Mo , Yechao Zhang , Leo Yu Zhang , Wei Luo , Nan Sun , Shengshan Hu , Shang Gao , Yang Xiang

Modern text-to-image (T2I) models can now render legible, paragraph-length text, enabling a fundamentally new class of misuse. We identify and formalize the inscriptive jailbreak, where an adversary coerces a T2I system into generating…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Zonghao Ying , Haowen Dai , Lianyu Hu , Zonglei Jing , Quanchen Zou , Yaodong Yang , Aishan Liu , Xianglong Liu

Diffusion models (DMs) are advanced deep learning models that achieved state-of-the-art capability on a wide range of generative tasks. However, recent studies have shown their vulnerability regarding backdoor attacks, in which backdoored…

Artificial Intelligence · Computer Science 2024-09-24 Vu Tuan Truong , Long Bao Le

Backdoor attacks pose a significant threat to Large Language Models (LLMs), where adversaries can embed hidden triggers to manipulate LLM's outputs. Most existing defense methods, primarily designed for classification tasks, are ineffective…

Cryptography and Security · Computer Science 2025-11-12 Zihan Wang , Rui Zhang , Hongwei Li , Wenshu Fan , Wenbo Jiang , Qingchuan Zhao , Guowen Xu

Textual adversarial attacks pose a serious security threat to Natural Language Processing (NLP) systems by introducing imperceptible perturbations that mislead deep learning models. While adversarial example detection offers a lightweight…

Computation and Language · Computer Science 2026-03-16 He Zhu , Yanshu Li , Wen Liu , Haitian Yang