中文
相关论文

相关论文: BlackMirror: Black-Box Backdoor Detection for Text…

200 篇论文

Diffusion models have achieved notable success in image generation, but they remain highly vulnerable to backdoor attacks, which compromise their integrity by producing specific undesirable outputs when presented with a pre-defined trigger.…

密码学与安全 · 计算机科学 2024-09-10 Yichuan Mo , Hui Huang , Mingjie Li , Ang Li , Yisen Wang

In response to adversarial text attacks, attack detection models have been proposed and shown to successfully identify text modified by adversaries. Attack detection models can be leveraged to provide an additional check for NLP models and…

计算与语言 · 计算机科学 2025-09-26 Jonathan Rusert

Backdoor attacks compromise the integrity and reliability of machine learning models by embedding a hidden trigger during the training process, which can later be activated to cause unintended misbehavior. We propose a novel backdoor…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Felix Hsieh , Huy H. Nguyen , AprilPyone MaungMaung , Dmitrii Usynin , Isao Echizen

Large language models (LLMs) have seen significant advancements, achieving superior performance in various Natural Language Processing (NLP) tasks, from understanding to reasoning. However, they remain vulnerable to backdoor attacks, where…

计算与语言 · 计算机科学 2024-11-28 Chen Chen , Yuchen Sun , Xueluan Gong , Jiaxin Gao , Kwok-Yan Lam

While image-to-text models have demonstrated significant advancements in various vision-language tasks, they remain susceptible to adversarial attacks. Existing white-box attacks on image-to-text models require access to the architecture,…

人工智能 · 计算机科学 2024-08-20 Qingyuan Zeng , Zhenzhong Wang , Yiu-ming Cheung , Min Jiang

Machine unlearning aims to remove specific concepts from pretrained text-to-image diffusion models, yet several white- and black-box attacks have been introduced to make the model generate such unlearned concepts. These attacks,…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Arian Komaei Koma , Seyed Amir Kasaei , AmirMahdi Sadeghzadeh , Mohammad Hossein Rohban

The ability to distinguish whether an image is generated by artificial intelligence (AI) is a crucial ingredient in human intelligence, usually accompanied by a complex and dialectical forensic and reasoning process. However, current fake…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Yixuan Li , Xuelin Liu , Xiaoyang Wang , Bu Sung Lee , Shiqi Wang , Anderson Rocha , Weisi Lin

Supervised fine-tuning has become the predominant method for adapting large pretrained models to downstream tasks. However, recent studies have revealed that these models are vulnerable to backdoor attacks, where even a small number of…

密码学与安全 · 计算机科学 2025-01-08 Peihai Jiang , Xixiang Lyu , Yige Li , Jing Ma

Deep learning models are being integrated into a wide range of high-impact, security-critical systems, from self-driving cars to medical diagnosis. However, recent research has demonstrated that many of these deep learning architectures are…

计算机视觉与模式识别 · 计算机科学 2020-11-17 Scott Freitas , Shang-Tse Chen , Zijie J. Wang , Duen Horng Chau

While text-to-image synthesis currently enjoys great popularity among researchers and the general public, the security of these models has been neglected so far. Many text-guided image generation models rely on pre-trained text encoders…

机器学习 · 计算机科学 2023-08-10 Lukas Struppek , Dominik Hintersdorf , Kristian Kersting

Text-to-image diffusion models can generate realistic images based on textual inputs, enabling users to convey their opinions visually through language. Meanwhile, within language, emotion plays a crucial role in expressing personal…

计算机视觉与模式识别 · 计算机科学 2025-10-31 Tianyu Wei , Shanmin Pang , Qi Guo , Yizhuo Ma , Xiaofeng Cao , Qing Guo

Deep neural networks have been demonstrated to be vulnerable to backdoor attacks. Specifically, by injecting a small number of maliciously constructed inputs into the training set, an adversary is able to plant a backdoor into the trained…

机器学习 · 统计学 2019-12-10 Alexander Turner , Dimitris Tsipras , Aleksander Madry

This paper addresses the challenge of generating Counterfactual Explanations (CEs), involving the identification and modification of the fewest necessary features to alter a classifier's prediction for a given image. Our proposed method,…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Guillaume Jeanneret , Loïc Simon , Frédéric Jurie

Many software engineering tasks, such as testing, and anomaly detection can benefit from the ability to infer a behavioral model of the software.Most existing inference approaches assume access to code to collect execution sequences. In…

机器学习 · 计算机科学 2021-10-13 Foozhan Ataiefard , Mohammad Jafar Mashhadi , Hadi Hemmati , Niel Walkinshaw

In a backdoor attack, an adversary inserts maliciously constructed backdoor examples into a training set to make the resulting model vulnerable to manipulation. Defending against such attacks typically involves viewing these inserted…

密码学与安全 · 计算机科学 2023-07-20 Alaa Khaddaj , Guillaume Leclerc , Aleksandar Makelov , Kristian Georgiev , Hadi Salman , Andrew Ilyas , Aleksander Madry

A backdoor attack in deep learning inserts a hidden backdoor in the model to trigger malicious behavior upon specific input patterns. Existing detection approaches assume a metric space (for either the original inputs or their latent…

密码学与安全 · 计算机科学 2023-12-06 Xiaoxing Mo , Yechao Zhang , Leo Yu Zhang , Wei Luo , Nan Sun , Shengshan Hu , Shang Gao , Yang Xiang

Modern text-to-image (T2I) models can now render legible, paragraph-length text, enabling a fundamentally new class of misuse. We identify and formalize the inscriptive jailbreak, where an adversary coerces a T2I system into generating…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Zonghao Ying , Haowen Dai , Lianyu Hu , Zonglei Jing , Quanchen Zou , Yaodong Yang , Aishan Liu , Xianglong Liu

Diffusion models (DMs) are advanced deep learning models that achieved state-of-the-art capability on a wide range of generative tasks. However, recent studies have shown their vulnerability regarding backdoor attacks, in which backdoored…

人工智能 · 计算机科学 2024-09-24 Vu Tuan Truong , Long Bao Le

Backdoor attacks pose a significant threat to Large Language Models (LLMs), where adversaries can embed hidden triggers to manipulate LLM's outputs. Most existing defense methods, primarily designed for classification tasks, are ineffective…

密码学与安全 · 计算机科学 2025-11-12 Zihan Wang , Rui Zhang , Hongwei Li , Wenshu Fan , Wenbo Jiang , Qingchuan Zhao , Guowen Xu

Textual adversarial attacks pose a serious security threat to Natural Language Processing (NLP) systems by introducing imperceptible perturbations that mislead deep learning models. While adversarial example detection offers a lightweight…

计算与语言 · 计算机科学 2026-03-16 He Zhu , Yanshu Li , Wen Liu , Haitian Yang