中文
相关论文

相关论文: Injecting Undetectable Backdoors in Obfuscated Neu…

200 篇论文

Prompt-based learning is vulnerable to backdoor attacks. Existing backdoor attacks against prompt-based models consider injecting backdoors into the entire embedding layers or word embedding vectors. Such attacks can be easily affected by…

计算与语言 · 计算机科学 2023-05-30 Kai Mei , Zheng Li , Zhenting Wang , Yang Zhang , Shiqing Ma

Backdoor attacks pose a serious threat to the security of large language models (LLMs), causing them to exhibit anomalous behavior under specific trigger conditions. The design of backdoor triggers has evolved from fixed triggers to dynamic…

密码学与安全 · 计算机科学 2026-04-15 Haotian Jin , Yang Li , Haihui Fan , Lin Shen , Xiangfang Li , Bo Li

Optical Character Recognition (OCR) is a widely used tool to extract text from scanned documents. Today, the state-of-the-art is achieved by exploiting deep neural networks. However, the cost of this performance is paid at the price of…

密码学与安全 · 计算机科学 2023-10-13 Mauro Conti , Nicola Farronato , Stefanos Koffas , Luca Pajola , Stjepan Picek

Large pre-trained language models (PLMs) have proven to be a crucial component of modern natural language processing systems. PLMs typically need to be fine-tuned on task-specific downstream datasets, which makes it hard to claim the…

计算与语言 · 计算机科学 2023-02-13 Chenxi Gu , Chengsong Huang , Xiaoqing Zheng , Kai-Wei Chang , Cho-Jui Hsieh

Foundation models have revolutionized computer vision by enabling broad generalization across diverse tasks. Yet, they remain highly susceptible to adversarial perturbations and targeted backdoor attacks. Mitigating such vulnerabilities…

机器学习 · 计算机科学 2025-10-17 Amel Abdelraheem , Alessandro Favero , Gerome Bovet , Pascal Frossard

Latent-space monitors aim to detect undesirable behaviours in Large Language Models by leveraging their internal representations rather than relying solely on black-box outputs. These methods have shown promise in identifying behaviours…

机器学习 · 计算机科学 2026-02-27 Rohan Gupta , Erik Jenner

Medical foundation models are gaining prominence in the medical community for their ability to derive general representations from extensive collections of medical image-text pairs. Recent research indicates that these models are…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Asif Hanif , Fahad Shamshad , Muhammad Awais , Muzammal Naseer , Fahad Shahbaz Khan , Karthik Nandakumar , Salman Khan , Rao Muhammad Anwer

With the rise of advanced reasoning capabilities, large language models (LLMs) are receiving increasing attention. However, although reasoning improves LLMs' performance on downstream tasks, it also introduces new security risks, as…

密码学与安全 · 计算机科学 2025-10-10 Man Hu , Xinyi Wu , Zuofeng Suo , Jinbo Feng , Linghui Meng , Yanhao Jia , Anh Tuan Luu , Shuai Zhao

We present a new type of backdoor attack that exploits a vulnerability of convolutional neural networks (CNNs) that has been previously unstudied. In particular, we examine the application of facial recognition. Deep learning techniques are…

计算机视觉与模式识别 · 计算机科学 2018-12-10 Jacob Dumford , Walter Scheirer

Driven by the rapid development of Large Language Models (LLMs), LLM-based agents have been developed to handle various real-world applications, including finance, healthcare, and shopping, etc. It is crucial to ensure the reliability and…

密码学与安全 · 计算机科学 2024-10-30 Wenkai Yang , Xiaohan Bi , Yankai Lin , Sishuo Chen , Jie Zhou , Xu Sun

This paper studies model-inversion attacks, in which the access to a model is abused to infer information about the training data. Since its first introduction, such attacks have raised serious concerns given that training data usually…

机器学习 · 计算机科学 2020-04-21 Yuheng Zhang , Ruoxi Jia , Hengzhi Pei , Wenxiao Wang , Bo Li , Dawn Song

Masked diffusion language models (MDLMs) are emerging as a compelling new paradigm for text generation, but their training-time security remains largely unexplored. Existing backdoor attacks on Gaussian diffusion models or autoregressive…

机器学习 · 计算机科学 2026-05-20 Daniel Yiming Cao , Chengzhong Wang , Sheng-Yen Chou , Chengyu Huang , Pin-Yu Chen , Shengwei An

The backdoor attack poses a new security threat to deep neural networks. Existing backdoor often relies on visible universal trigger to make the backdoored model malfunction, which are not only usually visually suspicious to human but also…

密码学与安全 · 计算机科学 2024-12-24 Xiangqi Wang , Mingfu Xue , Kewei Chen , Jing Xu , Wenmao Liu , Leo Yu Zhang , Yushu Zhang

With the ever-growing data and the need for developing powerful machine learning models, data owners increasingly depend on various untrusted platforms (e.g., public clouds, edges, and machine learning service providers) for scalable…

机器学习 · 计算机科学 2021-06-15 Sagar Sharma , Keke Chen

Backdoor data poisoning, inserted within instruction examples used to fine-tune a foundation Large Language Model (LLM) for downstream tasks (\textit{e.g.,} sentiment prediction), is a serious security concern due to the evasive nature of…

密码学与安全 · 计算机科学 2024-08-23 Jayaram Raghuram , George Kesidis , David J. Miller

The tremendous progress of autoencoders and generative adversarial networks (GANs) has led to their application to multiple critical tasks, such as fraud detection and sanitized data generation. This increasing adoption has fostered the…

密码学与安全 · 计算机科学 2020-10-09 Ahmed Salem , Yannick Sautter , Michael Backes , Mathias Humbert , Yang Zhang

Poisoning of data sets is a potential security threat to large language models that can lead to backdoored models. A description of the internal mechanisms of backdoored language models and how they process trigger inputs, e.g., when…

机器学习 · 计算机科学 2024-05-07 Max Lamparth , Anka Reuel

With the swift advancement of deep learning, state-of-the-art algorithms have been utilized in various social situations. Nonetheless, some algorithms have been discovered to exhibit biases and provide unequal results. The current debiasing…

机器学习 · 计算机科学 2024-07-02 Shangxi Wu , Qiuyang He , Jian Yu , Jitao Sang

Recent studies have shown that deep neural networks (DNNs) are vulnerable to backdoor attacks, where a designed trigger is injected into the dataset, causing erroneous predictions when activated. In this paper, we propose a novel defense…

机器学习 · 计算机科学 2025-08-08 Wenjie Huo , Katinka Wolter

Large language models (LLMs) have seen significant advancements, achieving superior performance in various Natural Language Processing (NLP) tasks, from understanding to reasoning. However, they remain vulnerable to backdoor attacks, where…

计算与语言 · 计算机科学 2024-11-28 Chen Chen , Yuchen Sun , Xueluan Gong , Jiaxin Gao , Kwok-Yan Lam