中文
相关论文

相关论文: Defending Against Stealthy Backdoor Attacks

200 篇论文

Backdoor attacks have become an emerging threat to NLP systems. By providing poisoned training data, the adversary can embed a "backdoor" into the victim model, which allows input instances satisfying certain textual patterns (e.g.,…

计算与语言 · 计算机科学 2023-05-30 Jun Yan , Vansh Gupta , Xiang Ren

Pre-trained language models (PTLMs) have achieved great success and remarkable performance over a wide range of natural language processing (NLP) tasks. However, there are also growing concerns regarding the potential security issues in the…

密码学与安全 · 计算机科学 2022-02-15 Shangwei Guo , Chunlong Xie , Jiwei Li , Lingjuan Lyu , Tianwei Zhang

Large Language Models (LLMs), while powerful, are built and trained to process a single text input. In common applications, multiple inputs can be processed by concatenating them together into a single stream of text. However, the LLM is…

密码学与安全 · 计算机科学 2024-03-25 Keegan Hines , Gary Lopez , Matthew Hall , Federico Zarfati , Yonatan Zunger , Emre Kiciman

As large language models are increasingly deployed in sensitive environments, fingerprinting attacks pose significant privacy and security risks. We present a study of LLM fingerprinting from both offensive and defensive perspectives. Our…

密码学与安全 · 计算机科学 2025-08-13 Kevin Kurian , Ethan Holland , Sean Oesch

Model Inversion (MI) attacks pose a significant threat to the privacy of Deep Neural Networks by recovering training data distribution from well-trained models. While existing defenses often rely on regularization techniques to reduce…

密码学与安全 · 计算机科学 2024-11-26 Zhen-Ting Liu , Shang-Tse Chen

The increasing demand for customized Large Language Models (LLMs) has led to the development of solutions like GPTs. These solutions facilitate tailored LLM creation via natural language prompts without coding. However, the trustworthiness…

密码学与安全 · 计算机科学 2024-05-29 Rui Zhang , Hongwei Li , Rui Wen , Wenbo Jiang , Yuan Zhang , Michael Backes , Yun Shen , Yang Zhang

Deep neural networks (DNNs) have been widely and successfully adopted and deployed in various applications of speech recognition. Recently, a few works revealed that these models are vulnerable to backdoor attacks, where the adversaries can…

声音 · 计算机科学 2023-07-18 Hanbo Cai , Pengcheng Zhang , Hai Dong , Yan Xiao , Stefanos Koffas , Yiming Li

Backdoor (trojan) attacks embed hidden, controllable behaviors into machine-learning models so that models behave normally on benign inputs but produce attacker-chosen outputs when a trigger is present. This survey reviews the rapidly…

密码学与安全 · 计算机科学 2025-09-10 Bilal Hussain Abbasi , Yanjun Zhang , Leo Zhang , Shang Gao

The rapid growth of natural language processing (NLP) and pre-trained language models have enabled accurate text classification in a variety of settings. However, text classification models are susceptible to backdoor attacks, where an…

密码学与安全 · 计算机科学 2024-12-30 A. Dilara Yavuz , M. Emre Gursoy

Natural Language Processing (NLP) models based on Machine Learning (ML) are susceptible to adversarial attacks -- malicious algorithms that imperceptibly modify input text to force models into making incorrect predictions. However,…

计算与语言 · 计算机科学 2023-05-26 Salijona Dyrmishi , Salah Ghamizi , Maxime Cordy

The Large Language Models (LLMs) are poised to offer efficient and intelligent services for future mobile communication networks, owing to their exceptional capabilities in language comprehension and generation. However, the extremely high…

密码学与安全 · 计算机科学 2023-09-07 Haomiao Yang , Kunlan Xiang , Mengyu Ge , Hongwei Li , Rongxing Lu , Shui Yu

Backdoor attacks have become a critical threat to deep neural networks (DNNs), drawing many research interests. However, most of the studied attacks employ a single type of trigger. Consequently, proposed backdoor defenders often rely on…

密码学与安全 · 计算机科学 2025-01-14 Duc Anh Vu , Anh Tuan Tran , Cong Tran , Cuong Pham

Recent developments in Large Language Models (LLMs) have manifested significant advancements. To facilitate safeguards against malicious exploitation, a body of research has concentrated on aligning LLMs with human preferences and…

密码学与安全 · 计算机科学 2024-06-11 Yuanpu Cao , Bochuan Cao , Jinghui Chen

The advent of Large Language Models (LLMs) has marked significant achievements in language processing and reasoning capabilities. Despite their advancements, LLMs face vulnerabilities to data poisoning attacks, where the adversary inserts…

For nearly a decade the academic community has investigated backdoors in neural networks, primarily focusing on classification tasks where adversaries manipulate the model prediction. While demonstrably malicious, the immediate real-world…

密码学与安全 · 计算机科学 2026-03-24 Nicolas Küchler , Ivan Petrov , Conrad Grobler , Ilia Shumailov

Deep neural networks are learning models having achieved state of the art performance in many fields like prediction, computer vision, language processing and so on. However, it has been shown that certain inputs exist which would not trick…

机器学习 · 计算机科学 2020-06-03 Jay N. Paranjape , Rahul Kumar Dubey , Vijendran V Gopalan

This paper proposes a new defense against neural network backdooring attacks that are maliciously trained to mispredict in the presence of attacker-chosen triggers. Our defense is based on the intuition that the feature extraction layers of…

机器学习 · 计算机科学 2023-02-24 Hao Fu , Akshaj Kumar Veldanda , Prashanth Krishnamurthy , Siddharth Garg , Farshad Khorrami

Prompt-based approaches offer a cutting-edge solution to data privacy issues in continual learning, particularly in scenarios involving multiple data suppliers where long-term storage of private user data is prohibited. Despite delivering…

机器学习 · 计算机科学 2024-12-18 Trang Nguyen , Anh Tran , Nhat Ho

Neural networks are often trained on proprietary datasets, making them attractive attack targets. We present a novel dataset extraction method leveraging an innovative training time backdoor attack, allowing a malicious federated learning…

密码学与安全 · 计算机科学 2025-12-19 Eden Luzon , Guy Amit , Roy Weiss , Torsten Kraub , Alexandra Dmitrienko , Yisroel Mirsky

Recently, deep neural networks have been shown to be vulnerable to backdoor attacks. A backdoor is inserted into neural networks via this attack paradigm, thus compromising the integrity of the network. As soon as an attacker presents a…

密码学与安全 · 计算机科学 2024-06-18 Zonghao Ying , Bin Wu