中文
相关论文

相关论文: Adaptive Defense against Harmful Fine-Tuning for L…

200 篇论文

Backdoor attacks can implant malicious behaviours into deep models while preserving performance on clean data, posing a serious threat to safety-critical vision systems. Although backdoor mitigation has been studied extensively for image…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Kealan Dunnett , Reza Arablouei , Dimity Miller , Volkan Dedeoglu , Raja Jurdak

Backdoor defense, which aims to detect or mitigate the effect of malicious triggers introduced by attackers, is becoming increasingly critical for machine learning security and integrity. Fine-tuning based on benign data is a natural…

人工智能 · 计算机科学 2023-10-31 Mingli Zhu , Shaokui Wei , Li Shen , Yanbo Fan , Baoyuan Wu

With the evolution of self-supervised learning, the pre-training paradigm has emerged as a predominant solution within the deep learning landscape. Model providers furnish pre-trained encoders designed to function as versatile feature…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Ziqi Zhou , Minghui Li , Wei Liu , Shengshan Hu , Yechao Zhang , Wei Wan , Lulu Xue , Leo Yu Zhang , Dezhong Yao , Hai Jin

Instruction-following language models are trained to be helpful and safe, yet their safety behavior can deteriorate under benign fine-tuning and worsen under adversarial updates. Existing defenses often offer limited protection or force a…

计算与语言 · 计算机科学 2026-05-12 Jyotin Goel , Souvik Maji , Pratik Mazumder

Harmful fine-tuning issues present significant safety challenges for fine-tuning-as-a-service in large language models. Existing alignment-stage defenses, e.g., Vaccine, Repnoise, Booster, and T-Vaccine, mitigate harmful fine-tuning issues…

密码学与安全 · 计算机科学 2025-10-14 Guozhi Liu , Qi Mu , Tiansheng Huang , Xinhua Wang , Li Shen , Weiwei Lin , Zhang Li

Supervised fine-tuning has become the predominant method for adapting large pretrained models to downstream tasks. However, recent studies have revealed that these models are vulnerable to backdoor attacks, where even a small number of…

密码学与安全 · 计算机科学 2025-01-08 Peihai Jiang , Xixiang Lyu , Yige Li , Jing Ma

Federated Learning (FL) facilitates decentralized machine learning model training, preserving data privacy, lowering communication costs, and boosting model performance through diversified data sources. Yet, FL faces vulnerabilities such as…

机器学习 · 计算机科学 2023-09-11 Torsten Krauß , Alexandra Dmitrienko

Backdoor defenses have been studied to alleviate the threat of deep neural networks (DNNs) being backdoor attacked and thus maliciously altered. Since DNNs usually adopt some external training data from an untrusted third party, a robust…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Kuofeng Gao , Yang Bai , Jindong Gu , Yong Yang , Shu-Tao Xia

Advanced Persistent Threats (APTs) have created new security challenges for critical infrastructures due to their stealthy, dynamic, and adaptive natures. In this work, we aim to lay a game-theoretic foundation by establishing a multi-stage…

计算机科学与博弈论 · 计算机科学 2018-09-10 Linan Huang , Quanyan Zhu

Despite their theoretical appealingness, Bayesian neural networks (BNNs) are left behind in real-world adoption, mainly due to persistent concerns on their scalability, accessibility, and reliability. In this work, we develop the…

机器学习 · 计算机科学 2022-10-14 Zhijie Deng , Jun Zhu

LLMs(Large Language Models) nowadays have widespread adoption as a tool for solving issues across various domain/tasks. These models since are susceptible to produce harmful or toxic results, inference-time adversarial attacks, therefore…

计算与语言 · 计算机科学 2024-10-01 Sachin Kumar

Deep models are highly susceptible to adversarial attacks. Such attacks are carefully crafted imperceptible noises that can fool the network and can cause severe consequences when deployed. To encounter them, the model requires training…

机器学习 · 计算机科学 2022-04-11 Gaurav Kumar Nayak , Ruchit Rawal , Anirban Chakraborty

Backdoor attacks represent a subtle yet effective class of cyberattacks targeting AI models, primarily due to their stealthy nature. The model behaves normally on clean data but exhibits malicious behavior only when the attacker embeds a…

机器学习 · 计算机科学 2025-09-29 Sujeevan Aseervatham , Achraf Kerzazi , Younès Bennani

Backdoor attacks represent one of the major threats to machine learning models. Various efforts have been made to mitigate backdoors. However, existing defenses have become increasingly complex and often require high computational resources…

密码学与安全 · 计算机科学 2022-12-20 Zeyang Sha , Xinlei He , Pascal Berrang , Mathias Humbert , Yang Zhang

Black-box finetuning is an emerging interface for adapting state-of-the-art language models to user needs. However, such access may also let malicious actors undermine model safety. To demonstrate the challenge of defending finetuning…

密码学与安全 · 计算机科学 2024-07-01 Danny Halawi , Alexander Wei , Eric Wallace , Tony T. Wang , Nika Haghtalab , Jacob Steinhardt

Data poisoning is a threat model in which a malicious actor tampers with training data to manipulate outcomes at inference time. A variety of defenses against this threat model have been proposed, but each suffers from at least one of the…

机器学习 · 计算机科学 2022-02-21 Jonas Geiping , Liam Fowl , Gowthami Somepalli , Micah Goldblum , Michael Moeller , Tom Goldstein

Adversarial training is among the most effective strategies for defending deep neural networks against adversarial examples. A key limitation of existing adversarial training approaches lies in their reliance on a fixed perturbation budget,…

计算机视觉与模式识别 · 计算机科学 2025-12-05 Alan Mitkiy , James Smith , Myungseo wong , Hana Satou , Hiroshi Tanaka , Emily Johnson

Adversarial attacks present a significant security risk to image recognition tasks. Defending against these attacks in a real-life setting can be compared to the way antivirus software works, with a key consideration being how well the…

计算机视觉与模式识别 · 计算机科学 2024-03-14 Haibo Zhang , Zhihua Yao , Kouichi Sakurai

Deep neural networks can be fooled by adversarial attacks: adding carefully computed small adversarial perturbations to clean inputs can cause misclassification on state-of-the-art machine learning models. The reason is that neural networks…

机器学习 · 计算机科学 2021-09-14 Shixian Wen , Amanda Rios , Laurent Itti

Large language models (LLMs) are increasingly deployed in security-sensitive applications, where they must follow system- or developer-specified instructions that define the intended task behavior, while completing benign user requests.…

密码学与安全 · 计算机科学 2026-01-13 Shawn Li , Chenxiao Yu , Zhiyu Ni , Hao Li , Charith Peris , Chaowei Xiao , Yue Zhao