中文
相关论文

相关论文: Backdoor Cleaning without External Guidance in MLL…

200 篇论文

Backdoor attacks represent one of the major threats to machine learning models. Various efforts have been made to mitigate backdoors. However, existing defenses have become increasingly complex and often require high computational resources…

密码学与安全 · 计算机科学 2022-12-20 Zeyang Sha , Xinlei He , Pascal Berrang , Mathias Humbert , Yang Zhang

Large language models (LLMs) have made remarkable strides in complex reasoning tasks, but their safety and robustness in reasoning processes remain underexplored. Existing attacks on LLM reasoning are constrained by specific settings or…

人工智能 · 计算机科学 2025-06-17 Jingyu Peng , Maolin Wang , Xiangyu Zhao , Kai Zhang , Wanyu Wang , Pengyue Jia , Qidong Liu , Ruocheng Guo , Qi Liu

Multimodal Large Language Models (MLLMs) have achieved remarkable progress in multimodal reasoning. However, they often excessively rely on textual information during the later stages of inference, neglecting the crucial integration of…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Shuo Yang , Yuwei Niu , Yuyang Liu , Yang Ye , Bin Lin , Li Yuan

Backdoors are hidden behaviors that are only triggered once an AI system has been deployed. Bad actors looking to create successful backdoors must design them to avoid activation during training and evaluation. Since data used in these…

密码学与安全 · 计算机科学 2024-12-25 Sara Price , Arjun Panickssery , Sam Bowman , Asa Cooper Stickland

Safety-aligned large language models (LLMs) are increasingly deployed in real-world pipelines, yet this deployment also enlarges the supply-chain attack surface: adversaries can distribute backdoored checkpoints that behave normally under…

密码学与安全 · 计算机科学 2026-04-15 Rui Yin , Tianxu Han , Naen Xu , Changjiang Li , Ping He , Chunyi Zhou , Jun Wang , Zhihui Fu , Tianyu Du , Jinbao Li , Shouling Ji

Large Language Models (LLMs) have transformed code completion tasks, providing context-based suggestions to boost developer productivity in software engineering. As users often fine-tune these models for specific applications, poisoning and…

密码学与安全 · 计算机科学 2024-06-12 Shenao Yan , Shen Wang , Yue Duan , Hanbin Hong , Kiho Lee , Doowon Kim , Yuan Hong

Large language models (LLMs) are becoming a popular tool as they have significantly advanced in their capability to tackle a wide range of language-based tasks. However, LLMs applications are highly vulnerable to prompt injection attacks,…

计算与语言 · 计算机科学 2024-11-11 Md Abdur Rahman , Fan Wu , Alfredo Cuzzocrea , Sheikh Iqbal Ahamed

LLM-based agents are increasingly used to simulate deliberative interactions such as negotiation, conflict resolution, and multi-turn opinion exchange. Yet generated transcripts often do not reveal why an agent's stance changes: movement…

人工智能 · 计算机科学 2026-05-18 Joshua C. Yang , Maurice Flechtner , Damian Dailisan , Michiel A. Bakker

Finetuning open-weight Large Language Models (LLMs) is standard practice for achieving task-specific performance improvements. Until now, finetuning has been regarded as a controlled and secure process in which training on benign datasets…

机器学习 · 计算机科学 2025-10-10 Thibaud Gloaguen , Mark Vero , Robin Staab , Martin Vechev

Backdoor attacks pose a significant threat to the integrity and reliability of Artificial Intelligence (AI) models, enabling adversaries to manipulate model behavior by injecting poisoned data with hidden triggers. These attacks can lead to…

机器学习 · 计算机科学 2026-03-31 Osama Wehbi , Sarhad Arisdakessian , Omar Abdel Wahab , Azzam Mourad , Hadi Otrok , Jamal Bentahar

Defending backdoor attacks in Federated Learning (FL) under heterogeneous client data distributions encounters limitations balancing effectiveness and privacy-preserving, while most existing methods highly rely on the assumption of…

机器学习 · 计算机科学 2025-10-14 Keke Gai , Dongjue Wang , Jing Yu , Liehuang Zhu , Qi Wu

Scanpath prediction models forecast the sequence and timing of human fixations during visual search, driving foveated rendering and attention-based interaction in mobile systems where their integrity is a first-class security concern. We…

密码学与安全 · 计算机科学 2026-04-13 Diana Romero , Mutahar Ali , Momin Ahmad Khan , Habiba Farrukh , Fatima Anwar , Salma Elmalaki

Safety alignment mechanisms in Large Language Models (LLMs) often operate as latent internal states, obscuring the model's inherent capabilities. Building on this observation, we model the safety mechanism as an unobserved confounder from a…

计算与语言 · 计算机科学 2026-02-09 Yao Zhou , Zeen Song , Wenwen Qiang , Fengge Wu , Shuyi Zhou , Changwen Zheng , Hui Xiong

Machine learning models are increasingly present in our everyday lives; as a result, they become targets of adversarial attackers seeking to manipulate the systems we interact with. A well-known vulnerability is a backdoor introduced into a…

机器学习 · 计算机科学 2026-02-12 Enrico Ahlers , Daniel Passon , Yannic Noller , Lars Grunske

Large Language Models (LLMs) have demonstrated remarkable capabilities in challenging, knowledge-intensive reasoning tasks. However, extending LLMs to perceive and reason over a new modality (e.g., vision), often requires costly development…

计算与语言 · 计算机科学 2025-11-25 James Y. Huang , Sheng Zhang , Qianchu Liu , Guanghui Qin , Tinghui Zhu , Tristan Naumann , Muhao Chen , Hoifung Poon

Recent studies have revealed a security threat to natural language processing (NLP) models, called the Backdoor Attack. Victim models can maintain competitive performance on clean samples while behaving abnormally on samples with a specific…

计算与语言 · 计算机科学 2021-03-30 Wenkai Yang , Lei Li , Zhiyuan Zhang , Xuancheng Ren , Xu Sun , Bin He

The deployment of Large Language Models (LLMs) in diverse applications necessitates an assurance of safety without compromising the contextual integrity of the generated content. Traditional approaches, including safety-specific fine-tuning…

计算与语言 · 计算机科学 2024-07-01 Shaina Raza , Ananya Raval , Veronica Chatrath

Large Language Models (LLMs) are known to be vulnerable to backdoor attacks, where triggers embedded in poisoned samples can maliciously alter LLMs' behaviors. In this paper, we move beyond attacking LLMs and instead examine backdoor…

密码学与安全 · 计算机科学 2025-02-18 Huaizhi Ge , Yiming Li , Qifan Wang , Yongfeng Zhang , Ruixiang Tang

While pre-trained Vision-Language Models (VLMs) such as CLIP exhibit impressive representational capabilities for multimodal data, recent studies have revealed their vulnerability to backdoor attacks. To alleviate the threat, existing…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Jiawei Kong , Hao Fang , Sihang Guo , Chenxi Qing , Kuofeng Gao , Bin Chen , Shu-Tao Xia , Ke Xu

Feature discovery from complex unstructured data is fundamentally a reasoning problem: it requires identifying abstractions that are predictive of a target outcome while avoiding leakage, proxies, and post-outcome signals. With the…