English

Backdoor Collapse: Eliminating Unknown Threats via Known Backdoor Aggregation in Language Models

Computation and Language 2026-05-14 v2

Abstract

Backdoor attacks are a significant threat to large language models (LLMs), often embedded via public checkpoints, yet existing defenses rely on impractical assumptions about trigger settings. To address this challenge, we propose \ourmethod, a defense framework that requires no prior knowledge of trigger settings. \ourmethod is based on the key observation that when deliberately injecting known backdoors into an already-compromised model, both existing unknown and newly injected backdoors aggregate in the representation space. \ourmethod leverages this through a two-stage process: \textbf{first}, aggregating backdoor representations by injecting known triggers, and \textbf{then}, performing recovery fine-tuning to restore benign outputs. Extensive experiments across multiple LLM architectures demonstrate that: (I) \ourmethod reduces the average Attack Success Rate to 4.41\% across multiple benchmarks, outperforming existing baselines by 28.1\%\sim69.3\%\uparrow. (II) Clean accuracy and utility are preserved within 0.5\% of the original model, ensuring negligible impact on legitimate tasks. (III) The defense generalizes across different types of backdoors, confirming its robustness in practical deployment scenarios.

Keywords

Cite

@article{arxiv.2510.10265,
  title  = {Backdoor Collapse: Eliminating Unknown Threats via Known Backdoor Aggregation in Language Models},
  author = {Liang Lin and Miao Yu and Moayad Aloqaily and Zhenhong Zhou and Kun Wang and Linsey Pang and Prakhar Mehrotra and Qingsong Wen},
  journal= {arXiv preprint arXiv:2510.10265},
  year   = {2026}
}
R2 v1 2026-07-01T06:31:32.310Z