English
Related papers

Related papers: When Backdoors Speak: Understanding LLM Backdoor A…

200 papers

The self-rationalising capabilities of large language models (LLMs) have been explored in restricted settings, using task/specific data sets. However, current LLMs do not (only) rely on specifically annotated data; nonetheless, they…

Computation and Language · Computer Science 2024-12-18 Jenny Kunz , Marco Kuhlmann

Large language models (LLMs) are susceptible to a type of attack known as jailbreaking, which misleads LLMs to output harmful contents. Although there are diverse jailbreak attack strategies, there is no unified understanding on why some…

Computation and Language · Computer Science 2024-12-04 Yuping Lin , Pengfei He , Han Xu , Yue Xing , Makoto Yamada , Hui Liu , Jiliang Tang

Large Language Models (LLMs) have demonstrated remarkable capabilities in generating coherent text but remain limited by the static nature of their training data. Retrieval Augmented Generation (RAG) addresses this issue by combining LLMs…

Cryptography and Security · Computer Science 2024-10-21 Cody Clop , Yannick Teglia

The prevalence and strong capability of large language models (LLMs) present significant safety and ethical risks if exploited by malicious users. To prevent the potentially deceptive usage of LLMs, recent works have proposed algorithms to…

Computation and Language · Computer Science 2023-10-20 Zhouxing Shi , Yihan Wang , Fan Yin , Xiangning Chen , Kai-Wei Chang , Cho-Jui Hsieh

Explainable machine learning holds great potential for analyzing and understanding learning-based systems. These methods can, however, be manipulated to present unfaithful explanations, giving rise to powerful and stealthy adversaries. In…

Cryptography and Security · Computer Science 2022-04-21 Maximilian Noppel , Lukas Peter , Christian Wressnegger

We find that language models have difficulties generating fallacious and deceptive reasoning. When asked to generate deceptive outputs, language models tend to leak honest counterparts but believe them to be false. Exploiting this…

Computation and Language · Computer Science 2025-05-26 Yue Zhou , Henry Peng Zou , Barbara Di Eugenio , Yang Zhang

The growing dependence on machine learning in real-world applications emphasizes the importance of understanding and ensuring its safety. Backdoor attacks pose a significant security risk due to their stealthy nature and potentially serious…

Cryptography and Security · Computer Science 2023-10-19 Ganghua Wang , Xun Xian , Jayanth Srinivasa , Ashish Kundu , Xuan Bi , Mingyi Hong , Jie Ding

The proliferation of large language models (LLMs) has sparked widespread and general interest due to their strong language generation capabilities, offering great potential for both industry and research. While previous research delved into…

Artificial Intelligence · Computer Science 2024-07-09 Lukas Struppek , Minh Hieu Le , Dominik Hintersdorf , Kristian Kersting

Deep neural networks are vulnerable to backdoor attacks, a type of adversarial attack that poisons the training data to manipulate the behavior of models trained on such data. Clean-label attacks are a more stealthy form of backdoor attacks…

Machine Learning · Computer Science 2024-07-17 Quang H. Nguyen , Nguyen Ngoc-Hieu , The-Anh Ta , Thanh Nguyen-Tang , Kok-Seng Wong , Hoang Thanh-Tung , Khoa D. Doan

Large language models (LLMs) undergo alignment training to avoid harmful behaviors, yet the resulting safeguards remain brittle: jailbreaks routinely bypass them, and fine-tuning on narrow domains can induce ``emergent misalignment'' that…

Computation and Language · Computer Science 2026-04-13 Hadas Orgad , Boyi Wei , Kaden Zheng , Martin Wattenberg , Peter Henderson , Seraphina Goldfarb-Tarrant , Yonatan Belinkov

Large language models (LLMs) have gained human trust due to their capabilities and helpfulness. However, this in turn may allow LLMs to affect users' mindsets by manipulating language. It is termed as gaslighting, a psychological effect. In…

Cryptography and Security · Computer Science 2024-10-15 Wei Li , Luyao Zhu , Yang Song , Ruixi Lin , Rui Mao , Yang You

Multi-modal large language models (MLLMs) extend large language models (LLMs) to process multi-modal information, enabling them to generate responses to image-text inputs. MLLMs have been incorporated into diverse multi-modal applications,…

Cryptography and Security · Computer Science 2025-03-21 Zenghui Yuan , Jiawen Shi , Pan Zhou , Neil Zhenqiang Gong , Lichao Sun

Despite their growing adoption across domains, large language model (LLM)-powered agents face significant security risks from backdoor attacks during training and fine-tuning. These compromised agents can subsequently be manipulated to…

Cryptography and Security · Computer Science 2025-06-12 Li Changjiang , Liang Jiacheng , Cao Bochuan , Chen Jinghui , Wang Ting

Although many large language models (LLMs) have been trained to refuse harmful requests, they are still vulnerable to jailbreaking attacks which rewrite the original prompt to conceal its harmful intent. In this paper, we propose a new…

Computation and Language · Computer Science 2024-06-10 Yihan Wang , Zhouxing Shi , Andrew Bai , Cho-Jui Hsieh

In the field of natural language processing, the prevalent approach involves fine-tuning pretrained language models (PLMs) using local samples. Recent research has exposed the susceptibility of PLMs to backdoor attacks, wherein the…

Machine Learning · Computer Science 2023-10-31 Ruixiang Tang , Jiayi Yuan , Yiming Li , Zirui Liu , Rui Chen , Xia Hu

The rapid development of large language models (LLMs) has not only provided numerous opportunities but also presented significant challenges. This becomes particularly evident when LLMs inadvertently generate harmful or toxic content,…

Computation and Language · Computer Science 2024-02-20 Kai Chen , Chunwei Wang , Kuo Yang , Jianhua Han , Lanqing Hong , Fei Mi , Hang Xu , Zhengying Liu , Wenyong Huang , Zhenguo Li , Dit-Yan Yeung , Lifeng Shang , Xin Jiang , Qun Liu

Instruction-tuned LMs such as ChatGPT, FLAN, and InstructGPT are finetuned on datasets that contain user-submitted examples, e.g., FLAN aggregates numerous open-source datasets and OpenAI leverages examples submitted in the browser…

Computation and Language · Computer Science 2023-05-02 Alexander Wan , Eric Wallace , Sheng Shen , Dan Klein

Large language models (LLMs) possess strong semantic understanding, driving significant progress in data mining applications. This is further enhanced by large reasoning models (LRMs), which provide explicit multi-step reasoning traces. On…

Machine Learning · Computer Science 2026-04-07 Aobo Chen , Chenxu Zhao , Chenglin Miao , Mengdi Huai

Large Language Models (LLMs) suffer from a range of vulnerabilities that allow malicious users to solicit undesirable responses through manipulation of the input text. These so-called jailbreak prompts are designed to trick the LLM into…

Computation and Language · Computer Science 2025-10-13 John Hawkins , Aditya Pramar , Rodney Beard , Rohitash Chandra

Vision Language Models (VLMs) have shown remarkable performance, but are also vulnerable to backdoor attacks whereby the adversary can manipulate the model's outputs through hidden triggers. Prior attacks primarily rely on single-modality…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Zhiyuan Zhong , Zhen Sun , Yepang Liu , Xinlei He , Guanhong Tao