English
Related papers

Related papers: Concept-ROT: Poisoning Concepts in Large Language …

200 papers

Large language models (LLMs) exhibit impressive language capabilities but remain vulnerable to malicious prompts and jailbreaking attacks. Existing knowledge editing methods for LLM detoxification face two major challenges. First, they…

Computation and Language · Computer Science 2025-05-29 Yifan Lu , Jing Li , Yigeng Zhou , Yihui Zhang , Wenya Wang , Xiucheng Li , Meishan Zhang , Fangming Liu , Jun Yu , Min Zhang

The open-endedness of large language models (LLMs) combined with their impressive capabilities may lead to new safety issues when being exploited for malicious use. While recent studies primarily focus on probing toxic outputs that can be…

Computation and Language · Computer Science 2023-11-30 Jiaxin Wen , Pei Ke , Hao Sun , Zhexin Zhang , Chengfei Li , Jinfeng Bai , Minlie Huang

Deep neural networks are vulnerable to adversarial attacks, such as backdoor attacks in which a malicious adversary compromises a model during training such that specific behaviour can be triggered at test time by attaching a specific word…

Cryptography and Security · Computer Science 2022-10-21 You Guo , Jun Wang , Trevor Cohn

Large language models (LLMs) are often fine-tuned on uncurated text datasets that adversaries can poison. Existing poisoning attacks primarily rely on fixed trigger phrases that defenses such as outlier detection, clean-data regularization,…

Cryptography and Security · Computer Science 2026-05-27 Zedian Shao , Charles Fleming , Teodora Baluta

Deep neural networks are vulnerable to adversarial attacks, where a small perturbation to an input alters the model prediction. In many cases, malicious inputs intentionally crafted for one model can fool another model. In this paper, we…

Machine Learning · Computer Science 2021-09-23 Liping Yuan , Xiaoqing Zheng , Yi Zhou , Cho-Jui Hsieh , Kai-wei Chang

Robots need task planning methods to achieve goals that require more than individual actions. Recently, large language models (LLMs) have demonstrated impressive performance in task planning. LLMs can generate a step-by-step solution using…

Large Language Models (LLMs) are widely deployed in diverse real-world settings, yet remain vulnerable to jailbreaking, where prompt-based attacks bypass safety filters. We present THREAT (Targeted Harmful generation via Reframing and…

Cryptography and Security · Computer Science 2026-05-22 Shahnewaz Karim Sakib , Swati Kar , Anindya Bijoy Das

Recent advancements in Artificial Intelligence namely in Deep Learning has heightened its adoption in many applications. Some are playing important roles to the extent that we are heavily dependent on them for our livelihood. However, as…

Cryptography and Security · Computer Science 2020-08-05 Jonathan Pan

Recent advances in Chain-of-Thought (CoT) prompting have substantially improved the reasoning capabilities of large language models (LLMs), but have also introduced their computational efficiency as a new attack surface. In this paper, we…

Cryptography and Security · Computer Science 2025-11-17 Shuaitong Liu , Renjue Li , Lijia Yu , Lijun Zhang , Zhiming Liu , Gaojie Jin

Recent studies have shown that Large Language Models (LLMs) are vulnerable to data poisoning attacks, where malicious training examples embed hidden behaviours triggered by specific input patterns. However, most existing works assume a…

Computation and Language · Computer Science 2025-10-10 Sanhanat Sivapiromrat , Caiqi Zhang , Marco Basaldella , Nigel Collier

Despite the ability to train capable LLMs, the methodology for maintaining their relevancy and rectifying errors remains elusive. To this end, the past few years have witnessed a surge in techniques for editing LLMs, the objective of which…

Computation and Language · Computer Science 2023-12-01 Yunzhi Yao , Peng Wang , Bozhong Tian , Siyuan Cheng , Zhoubo Li , Shumin Deng , Huajun Chen , Ningyu Zhang

Large language models (LLMs) are susceptible to social-engineered attacks that are human-interpretable but require a high level of comprehension for LLMs to counteract. Existing defensive measures can only mitigate less than half of these…

Computation and Language · Computer Science 2025-05-01 Canaan Yung , Hadi Mohaghegh Dolatabadi , Sarah Erfani , Christopher Leckie

Reasoning-enhanced large language models (LLMs) explicitly generate intermediate reasoning steps prior to generating final answers, helping the model excel in complex problem-solving. In this paper, we demonstrate that this emerging…

Machine Learning · Computer Science 2025-05-22 Tong Wu , Chong Xiang , Jiachen T. Wang , G. Edward Suh , Prateek Mittal

This paper investigates using knowledge editing techniques to detoxify Large Language Models (LLMs). We construct a benchmark, SafeEdit, which covers nine unsafe categories with various powerful attack prompts and equips comprehensive…

Computation and Language · Computer Science 2024-05-29 Mengru Wang , Ningyu Zhang , Ziwen Xu , Zekun Xi , Shumin Deng , Yunzhi Yao , Qishen Zhang , Linyi Yang , Jindong Wang , Huajun Chen

Autoregressive Visual Language Models (VLMs) showcase impressive few-shot learning capabilities in a multimodal context. Recently, multimodal instruction tuning has been proposed to further enhance instruction-following abilities. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jiawei Liang , Siyuan Liang , Man Luo , Aishan Liu , Dongchen Han , Ee-Chien Chang , Xiaochun Cao

Pretrained neural language models (LMs) are prone to generating racist, sexist, or otherwise toxic language which hinders their safe deployment. We investigate the extent to which pretrained LMs can be prompted to generate toxic language,…

Computation and Language · Computer Science 2020-09-29 Samuel Gehman , Suchin Gururangan , Maarten Sap , Yejin Choi , Noah A. Smith

Backdoor attack against image classification task has been widely studied and proven to be successful, while there exist little research on the backdoor attack against vision-language models. In this paper, we explore backdoor attack…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Meiling Li , Nan Zhong , Xinpeng Zhang , Zhenxing Qian , Sheng Li

Large Language Models (LLMs) possess the potential to exert substantial influence on public perceptions and interactions with information. This raises concerns about the societal impact that could arise if the ideologies within these models…

Computation and Language · Computer Science 2024-06-19 Kai Chen , Zihao He , Jun Yan , Taiwei Shi , Kristina Lerman

Large Language Models (LLMs) are increasingly being integrated into the scientific peer-review process, raising new questions about their reliability and resilience to manipulation. In this work, we investigate the potential for hidden…

Cryptography and Security · Computer Science 2026-03-31 Matteo Gioele Collu , Umberto Salviati , Roberto Confalonieri , Mauro Conti , Giovanni Apruzzese

Large Language Models (LLMs) have demonstrated great potential as generalist assistants, showcasing powerful task understanding and problem-solving capabilities. To deploy LLMs as AI assistants, it is crucial that these models exhibit…

Artificial Intelligence · Computer Science 2025-02-12 Huanqian Wang , Yang Yue , Rui Lu , Jingxin Shi , Andrew Zhao , Shenzhi Wang , Shiji Song , Gao Huang
‹ Prev 1 3 4 5 6 7 10 Next ›