English
Related papers

Related papers: Can Sensitive Information Be Deleted From LLMs? Ob…

200 papers

Large language models (LLMs) are increasingly deployed in settings where inducing a bias toward a certain topic can have significant consequences, and backdoor attacks can be used to produce such models. Prior work on backdoor attacks has…

Cryptography and Security · Computer Science 2026-02-17 Anudeep Das , Prach Chantasantitam , Gurjot Singh , Lipeng He , Mariia Ponomarenko , Florian Kerschbaum

As Large Language Models (LLMs) of Prompt Jailbreaking are getting more and more attention, it is of great significance to raise a generalized research paradigm to evaluate attack strengths and a basic model to conduct subtler experiments.…

Cryptography and Security · Computer Science 2024-04-15 Tianyu Zhang , Zixuan Zhao , Jiaqi Huang , Jingyu Hua , Sheng Zhong

The protection of cyber Intellectual Property (IP) such as web content is an increasingly critical concern. The rise of large language models (LLMs) with online retrieval capabilities enables convenient access to information but often…

Cryptography and Security · Computer Science 2025-06-09 Yisheng Zhong , Yizhu Wen , Junfeng Guo , Mehran Kafai , Heng Huang , Hanqing Guo , Zhuangdi Zhu

The open-endedness of large language models (LLMs) combined with their impressive capabilities may lead to new safety issues when being exploited for malicious use. While recent studies primarily focus on probing toxic outputs that can be…

Computation and Language · Computer Science 2023-11-30 Jiaxin Wen , Pei Ke , Hao Sun , Zhexin Zhang , Chengfei Li , Jinfeng Bai , Minlie Huang

This work considers a black-box threat model in which adversaries attempt to propagate arbitrary non-relevant content in search. We show that retrievers, rerankers, and LLM relevance judges are all highly vulnerable to attacks that enable…

Information Retrieval · Computer Science 2026-01-01 Manveer Singh Tamber , Jimmy Lin

Large language models (LLMs) are increasingly trained on massive, heterogeneous text corpora, raising serious concerns about the unauthorised use of proprietary or personal data during model training. In this work, we address the problem of…

Computation and Language · Computer Science 2026-01-08 Ruihan Zhang , Jun Sun

While Code Language Models (CLMs) have demonstrated superior performance in software engineering tasks such as code generation and summarization, recent empirical studies reveal a critical privacy vulnerability: these models exhibit…

Software Engineering · Computer Science 2025-09-18 Zhaoyang Chu , Yao Wan , Zhikun Zhang , Di Wang , Zhou Yang , Hongyu Zhang , Pan Zhou , Xuanhua Shi , Hai Jin , David Lo

Large Language Models (LLMs) memorize, and thus, among huge amounts of uncontrolled data, may memorize Personally Identifiable Information (PII), which should not be stored and, consequently, not leaked. In this paper, we introduce Private…

Cryptography and Security · Computer Science 2025-08-22 Elena Sofia Ruzzetti , Giancarlo A. Xompero , Davide Venditti , Fabio Massimo Zanzotto

Recent attacks on Machine Learning (ML) models such as evasion attacks with adversarial examples and models stealing through extraction attacks pose several security and privacy threats. Prior work proposes to use adversarial training to…

Machine Learning · Computer Science 2022-08-23 Kacem Khaled , Gabriela Nicolescu , Felipe Gohring de Magalhães

Ensuring the security of large language models (LLMs) is an ongoing challenge despite their widespread popularity. Developers work to enhance LLMs security, but vulnerabilities persist, even in advanced versions like GPT-4. Attackers…

Cryptography and Security · Computer Science 2023-12-19 Aysan Esmradi , Daniel Wankit Yip , Chun Fai Chan

Large Language Models (LLMs) are known to be vulnerable to backdoor attacks, where triggers embedded in poisoned samples can maliciously alter LLMs' behaviors. In this paper, we move beyond attacking LLMs and instead examine backdoor…

Cryptography and Security · Computer Science 2025-02-18 Huaizhi Ge , Yiming Li , Qifan Wang , Yongfeng Zhang , Ruixiang Tang

The prevalence and strong capability of large language models (LLMs) present significant safety and ethical risks if exploited by malicious users. To prevent the potentially deceptive usage of LLMs, recent works have proposed algorithms to…

Computation and Language · Computer Science 2023-10-20 Zhouxing Shi , Yihan Wang , Fan Yin , Xiangning Chen , Kai-Wei Chang , Cho-Jui Hsieh

Large Language Models (LLMs) have been widely adopted to enhance Task-Oriented Dialogue Systems (TODS) by modeling complex language patterns and delivering contextually appropriate responses. However, this integration introduces significant…

Computation and Language · Computer Science 2026-03-05 Shuo Zhang , Junzhou Zhao , Junji Hou , Pinghui Wang , Chenxu Wang , Jing Tao

Deep neural networks are vulnerable to adversarial attacks, such as backdoor attacks in which a malicious adversary compromises a model during training such that specific behaviour can be triggered at test time by attaching a specific word…

Cryptography and Security · Computer Science 2022-10-21 You Guo , Jun Wang , Trevor Cohn

Large language models (LLMs) have significantly transformed the landscape of Natural Language Processing (NLP). Their impact extends across a diverse spectrum of tasks, revolutionizing how we approach language understanding and generations.…

Cryptography and Security · Computer Science 2025-06-13 Sara Abdali , Richard Anarfi , CJ Barberan , Jia He , Erfan Shayegani

As large language models (LLMs) become an important way of information access, there have been increasing concerns that LLMs may intensify the spread of unethical content, including implicit bias that hurts certain populations without…

Computation and Language · Computer Science 2025-07-14 Yuchen Wen , Keping Bi , Wei Chen , Jiafeng Guo , Xueqi Cheng

Large Language Models (LLMs) presents significant priority in text understanding and generation. However, LLMs suffer from the risk of generating harmful contents especially while being employed to applications. There are several black-box…

Computation and Language · Computer Science 2023-12-11 Chengyuan Liu , Fubang Zhao , Lizhi Qing , Yangyang Kang , Changlong Sun , Kun Kuang , Fei Wu

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

Large language models (LLMs) are complex artificial intelligence systems capable of understanding, generating and translating human language. They learn language patterns by analyzing large amounts of text data, allowing them to perform…

Cryptography and Security · Computer Science 2024-03-15 Biwei Yan , Kun Li , Minghui Xu , Yueyan Dong , Yue Zhang , Zhaochun Ren , Xiuzhen Cheng

Although large language models (LLMs) demonstrate impressive proficiency in various tasks, they present potential safety risks, such as `jailbreaks', where malicious inputs can coerce LLMs into generating harmful content bypassing safety…

Computation and Language · Computer Science 2025-11-26 Isack Lee , Haebin Seong