English
Related papers

Related papers: Data Defenses Against Large Language Models

200 papers

As Large Language Models quickly become ubiquitous, it becomes critical to understand their security vulnerabilities. Recent work shows that text optimizers can produce jailbreaking prompts that bypass moderation and alignment. Drawing from…

Adversarial attacks on knowledge graph embeddings (KGE) aim to disrupt the model's ability of link prediction by removing or inserting triples. A recent black-box method has attempted to incorporate textual and structural information to…

Computation and Language · Computer Science 2025-10-15 Ting Li , Yang Yang , Yipeng Yu , Liang Yao , Guoqing Chao , Ruifeng Xu

Graph data contains rich node features and unique edge information, which have been applied across various domains, such as citation networks or recommendation systems. Graph Neural Networks (GNNs) are specialized for handling such data and…

Machine Learning · Computer Science 2024-06-26 Faqian Guan , Tianqing Zhu , Hui Sun , Wanlei Zhou , Philip S. Yu

The spread of fake news has emerged as a critical challenge, undermining trust and posing threats to society. In the era of Large Language Models (LLMs), the capability to generate believable fake content has intensified these concerns. In…

Computation and Language · Computer Science 2023-09-19 Jinyan Su , Terry Yue Zhuo , Jonibek Mansurov , Di Wang , Preslav Nakov

Jailbreak attacks in large language models (LLMs) entail inducing the models to generate content that breaches ethical and legal norm through the use of malicious prompts, posing a substantial threat to LLM security. Current strategies for…

Cryptography and Security · Computer Science 2024-06-07 Lin Lu , Hai Yan , Zenghui Yuan , Jiawen Shi , Wenqi Wei , Pin-Yu Chen , Pan Zhou

With the boom of Large Language Models (LLMs), the research of solving Math Word Problem (MWP) has recently made great progress. However, there are few studies to examine the security of LLMs in math solving ability. Instead of attacking…

Computation and Language · Computer Science 2023-09-06 Zihao Zhou , Qiufeng Wang , Mingyu Jin , Jie Yao , Jianan Ye , Wei Liu , Wei Wang , Xiaowei Huang , Kaizhu Huang

The ability of large language models to generate complex texts allows them to be widely integrated into many aspects of life, and their output can quickly fill all network resources. As the impact of LLMs grows, it becomes increasingly…

Computation and Language · Computer Science 2024-11-12 Yongye Su , Yuqing Wu

Large language models (LLMs) are inherently vulnerable to unintended privacy breaches. Consequently, systematic red-teaming research is essential for developing robust defense mechanisms. However, current data extraction methods suffer from…

Machine Learning · Computer Science 2025-05-13 Zhiqiang Wang , Ruoxi Cheng

Large Language Models (LLMs) are increasingly vulnerable to adversarial attacks that can subtly manipulate their outputs. While various defense mechanisms have been proposed, many operate as black boxes, lacking transparency in their…

Cryptography and Security · Computer Science 2025-11-19 Shaowei Guan , Yu Zhai , Zhengyu Zhang , Yanze Wang , Hin Chi Kwok

Large language models (LLMs) are sophisticated artificial intelligence systems that enable machines to generate human-like text with remarkable precision. While LLMs offer significant technological progress, their development using vast…

Cryptography and Security · Computer Science 2025-06-23 Yashothara Shanmugarasa , Ming Ding , M. A. P Chamikara , Thierry Rakotoarivelo

Large language models (LLMs) and LLM-based agents have been widely deployed in a wide range of applications in the real world, including healthcare diagnostics, financial analysis, customer support, robotics, and autonomous driving,…

Cryptography and Security · Computer Science 2025-05-20 Wenrui Xu , Keshab K. Parhi

Extensive efforts have been made before the public release of Large language models (LLMs) to align their behaviors with human values. However, even meticulously aligned LLMs remain vulnerable to malicious manipulations such as…

Cryptography and Security · Computer Science 2024-10-01 Zeguan Xiao , Yan Yang , Guanhua Chen , Yun Chen

Large language models (LLMs) have significantly transformed the landscape of Natural Language Processing (NLP). Their impact extends across a diverse spectrum of tasks, revolutionizing how we approach language understanding and generations.…

Cryptography and Security · Computer Science 2025-06-13 Sara Abdali , Richard Anarfi , CJ Barberan , Jia He , Erfan Shayegani

Large Language Models (LLMs) are increasingly attracting attention in various applications. Nonetheless, there is a growing concern as some users attempt to exploit these models for malicious purposes, including the synthesis of controlled…

Artificial Intelligence · Computer Science 2025-08-26 Chongwen Zhao , Zhihao Dou , Kaizhu Huang

The integration of Large Language Models (LLMs) into robotics has revolutionized their ability to interpret complex human commands and execute sophisticated tasks. However, such paradigm shift introduces critical security vulnerabilities…

Large Language Models (LLMs) have greatly advanced Natural Language Processing (NLP), particularly through instruction tuning, which enables broad task generalization without additional fine-tuning. However, their reliance on large-scale…

Computation and Language · Computer Science 2026-04-21 San Kim , Gary Geunbae Lee

Large Language Models (LLMs) are increasingly integrated into daily routines, yet they raise significant privacy and safety concerns. Recent research proposes collaborative inference, which outsources the early-layer inference to ensure…

Cryptography and Security · Computer Science 2025-07-23 Tian Dong , Yan Meng , Shaofeng Li , Guoxing Chen , Zhen Liu , Haojin Zhu

While (multimodal) large language models (LLMs) have attracted widespread attention due to their exceptional capabilities, they remain vulnerable to jailbreak attacks. Various defense methods are proposed to defend against jailbreak…

Cryptography and Security · Computer Science 2025-05-29 Yongcan Yu , Yanbo Wang , Ran He , Jian Liang

Recent studies reveal that Large Language Models (LLMs) face challenges in balancing safety with utility, particularly when processing long texts for NLP tasks like summarization and translation. Despite defenses against malicious short…

Computation and Language · Computer Science 2024-05-27 Yu Fu , Wen Xiao , Jia Chen , Jiachen Li , Evangelos Papalexakis , Aichi Chien , Yue Dong

Customizing Large Language Models (LLMs) on untrusted datasets poses severe risks of injecting toxic behaviors. In this work, we introduce Optimus, a novel defense framework designed to mitigate fine-tuning harms while preserving…