English
Related papers

Related papers: Understanding and Mitigating Over-refusal for Larg…

200 papers

Large Language Models (LLMs) have become central to numerous natural language processing tasks, but their vulnerabilities present significant security and ethical challenges. This systematic survey explores the evolving landscape of attack…

Cryptography and Security · Computer Science 2025-05-05 Zhiyu Liao , Kang Chen , Yuanguo Lin , Kangkang Li , Yunxuan Liu , Hefeng Chen , Xingwang Huang , Yuanhui Yu

Current safety alignment techniques for large language models (LLMs) face two key challenges: (1) under-generalization, which leaves models vulnerable to novel jailbreak attacks, and (2) over-alignment, which leads to the excessive refusal…

Computation and Language · Computer Science 2025-04-15 Yutao Mou , Yuxiao Luo , Shikun Zhang , Wei Ye

Recent advancements in Large Language Models (LLMs) have showcased remarkable capabilities across various tasks in different domains. However, the emergence of biases and the potential for generating harmful content in LLMs, particularly…

Cryptography and Security · Computer Science 2024-07-25 Zhuowen Yuan , Zidi Xiong , Yi Zeng , Ning Yu , Ruoxi Jia , Dawn Song , Bo Li

Large language models (LLMs) are vulnerable when trained on datasets containing harmful content, which leads to potential jailbreaking attacks in two scenarios: the integration of harmful texts within crowdsourced data used for pre-training…

Cryptography and Security · Computer Science 2024-06-03 Xiaoqun Liu , Jiacheng Liang , Muchao Ye , Zhaohan Xi

Despite the exceptional performance of multi-modal large language models (MLLMs), their deployment requires substantial computational resources. Once malicious users induce high energy consumption and latency time (energy-latency cost), it…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Kuofeng Gao , Jindong Gu , Yang Bai , Shu-Tao Xia , Philip Torr , Wei Liu , Zhifeng Li

Oversampling is one of the most widely used approaches for addressing imbalanced classification. The core idea is to generate additional minority samples to rebalance the dataset. Most existing methods, such as SMOTE, require converting…

Machine Learning · Computer Science 2025-10-14 Dang Nguyen , Sunil Gupta , Kien Do , Thin Nguyen , Taylor Braund , Alexis Whitton , Svetha Venkatesh

Despite the rapid development of safety alignment techniques for LLMs, defending against multi-turn jailbreaks is still a challenging task. In this paper, we conduct a comprehensive comparison, revealing that some existing defense methods…

Cryptography and Security · Computer Science 2025-12-29 Xiaoya Lu , Dongrui Liu , Yi Yu , Luxin Xu , Jing Shao

While large language models (LLMs) have increasingly been applied to hate speech detoxification, the prompts often trigger safety alerts, causing LLMs to refuse the task. In this study, we systematically investigate false refusal behavior…

Computation and Language · Computer Science 2026-01-14 Kyuri Im , Shuzhou Yuan , Michael Färber

With the widespread real-world deployment of large language models (LLMs), ensuring their behavior complies with safety standards has become crucial. Jailbreak attacks exploit vulnerabilities in LLMs to induce undesirable behavior, posing a…

Computation and Language · Computer Science 2025-05-26 Jiaqi Wu , Chen Chen , Chunyan Hou , Xiaojie Yuan

Safety alignment of large language models currently faces a central challenge: existing alignment techniques often prioritize mitigating responses to harmful prompts at the expense of overcautious behavior, leading models to incorrectly…

Large language models (LLMs) have transformed the way we access information. These models are often tuned to refuse to comply with requests that are considered harmful and to produce responses that better align with the preferences of those…

Computation and Language · Computer Science 2025-08-12 Hannah Cyberey , David Evans

Rapid advances in the capabilities of large language models (LLMs) have raised widespread concerns regarding their potential for malicious use. Open-weight LLMs present unique challenges, as existing safeguards lack robustness to tampering…

Large Language Models (LLMs) have emerged as a promising cornerstone for the development of natural language processing (NLP) and artificial intelligence (AI). However, ensuring the robustness of LLMs remains a critical challenge. To…

Computation and Language · Computer Science 2025-11-07 Pankaj Kumar , Subhankar Mishra

The focus on safety alignment in large language models (LLMs) has increased significantly due to their widespread adoption across different domains. The scale of LLMs play a contributing role in their success, and the growth in parameter…

Artificial Intelligence · Computer Science 2025-07-29 Rachel S. Y. Teo , Laziz U. Abdullaev , Tan M. Nguyen

Large language models (LLMs) are vital for a wide range of applications yet remain susceptible to jailbreak threats, which could lead to the generation of inappropriate responses. Conventional defenses, such as refusal and adversarial…

Cryptography and Security · Computer Science 2026-01-29 Xianglin Yang , Gelei Deng , Jieming Shi , Tianwei Zhang , Jin Song Dong

Multimodal Large Language Models (MLLMs) are widely used in various fields due to their powerful cross-modal comprehension and generation capabilities. However, more modalities bring more vulnerabilities to being utilized for jailbreak…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Shiji Zhao , Shukun Xiong , Yao Huang , Yan Jin , Zhenyu Wu , Jiyang Guan , Ranjie Duan , Jialing Tao , Hui Xue , Xingxing Wei

Despite their outstanding performance, large language models (LLMs) suffer notorious flaws related to their preference for simple, surface-level textual relations over full semantic complexity of the problem. This proposal investigates a…

Computation and Language · Computer Science 2022-06-20 Michal Štefánik

Safety-aligned LLMs suffer from two failure modes: jailbreak (answering harmful inputs) and over-refusal (declining benign queries). Existing vector steering methods adjust the magnitude of answer vectors, but this creates a fundamental…

Machine Learning · Computer Science 2026-05-05 Haonan Zhang , Dongxia Wang , Yi Liu , Kexin Chen , Wenhai Wang

The safety mechanisms of large language models (LLMs) exhibit notable fragility, as even fine-tuning on datasets without harmful content may still undermine their safety capabilities. Meanwhile, existing safety alignment methods…

Computers and Society · Computer Science 2026-02-03 Guanghao Zhou , Panjia Qiu , Cen Chen , Hongyu Li , Mingyuan Chu , Xin Zhang , Jun Zhou

As large language models (LLMs) are increasingly deployed in risk-sensitive applications such as real-world open-ended question answering (QA), ensuring the trustworthiness of their outputs has become critical. Existing selective conformal…

Artificial Intelligence · Computer Science 2026-02-17 Qingni Wang , Yue Fan , Xin Eric Wang