English
Related papers

Related papers: Beyond Over-Refusal: Scenario-Based Diagnostics an…

200 papers

Solving complex or long-horizon problems often requires large language models (LLMs) to use external tools and operate over a significantly longer context window. New LLMs enable longer context windows and support tool calling capabilities.…

Machine Learning · Computer Science 2025-12-03 Tsimur Hadeliya , Mohammad Ali Jauhar , Nidhi Sakpal , Diogo Cruz

Without proper safeguards, large language models will readily follow malicious instructions and generate toxic content. This risk motivates safety efforts such as red-teaming and large-scale feedback learning, which aim to make models both…

Computation and Language · Computer Science 2024-04-02 Paul Röttger , Hannah Rose Kirk , Bertie Vidgen , Giuseppe Attanasio , Federico Bianchi , Dirk Hovy

The increasing integration of large language models (LLMs) into mental health applications necessitates robust frameworks for evaluating professional safety alignment. Current evaluative approaches primarily rely on refusal-based safety…

Computation and Language · Computer Science 2026-01-08 Yaling Shen , Stephanie Fong , Yiwen Jiang , Zimu Wang , Feilong Tang , Qingyang Xu , Xiangyu Zhao , Zhongxing Xu , Jiahe Liu , Jinpeng Hu , Dominic Dwyer , Zongyuan Ge

Safety alignment in Large Language Models is critical for healthcare; however, reliance on binary refusal boundaries often results in \emph{over-refusal} of benign queries or \emph{unsafe compliance} with harmful ones. While existing…

Artificial Intelligence · Computer Science 2026-01-27 Zhihao Zhang , Liting Huang , Guanghao Wu , Preslav Nakov , Heng Ji , Usman Naseem

Misalignment in Large Language Models (LLMs) arises when model behavior diverges from human expectations and fails to simultaneously satisfy safety, value, and cultural dimensions, which must co-occur in real-world settings to solve a…

Computation and Language · Computer Science 2026-02-13 Usman Naseem , Gautam Siddharth Kashyap , Rafiq Ali , Ebad Shabbir , Sushant Kumar Ray , Abdullah Mohammad , Agrima Seth

Large Language Models (LLMs) are increasingly vulnerable to a sophisticated form of adversarial prompting known as camouflaged jailbreaking. This method embeds malicious intent within seemingly benign language to evade existing safety…

Cryptography and Security · Computer Science 2025-09-09 Youjia Zheng , Mohammad Zandsalimy , Shanu Sushmita

As large language models (LLMs) evolve from conversational assistants into autonomous agents, evaluating the safety of their actions becomes critical. Prior safety benchmarks have primarily focused on preventing generation of harmful…

Computation and Language · Computer Science 2026-03-04 Adi Simhi , Jonathan Herzig , Martin Tutek , Itay Itzhak , Idan Szpektor , Yonatan Belinkov

Safety alignment is crucial for large language models (LLMs) to resist malicious instructions but often results in over-refusals, where benign prompts are unnecessarily rejected, impairing user experience and model utility. We introduce…

Machine Learning · Computer Science 2025-07-08 Mahavir Dabas , Si Chen , Charles Fleming , Ming Jin , Ruoxi Jia

In LLM-based text-to-SQL systems, unanswerable and underspecified user queries may generate not only incorrect text but also executable programs that yield misleading results or violate safety constraints, posing a major barrier to safe…

Artificial Intelligence · Computer Science 2026-04-15 Xuancheng Ren , Shijing Hu , Zhihui Lu , Jiangqi Huang , Qiang Duan

Safety alignment in large language models (LLMs), particularly for cybersecurity tasks, primarily focuses on preventing misuse. While this approach reduces direct harm, it obscures a complementary failure mode: denial of assistance to…

Cryptography and Security · Computer Science 2026-03-12 David Campbell , Neil Kale , Udari Madhushani Sehwag , Bert Herring , Nick Price , Dan Borges , Alex Levinson , Christina Q Knight

Large language models (LLMs) introduce new security risks, but there are few comprehensive evaluation suites to measure and reduce these risks. We present BenchmarkName, a novel benchmark to quantify LLM security risks and capabilities. We…

Refusal behavior in large language models (LLMs) enables them to decline responding to harmful, unethical, or inappropriate prompts, ensuring alignment with ethical standards. This paper investigates refusal behavior across six LLMs from…

Computation and Language · Computer Science 2025-01-15 Fabian Hildebrandt , Andreas Maier , Patrick Krauss , Achim Schilling

Many studies have demonstrated that large language models (LLMs) can produce harmful responses, exposing users to unexpected risks when LLMs are deployed. Previous studies have proposed comprehensive taxonomies of the risks posed by LLMs,…

Computation and Language · Computer Science 2024-08-06 Yuxia Wang , Zenan Zhai , Haonan Li , Xudong Han , Lizhi Lin , Zhenxuan Zhang , Jingru Zhao , Preslav Nakov , Timothy Baldwin

Multimodal large language models (MLLMs) hold considerable promise for applications in healthcare. However, their deployment in safety-critical settings is hindered by two key limitations: (i) sensitivity to prompt design, and (ii) a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Anita Kriz , Elizabeth Laura Janes , Xing Shen , Tal Arbel

Ensuring the safety of large language model (LLM) applications is essential for developing trustworthy artificial intelligence. Current LLM safety benchmarks have two limitations. First, they focus solely on either discriminative or…

Computation and Language · Computer Science 2024-10-30 Yutao Mou , Shikun Zhang , Wei Ye

The growing integration of Large Language Models (LLMs) into critical societal domains has raised concerns about embedded biases that can perpetuate stereotypes and undermine fairness. Such biases may stem from historical inequalities in…

Computation and Language · Computer Science 2025-10-17 Riccardo Cantini , Alessio Orsino , Massimo Ruggiero , Domenico Talia

Safety-aligned Large Language Models (LLMs) still show two dominant failure modes: they are easily jailbroken, or they over-refuse harmless inputs that contain sensitive surface signals. We trace both to a common cause: current models…

Computation and Language · Computer Science 2025-10-07 Rui Wu , Yihao Quan , Zeru Shi , Zhenting Wang , Yanshu Li , Ruixiang Tang

Large Language Models (LLMs) have advanced various Natural Language Processing (NLP) tasks, such as text generation and translation, among others. However, these models often generate texts that can perpetuate biases. Existing approaches to…

Computation and Language · Computer Science 2025-01-07 Shaina Raza , Oluwanifemi Bamgbose , Shardul Ghuge , Fatemeh Tavakol , Deepak John Reji , Syed Raza Bashir

Large Language Models (LLMs) have been shown to enhance the effectiveness of enriching item descriptions, thereby improving the accuracy of recommendation systems. However, most existing approaches either rely on text-only prompting or…

Information Retrieval · Computer Science 2025-10-24 Hanjia Lyu , Ryan Rossi , Xiang Chen , Md Mehrab Tanjim , Stefano Petrangeli , Somdeb Sarkhel , Jiebo Luo

Recent advancements in Large Language Models (LLMs) have significantly enhanced interactions between users and models. These advancements concurrently underscore the need for rigorous safety evaluations due to the manifestation of social…

Computation and Language · Computer Science 2025-03-26 Dahyun Jung , Seungyoon Lee , Hyeonseok Moon , Chanjun Park , Heuiseok Lim