English
Related papers

Related papers: Safety Tax: Safety Alignment Makes Your Large Reas…

200 papers

Safety alignment often improves robustness to harmful queries at the cost of reasoning ability, a tradeoff known as the safety tax. A common cause is distributional mismatch: supervised fine-tuning trains the target model on safety…

Machine Learning · Computer Science 2026-05-19 Yu Fu , Longxuan Yu , Haz Sameen Shahgir , Zhipeng Wei , Hui Liu , N. Benjamin Erichson , Yue Dong

Despite the remarkable proficiency of \textit{Large Reasoning Models} (LRMs) in handling complex reasoning tasks, their reliability in safety-critical scenarios remains uncertain. Existing evaluations primarily assess response-level safety,…

Artificial Intelligence · Computer Science 2025-05-27 Baihui Zheng , Boren Zheng , Kerui Cao , Yingshui Tan , Zhendong Liu , Weixun Wang , Jiaheng Liu , Jian Yang , Wenbo Su , Xiaoyong Zhu , Bo Zheng , Kaifu Zhang

We discover a novel and surprising phenomenon of unintentional misalignment in reasoning language models (RLMs), which we call self-jailbreaking. Specifically, after benign reasoning training on math or code domains, RLMs will use multiple…

Cryptography and Security · Computer Science 2026-04-30 Zheng-Xin Yong , Stephen H. Bach

This paper presents a systematic evaluation of Large Language Models' (LLMs) behavior on long-tail distributed (encrypted) texts and their safety implications. We introduce a two-dimensional framework for assessing LLM safety: (1)…

Computation and Language · Computer Science 2025-06-05 Utsav Maskey , Mark Dras , Usman Naseem

The emergence of autonomous Large Language Model (LLM) agents capable of tool usage has introduced new safety risks that go beyond traditional conversational misuse. These agents, empowered to execute external functions, are vulnerable to…

Artificial Intelligence · Computer Science 2025-07-14 Zeyang Sha , Hanling Tian , Zhuoer Xu , Shiwen Cui , Changhua Meng , Weiqiang Wang

Due to the remarkable capabilities and growing impact of large language models (LLMs), they have been deeply integrated into many aspects of society. Thus, ensuring their alignment with human values and intentions has emerged as a critical…

Large Language Models (LLMs) continue to exhibit vulnerabilities despite deliberate safety alignment efforts, posing significant risks to users and society. To safeguard against the risk of policy-violating content, system-level moderation…

Artificial Intelligence · Computer Science 2025-10-27 Jingnan Zheng , Xiangtian Ji , Yijun Lu , Chenhang Cui , Weixiang Zhao , Gelei Deng , Zhenkai Liang , An Zhang , Tat-Seng Chua

As large language models (LLMs) become easily accessible nowadays, the trade-off between safety and helpfulness can significantly impact user experience. A model that prioritizes safety will cause users to feel less engaged and assisted…

Computation and Language · Computer Science 2024-04-02 Yi-Lin Tuan , Xilun Chen , Eric Michael Smith , Louis Martin , Soumya Batra , Asli Celikyilmaz , William Yang Wang , Daniel M. Bikel

When building Large Language Models (LLMs), it is paramount to bear safety in mind and protect them with guardrails. Indeed, LLMs should never generate content promoting or normalizing harmful, illegal, or unethical behavior that may…

Computation and Language · Computer Science 2024-06-25 Simone Tedeschi , Felix Friedrich , Patrick Schramowski , Kristian Kersting , Roberto Navigli , Huu Nguyen , Bo Li

The safety alignment of large language models (LLMs) remains vulnerable, as their initial behavior can be easily jailbroken by even relatively simple attacks. Since infilling a fixed template between the input instruction and initial model…

Computation and Language · Computer Science 2025-06-05 Chak Tou Leong , Qingyu Yin , Jian Wang , Wenjie Li

The emergence of Large Reasoning Models (LRMs) introduces a new paradigm of explicit reasoning, enabling remarkable advances yet posing unique risks such as reasoning manipulation and information leakage. To mitigate these risks, current…

Artificial Intelligence · Computer Science 2026-02-03 Jingnan Zheng , Jingjun Xu , Yanzhen Luo , Chenhang Cui , Gelei Deng , Zhenkai Liang , Xiang Wang , An Zhang , Tat-Seng Chua

Although Large Reasoning Models (LRMs) have progressed in solving complex problems, their chain-of-thought (CoT) reasoning often contains harmful content that can persist even when the final responses appear safe. We show that this issue…

Artificial Intelligence · Computer Science 2026-03-03 Yichi Zhang , Yue Ding , Jingwen Yang , Tianwei Luo , Dongbai Li , Ranjie Duan , Qiang Liu , Hang Su , Yinpeng Dong , Jun Zhu

Recent developments in large language models (LLMs) have led to their widespread usage for various tasks. The prevalence of LLMs in society implores the assurance on the reliability of their performance. In particular, risk-sensitive…

Machine Learning · Computer Science 2025-02-28 Catherine Yu-Chi Chen , Jingyan Shen , Zhun Deng , Lihua Lei

Considerable research efforts have been devoted to ensuring that large language models (LLMs) align with human values and generate safe text. However, an excessive focus on sensitivity to certain topics can compromise the model's robustness…

Computation and Language · Computer Science 2023-08-29 Huachuan Qiu , Shuai Zhang , Anqi Li , Hongliang He , Zhenzhong Lan

LLMs(Large Language Models) nowadays have widespread adoption as a tool for solving issues across various domain/tasks. These models since are susceptible to produce harmful or toxic results, inference-time adversarial attacks, therefore…

Computation and Language · Computer Science 2024-10-01 Sachin Kumar

Large Language Models (LLMs) are typically aligned for safety during the post-training phase; however, they may still generate inappropriate outputs that could potentially pose risks to users. This challenge underscores the need for robust…

Machine Learning · Computer Science 2025-12-08 Mahesh Kumar Nandwana , Youngwan Lim , Joseph Liu , Alex Yang , Varun Notibala , Nishchaie Khanna

The last two years have seen a rapid growth in concerns around the safety of large language models (LLMs). Researchers and practitioners have met these concerns by creating an abundance of datasets for evaluating and improving LLM safety.…

Computation and Language · Computer Science 2025-01-13 Paul Röttger , Fabio Pernisi , Bertie Vidgen , Dirk Hovy

Multimodal large language models (MLLMs) have demonstrated impressive reasoning and instruction-following capabilities, yet their expanded modality space introduces new compositional safety risks that emerge from complex text-image…

Cryptography and Security · Computer Science 2025-11-18 Xuankun Rong , Wenke Huang , Tingfeng Wang , Daiguo Zhou , Bo Du , Mang Ye

Large language models (LLMs) have shown significant progress in reasoning tasks. However, recent studies show that transformers and LLMs fail catastrophically once reasoning problems exceed modest complexity. We revisit these findings…

Artificial Intelligence · Computer Science 2025-10-28 Revanth Rameshkumar , Jimson Huang , Yunxin Sun , Fei Xia , Abulhair Saparov

Efforts to ensure the safety of large language models (LLMs) include safety fine-tuning, evaluation, and red teaming. However, despite the widespread use of the Retrieval-Augmented Generation (RAG) framework, AI safety work focuses on…

Computation and Language · Computer Science 2025-04-28 Bang An , Shiyue Zhang , Mark Dredze
‹ Prev 1 3 4 5 6 7 10 Next ›