English
Related papers

Related papers: Safety Alignment Depth in Large Language Models: A…

200 papers

The open-sourcing of large language models (LLMs) accelerates application development, innovation, and scientific progress. This includes both base models, which are pre-trained on extensive datasets without alignment, and aligned models,…

Computation and Language · Computer Science 2024-04-17 Xiao Wang , Tianze Chen , Xianjun Yang , Qi Zhang , Xun Zhao , Dahua Lin

Safety alignment is critical for deploying large language models (LLMs) in real-world applications, yet most existing approaches rely on large human-annotated datasets and static red-teaming benchmarks that are costly, difficult to scale,…

Computation and Language · Computer Science 2026-03-10 Punyajoy Saha , Sudipta Halder , Debjyoti Mondal , Subhadarshi Panda

As the use of Large Language Models (LLMs) becomes more widespread, understanding their self-evaluation of confidence in generated responses becomes increasingly important as it is integral to the reliability of the output of these models.…

Computation and Language · Computer Science 2024-06-18 Abhishek Kumar , Robert Morabito , Sanzhar Umbet , Jad Kabbara , Ali Emami

The deployment of Large Language Models (LLMs) in robotic systems presents unique safety challenges, particularly in unpredictable environments. Although LLMs, leveraging zero-shot learning, enhance human-robot interaction and…

Robotics · Computer Science 2025-03-07 Ahmad Hafez , Alireza Naderi Akhormeh , Amr Hegazy , Amr Alanwar

With the rapid advancement of artificial intelligence, Large Language Models (LLMs) have shown remarkable capabilities in Natural Language Processing (NLP), including content generation, human-computer interaction, machine translation, and…

Computation and Language · Computer Science 2025-10-31 Songyang Liu , Chaozhuo Li , Jiameng Qiu , Xi Zhang , Feiran Huang , Litian Zhang , Yiming Hei , Philip S. Yu

Safety alignment in large language models (LLMs) is primarily evaluated under open-ended generation, where models can mitigate risk by refusing to respond. In contrast, many real-world applications place LLMs in structured decision-making…

Computation and Language · Computer Science 2026-04-21 Yuheng Chen , Zhiyu Wu , Bowen Cheng , Tetsuro Takahashi

Large Language Models (LLMs) exhibit significant safety disparities across languages, with low-resource languages (LRLs) often bypassing safety guardrails established for high-resource languages (HRLs) like English. Existing solutions, such…

Machine Learning · Computer Science 2026-02-27 Jiaming Liang , Zhaoxin Wang , Handing Wang

As Large Language Models (LLMs) continue to advance in understanding and generating long sequences, new safety concerns have been introduced through the long context. However, the safety of LLMs in long-context tasks remains under-explored,…

Computation and Language · Computer Science 2025-02-25 Yida Lu , Jiale Cheng , Zhexin Zhang , Shiyao Cui , Cunxiang Wang , Xiaotao Gu , Yuxiao Dong , Jie Tang , Hongning Wang , Minlie Huang

The safety of Large Language Models (LLMs) has gained increasing attention in recent years, but there still lacks a comprehensive approach for detecting safety issues within LLMs' responses in an aligned, customizable and explainable…

Computation and Language · Computer Science 2024-11-06 Zhexin Zhang , Yida Lu , Jingyuan Ma , Di Zhang , Rui Li , Pei Ke , Hao Sun , Lei Sha , Zhifang Sui , Hongning Wang , Minlie Huang

Jailbreak attacks pose persistent threats to large language models (LLMs). Current safety alignment methods have attempted to address these issues, but they experience two significant limitations: insufficient safety alignment depth and…

Cryptography and Security · Computer Science 2025-09-19 Yuanbo Xie , Yingjie Zhang , Tianyun Liu , Duohe Ma , Tingwen Liu

The proliferation of Large Language Models (LLMs) has demonstrated remarkable capabilities, elevating the critical importance of LLM safety. However, existing safety methods rely on ad-hoc taxonomy and lack a rigorous, systematic…

Computation and Language · Computer Science 2025-09-29 Wenbin Hu , Huihao Jing , Haochen Shi , Haoran Li , Yangqiu Song

Large Language Models (LLMs) are increasingly vulnerable to a sophisticated form of adversarial prompting known as camouflaged jailbreaking. This method embeds malicious intent within seemingly benign language to evade existing safety…

Cryptography and Security · Computer Science 2025-09-09 Youjia Zheng , Mohammad Zandsalimy , Shanu Sushmita

Large language models (LLMs) have significantly transformed the landscape of Natural Language Processing (NLP). Their impact extends across a diverse spectrum of tasks, revolutionizing how we approach language understanding and generations.…

Cryptography and Security · Computer Science 2025-06-13 Sara Abdali , Richard Anarfi , CJ Barberan , Jia He , Erfan Shayegani

Large Language Models (LLMs) are increasingly integrated into high-stakes applications, making robust safety guarantees a central practical and commercial concern. Existing safety evaluations predominantly rely on fixed collections of…

Computation and Language · Computer Science 2026-03-23 Zafir Shamsi , Nikhil Chekuru , Zachary Guzman , Shivank Garg

Ensuring the safe alignment of large language models (LLMs) with human values is critical as they become integral to applications like translation and question answering. Current alignment methods struggle with dynamic user intentions and…

Computation and Language · Computer Science 2024-10-29 Rima Hazra , Sayan Layek , Somnath Banerjee , Soujanya Poria

Large language models (LLMs) are often assumed to contain ``safety regions'' -- parameter subsets whose modification directly influences safety behaviors. We conduct a systematic evaluation of four safety region identification methods…

Machine Learning · Computer Science 2026-02-23 Zongmin Li , Jian Su , Farah Benamara , Aixin Sun

Large Language Models (LLMs), despite advanced general capabilities, still suffer from numerous safety risks, especially jailbreak attacks that bypass safety protocols. Understanding these vulnerabilities through black-box jailbreak…

Cryptography and Security · Computer Science 2025-05-29 Yao Huang , Yitong Sun , Shouwei Ruan , Yichi Zhang , Yinpeng Dong , Xingxing Wei

Larger language models (LLMs) have taken the world by storm with their massive multi-tasking capabilities simply by optimizing over a next-word prediction objective. With the emergence of their properties and encoded knowledge, the risk of…

Computation and Language · Computer Science 2023-08-31 Rishabh Bhardwaj , Soujanya Poria

We introduce a novel inference-time alignment approach for LLMs that aims to generate safe responses almost surely, i.e., with probability approaching one. Our approach models the generation of safe responses as a constrained Markov…

Machine Learning · Computer Science 2025-06-23 Xiaotong Ji , Shyam Sundhar Ramesh , Matthieu Zimmer , Ilija Bogunovic , Jun Wang , Haitham Bou Ammar

Large Language Models (LLMs) have evolved into Multimodal Large Language Models (MLLMs), significantly enhancing their capabilities by integrating visual information and other types, thus aligning more closely with the nature of human…

Cryptography and Security · Computer Science 2025-06-03 Youze Wang , Wenbo Hu , Yinpeng Dong , Jing Liu , Hanwang Zhang , Richang Hong