English
Related papers

Related papers: Adapting Safe-for-Work Classifier for Malaysian La…

200 papers

Large Language Models (LLMs) with safe-alignment training are powerful instruments with robust language comprehension capabilities. These models typically undergo meticulous alignment procedures involving human feedback to ensure the…

Machine Learning · Computer Science 2025-09-22 Maithili Joshi , Palash Nandi , Tanmoy Chakraborty

Safety fine-tuning helps align Large Language Models (LLMs) with human preferences for their safe deployment. To better understand the underlying factors that make models safe via safety fine-tuning, we design a synthetic data generation…

Machine Learning · Computer Science 2024-08-22 Samyak Jain , Ekdeep Singh Lubana , Kemal Oksuz , Tom Joy , Philip H. S. Torr , Amartya Sanyal , Puneet K. Dokania

As large language models (LLMs) see wider real-world use, understanding and mitigating their unsafe behaviors is critical. Interpretation techniques can reveal causes of unsafe outputs and guide safety, but such connections with safety are…

Software Engineering · Computer Science 2025-06-09 Seongmin Lee , Aeree Cho , Grace C. Kim , ShengYun Peng , Mansi Phute , Duen Horng Chau

Large language models (LLMs) are being deployed across the Global South, where everyday use involves low-resource languages, code-mixing, and culturally specific norms. Yet safety pipelines, benchmarks, and alignment still largely target…

Computation and Language · Computer Science 2026-02-17 Somnath Banerjee , Rima Hazra , Animesh Mukherjee

Large Language Models (LLMs) are increasingly adopted in high-stakes scenarios, yet their safety mechanisms often remain fragile. Simple jailbreak prompts or even benign fine-tuning can bypass these protocols, underscoring the need to…

Machine Learning · Computer Science 2025-02-04 Ching-Chia Kao , Chia-Mu Yu , Chun-Shien Lu , Chu-Song Chen

Most prior safety research of large language models (LLMs) has focused on enhancing the alignment of LLMs to better suit the safety requirements of humans. However, internalizing such safeguard features into larger models brought challenges…

Computation and Language · Computer Science 2025-01-24 Ohjoon Kwon , Donghyeon Jeon , Nayoung Choi , Gyu-Hwung Cho , Changbong Kim , Hyunwoo Lee , Inho Kang , Sun Kim , Taiwoo Park

Jailbreak attacks pose a serious threat to the safety of Large Language Models (LLMs) by crafting adversarial prompts that bypass alignment mechanisms, causing the models to produce harmful, restricted, or biased content. In this paper, we…

Machine Learning · Computer Science 2025-08-22 Xiangman Li , Xiaodong Wu , Qi Li , Jianbing Ni , Rongxing Lu

Considerable research efforts have been devoted to ensuring that large language models (LLMs) align with human values and generate safe text. However, an excessive focus on sensitivity to certain topics can compromise the model's robustness…

Computation and Language · Computer Science 2023-08-29 Huachuan Qiu , Shuai Zhang , Anqi Li , Hongliang He , Zhenzhong Lan

Recent advancements in Large Language Models (LLMs) have sparked widespread concerns about their safety. Recent work demonstrates that safety alignment of LLMs can be easily removed by fine-tuning with a few adversarially chosen…

Computation and Language · Computer Science 2025-03-03 Samuele Poppi , Zheng-Xin Yong , Yifei He , Bobbie Chern , Han Zhao , Aobo Yang , Jianfeng Chi

Recent advancements in Large Language Models (LLMs) have showcased remarkable capabilities across various tasks in different domains. However, the emergence of biases and the potential for generating harmful content in LLMs, particularly…

Cryptography and Security · Computer Science 2024-07-25 Zhuowen Yuan , Zidi Xiong , Yi Zeng , Ning Yu , Ruoxi Jia , Dawn Song , Bo Li

Although region-specific large language models (LLMs) are increasingly developed, their safety remains underexplored, particularly in culturally diverse settings like Indonesia, where sensitivity to local norms is essential and highly…

Computation and Language · Computer Science 2025-06-04 Muhammad Falensi Azmi , Muhammad Dehan Al Kautsar , Alfan Farizki Wicaksono , Fajri Koto

Attracted by the impressive power of Multimodal Large Language Models (MLLMs), the public is increasingly utilizing them to improve the efficiency of daily work. Nonetheless, the vulnerabilities of MLLMs to unsafe instructions bring huge…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xin Liu , Yichen Zhu , Yunshi Lan , Chao Yang , Yu Qiao

Guardrail, an emerging mechanism designed to ensure that large language models (LLMs) align with human values by moderating harmful or toxic responses, requires a sociotechnical approach in their design. This paper addresses a critical…

Artificial Intelligence · Computer Science 2025-06-05 Jinwei Hu , Yi Dong , Xiaowei Huang

In the burgeoning field of Large Language Models (LLMs), developing a robust safety mechanism, colloquially known as "safeguards" or "guardrails", has become imperative to ensure the ethical use of LLMs within prescribed boundaries. This…

Cryptography and Security · Computer Science 2024-06-06 Yi Dong , Ronghui Mu , Yanghao Zhang , Siqi Sun , Tianle Zhang , Changshun Wu , Gaojie Jin , Yi Qi , Jinwei Hu , Jie Meng , Saddek Bensalem , Xiaowei Huang

Recent developments in balancing the usefulness and safety of Large Language Models (LLMs) have raised a critical question: Are mainstream NLP tasks adequately aligned with safety consideration? Our study, focusing on safety-sensitive…

Computation and Language · Computer Science 2024-06-10 Yu Fu , Yufei Li , Wen Xiao , Cong Liu , Yue Dong

Large vision-language models (LVLMs) have achieved remarkable progress in vision-language reasoning tasks, yet ensuring their safety remains a critical challenge. Recent input-side defenses detect unsafe images with CLIP and prepend safety…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xingyu Zhu , Beier Zhu , Junfeng Fang , Shuo Wang , Yin Zhang , Xiang Wang , Xiangnan He

Safety guardrails have become an active area of research in AI safety, aimed at ensuring the appropriate behavior of large language models (LLMs). However, existing research lacks consideration of nuances across linguistic and cultural…

Cryptography and Security · Computer Science 2026-04-21 Hua-Rong Chu , Kuan-Chun Wang , Yao-Te Huang

The safety of Large Language Models (LLMs) has gained increasing attention in recent years, but there still lacks a comprehensive approach for detecting safety issues within LLMs' responses in an aligned, customizable and explainable…

Computation and Language · Computer Science 2024-11-06 Zhexin Zhang , Yida Lu , Jingyuan Ma , Di Zhang , Rui Li , Pei Ke , Hao Sun , Lei Sha , Zhifang Sui , Hongning Wang , Minlie Huang

Multi-modal large language models (MLLMs) have made significant progress, yet their safety alignment remains limited. Typically, current open-source MLLMs rely on the alignment inherited from their language module to avoid harmful…

Cryptography and Security · Computer Science 2025-04-15 Yanbo Wang , Jiyang Guan , Jian Liang , Ran He

As large language models (LLMs) are increasingly deployed, ensuring their safe use is paramount. Jailbreaking, adversarial prompts that bypass model alignment to trigger harmful outputs, present significant risks, with existing studies…

Cryptography and Security · Computer Science 2026-01-01 Yuan Xin , Dingfan Chen , Linyi Yang , Michael Backes , Xiao Zhang