English
Related papers

Related papers: SAFETY-J: Evaluating Safety with Critique

200 papers

LLMs (Large Language Models) are increasingly used in text processing pipelines to intelligently respond to a variety of inputs and generation tasks. This raises the possibility of replacing human roles that bottleneck existing information…

Computation and Language · Computer Science 2025-12-18 Kester Clegg , Richard Hawkins , Ibrahim Habli , Tom Lawton

With the rapid popularity of large language models such as ChatGPT and GPT-4, a growing amount of attention is paid to their safety concerns. These models may generate insulting and discriminatory content, reflect incorrect social values,…

Computation and Language · Computer Science 2023-04-21 Hao Sun , Zhexin Zhang , Jiawen Deng , Jiale Cheng , Minlie Huang

Generative large language models (LLMs) have revolutionized natural language processing with their transformative and emergent capabilities. However, recent evidence indicates that LLMs can produce harmful content that violates social…

Cryptography and Security · Computer Science 2025-04-08 Xiaohan Yuan , Jinfeng Li , Dongxia Wang , Yuefeng Chen , Xiaofeng Mao , Longtao Huang , Jialuo Chen , Hui Xue , Xiaoxia Liu , Wenhai Wang , Kui Ren , Jingyi Wang

Many studies have demonstrated that large language models (LLMs) can produce harmful responses, exposing users to unexpected risks when LLMs are deployed. Previous studies have proposed comprehensive taxonomies of the risks posed by LLMs,…

Computation and Language · Computer Science 2024-08-06 Yuxia Wang , Zenan Zhai , Haonan Li , Xudong Han , Lizhi Lin , Zhenxuan Zhang , Jingru Zhao , Preslav Nakov , Timothy Baldwin

With the rapid development of Large Language Models (LLMs), increasing attention has been paid to their safety concerns. Consequently, evaluating the safety of LLMs has become an essential task for facilitating the broad applications of…

Computation and Language · Computer Science 2024-06-25 Zhexin Zhang , Leqi Lei , Lindong Wu , Rui Sun , Yongkang Huang , Chong Long , Xiao Liu , Xuanyu Lei , Jie Tang , Minlie Huang

Evaluating aligned large language models' (LLMs) ability to recognize and reject unsafe user requests is crucial for safe, policy-compliant deployments. Existing evaluation efforts, however, face three limitations that we address with…

Large language models (LLMs), like ChatGPT and GPT-4, have demonstrated remarkable abilities in natural language understanding and generation. However, alongside their positive impact on our daily tasks, they can also produce harmful…

Computation and Language · Computer Science 2023-10-10 Liang Xu , Kangkang Zhao , Lei Zhu , Hang Xue

With the rapid advancement of artificial intelligence, Large Language Models (LLMs) have shown remarkable capabilities in Natural Language Processing (NLP), including content generation, human-computer interaction, machine translation, and…

Computation and Language · Computer Science 2025-10-31 Songyang Liu , Chaozhuo Li , Jiameng Qiu , Xi Zhang , Feiran Huang , Litian Zhang , Yiming Hei , Philip S. Yu

We propose a novel dynamic safety framework that optimizes language model (LM) safety reasoning at inference time without modifying model weights. Building on recent advances in self-critique methods, our approach leverages a meta-critique…

Computation and Language · Computer Science 2025-04-08 Víctor Gallego

Large Language Models (LLMs) represent an advanced evolution of earlier, simpler language models. They boast enhanced abilities to handle complex language patterns and generate coherent text, images, audios, and videos. Furthermore, they…

Cryptography and Security · Computer Science 2024-03-01 Jun Huang , Jiawei Zhang , Qi Wang , Weihong Han , Yanchun Zhang

While Large Language Models (LLMs) have seen widespread applications across numerous fields, their limited interpretability poses concerns regarding their safe operations from multiple aspects, e.g., truthfulness, robustness, and fairness.…

Software Engineering · Computer Science 2024-04-15 Xuan Xie , Jiayang Song , Zhehua Zhou , Yuheng Huang , Da Song , Lei Ma

Studying the robustness of Large Language Models (LLMs) to unsafe behaviors is an important topic of research today. Building safety classification models or guard models, which are fine-tuned models for input/output safety classification…

Computation and Language · Computer Science 2025-07-30 Sowmya Vajjala

With the profound development of large language models(LLMs), their safety concerns have garnered increasing attention. However, there is a scarcity of Chinese safety benchmarks for LLMs, and the existing safety taxonomies are inadequate,…

Computation and Language · Computer Science 2024-09-04 Wenjing Zhang , Xuejiao Lei , Zhaoxiang Liu , Meijuan An , Bikun Yang , KaiKai Zhao , Kai Wang , Shiguo Lian

The security concerns surrounding Large Language Models (LLMs) have been extensively explored, yet the safety of Multimodal Large Language Models (MLLMs) remains understudied. In this paper, we observe that Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xin Liu , Yichen Zhu , Jindong Gu , Yunshi Lan , Chao Yang , Yu Qiao

Powered by remarkable advancements in Large Language Models (LLMs), Multimodal Large Language Models (MLLMs) demonstrate impressive capabilities in manifold tasks. However, the practical application scenarios of MLLMs are intricate,…

Computation and Language · Computer Science 2024-06-18 Tianle Gu , Zeyang Zhou , Kexin Huang , Dandan Liang , Yixu Wang , Haiquan Zhao , Yuanqi Yao , Xingge Qiao , Keqing Wang , Yujiu Yang , Yan Teng , Yu Qiao , Yingchun Wang

With the rapid development of Large language models (LLMs), understanding the capabilities of LLMs in identifying unsafe content has become increasingly important. While previous works have introduced several benchmarks to evaluate the…

Computation and Language · Computer Science 2025-04-15 Hengxiang Zhang , Hongfu Gao , Qiang Hu , Guanhua Chen , Lili Yang , Bingyi Jing , Hongxin Wei , Bing Wang , Haifeng Bai , Lei Yang

Large language models (LLMs) have demonstrated remarkable capabilities across various applications, highlighting the urgent need for comprehensive safety evaluations. In particular, the enhanced Chinese language proficiency of LLMs,…

Computation and Language · Computer Science 2025-02-27 Shuyi Liu , Simiao Cui , Haoran Bu , Yuming Shang , Xi Zhang

The rapid development and deployment of large language models (LLMs) have introduced a new frontier in artificial intelligence, marked by unprecedented capabilities in natural language understanding and generation. However, the increasing…

Artificial Intelligence · Computer Science 2024-12-25 Dan Shi , Tianhao Shen , Yufei Huang , Zhigen Li , Yongqi Leng , Renren Jin , Chuang Liu , Xinwei Wu , Zishan Guo , Linhao Yu , Ling Shi , Bojian Jiang , Deyi Xiong

Safety fine-tuning helps align Large Language Models (LLMs) with human preferences for their safe deployment. To better understand the underlying factors that make models safe via safety fine-tuning, we design a synthetic data generation…

Machine Learning · Computer Science 2024-08-22 Samyak Jain , Ekdeep Singh Lubana , Kemal Oksuz , Tom Joy , Philip H. S. Torr , Amartya Sanyal , Puneet K. Dokania

In the rapidly evolving landscape of Large Language Models (LLMs), ensuring robust safety measures is paramount. To meet this crucial need, we propose \emph{SALAD-Bench}, a safety benchmark specifically designed for evaluating LLMs, attack,…

Computation and Language · Computer Science 2024-06-10 Lijun Li , Bowen Dong , Ruohui Wang , Xuhao Hu , Wangmeng Zuo , Dahua Lin , Yu Qiao , Jing Shao
‹ Prev 1 2 3 10 Next ›