English
Related papers

Related papers: Evolving Contextual Safety in Multi-Modal Large La…

200 papers

Large Language Models (LLMs) have achieved impressive performance across diverse natural language processing tasks, but their growing power also amplifies potential risks such as jailbreak attacks that circumvent built-in safety mechanisms.…

Artificial Intelligence · Computer Science 2025-10-01 Qinjian Zhao , Jiaqi Wang , Zhiqiang Gao , Zhihao Dou , Belal Abuhaija , Kaizhu Huang

The widespread adoption and increasing prominence of large language models (LLMs) in global technologies necessitate a rigorous focus on ensuring their safety across a diverse range of linguistic and cultural contexts. The lack of a…

Computation and Language · Computer Science 2025-08-28 Zhiyuan Ning , Tianle Gu , Jiaxin Song , Shixin Hong , Lingyu Li , Huacan Liu , Jie Li , Yixu Wang , Meng Lingyu , Yan Teng , Yingchun Wang

Comprehensive situational awareness is essential for autonomous vehicles operating in safety-critical environments, as it enables the identification and mitigation of potential risks. Although recent Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Sainithin Artham , Shankar Gangisetty , Avijit Dasgupta , C. V. Jawahar

The rise of Omni-modal Large Language Models (OLLMs), which integrate visual and auditory processing with text, necessitates robust safety evaluations to mitigate harmful outputs. However, no dedicated benchmarks currently exist for OLLMs,…

Computation and Language · Computer Science 2025-09-30 Leyi Pan , Zheyu Fu , Yunpeng Zhai , Shuchang Tao , Sheng Guan , Shiyu Huang , Lingzhe Zhang , Zhaoyang Liu , Bolin Ding , Felix Henry , Aiwei Liu , Lijie Wen

Considerable research efforts have been devoted to ensuring that large language models (LLMs) align with human values and generate safe text. However, an excessive focus on sensitivity to certain topics can compromise the model's robustness…

Computation and Language · Computer Science 2023-08-29 Huachuan Qiu , Shuai Zhang , Anqi Li , Hongliang He , Zhenzhong Lan

Traditional approaches to safety event analysis in autonomous systems have relied on complex machine learning models and extensive datasets for high accuracy and reliability. However, the advent of Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Mohammad Abu Tami , Huthaifa I. Ashqar , Mohammed Elhenawy

Large language models (LLMs) are increasingly explored as scalable tools for mental health counseling, yet evaluating their safety remains challenging due to the interactional and context-dependent nature of clinical harm. Existing…

Computation and Language · Computer Science 2026-04-21 Suhyun Lee , Palakorn Achananuparp , Neemesh Yadav , Ee-Peng Lim , Yang Deng

As the use of large language model (LLM) agents continues to grow, their safety vulnerabilities have become increasingly evident. Extensive benchmarks evaluate various aspects of LLM safety by defining the safety relying heavily on general…

Computation and Language · Computer Science 2025-10-24 Yeonjun In , Wonjoong Kim , Kanghoon Yoon , Sungchul Kim , Mehrab Tanjim , Sangwu Park , Kibum Kim , Chanyoung Park

Equipping Large Language Models (LLMs) with persistent memory enhances interaction continuity and personalization but introduces new safety risks. Specifically, contaminated or biased memory accumulation can trigger abnormal agent…

Computation and Language · Computer Science 2026-05-22 Weiwei Xie , Shaoxiong Guo , Fan Zhang , Tian Xia , Xue Yang , Lizhuang Ma , Junchi Yan , Qibing Ren

Individuals' concerns about data privacy and AI safety are highly contextualized and extend beyond sensitive patterns. Addressing these issues requires reasoning about the context to identify and mitigate potential risks. Though researchers…

Computation and Language · Computer Science 2026-04-15 Haoran Li , Yulin Chen , Huihao Jing , Wenbin Hu , Tsz Ho Li , Chanhou Lou , Hong Ting Tsang , Sirui Han , Yangqiu Song

Multimodal large language models (MLLMs) have shown impressive reasoning abilities. However, they are also more vulnerable to jailbreak attacks than their LLM predecessors. Although still capable of detecting the unsafe responses, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Yunhao Gou , Kai Chen , Zhili Liu , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung , James T. Kwok , Yu Zhang

Multimodal Large Language Models (MLLMs) exacerbate safety risks by introducing vulnerabilities across multiple modalities, such as language and vision. Current MLLM safety evaluation tools, however, suffer from major limitations: 1)…

Computation and Language · Computer Science 2026-05-28 Yongwoo Kim , Sojung An , Yunjin Park , Jungwon Yoon , Dujin Lee , HyunBeom Cho , Jaewon Lee , Wonhyuk Lee , Youngchol Kim , JeongYeop Kim , Donghyun Kim

Large Language Models (LLMs) have exhibited great performance in autonomously calling various tools in external environments, leading to better problem solving and task automation capabilities. However, these external tools also amplify…

Cryptography and Security · Computer Science 2025-09-10 Hongfei Xia , Hongru Wang , Zeming Liu , Qian Yu , Yuhang Guo , Haifeng Wang

User prompts to large language models (LLMs) are often ambiguous or under-specified, and subtle contextual cues shaped by user intentions, prior knowledge, and risk factors strongly influence what constitutes an appropriate response.…

Machine Learning · Computer Science 2025-12-16 Minseon Kim , Lucas Caccia , Zhengyan Shi , Matheus Pereira , Marc-Alexandre Côté , Xingdi Yuan , Alessandro Sordoni

Recent advances in multi-modal large language models (MLLMs) have enabled unified perception-reasoning capabilities, yet these systems remain highly vulnerable to jailbreak attacks that bypass safety alignment and induce harmful behaviors.…

Cryptography and Security · Computer Science 2025-12-09 Xiaojun Jia , Jie Liao , Qi Guo , Teng Ma , Simeng Qin , Ranjie Duan , Tianlin Li , Yihao Huang , Zhitao Zeng , Dongxian Wu , Yiming Li , Wenqi Ren , Xiaochun Cao , Yang Liu

Large language models (LLMs) have achieved impressive performance across natural language tasks and are increasingly deployed in real-world applications. Despite extensive safety alignment efforts, recent studies show that such alignment is…

Artificial Intelligence · Computer Science 2026-02-02 Yinzhi Zhao , Ming Wang , Shi Feng , Xiaocui Yang , Daling Wang , Yifei Zhang

With the rapid advancement of Large Language Models (LLMs), the safety of LLMs has been a critical concern requiring precise assessment. Current benchmarks primarily concentrate on single-turn dialogues or a single jailbreak attack method…

While large language models (LLMs) exhibit remarkable capabilities across a wide range of tasks, they pose potential safety concerns, such as the ``jailbreak'' problem, wherein malicious instructions can manipulate LLMs to exhibit…

Computation and Language · Computer Science 2024-03-05 Yue Deng , Wenxuan Zhang , Sinno Jialin Pan , Lidong Bing

Vulnerability detection is a critical aspect of software security. Accurate detection is essential to prevent potential security breaches and protect software systems from malicious attacks. Recently, vulnerability detection methods…

Software Engineering · Computer Science 2025-04-24 Yixin Yang , Bowen Xu , Xiang Gao , Hailong Sun

As large language models (LLMs) are deployed in multilingual settings, their safety behavior in culturally diverse, low-resource languages remains poorly understood. We present the first systematic evaluation of LLM safety across 12 Indic…

Computation and Language · Computer Science 2026-05-18 Priyaranjan Pattnayak , Sanchari Chowdhuri