English
Related papers

Related papers: GuardTrace-VL: Detecting Unsafe Multimodel Reasoni…

200 papers

As large language models (LLMs) evolve from static chatbots into autonomous agents, the primary vulnerability surface shifts from final outputs to intermediate execution traces. While safety guardrails are well-benchmarked for natural…

Cryptography and Security · Computer Science 2026-04-09 Yen-Shan Chen , Sian-Yao Huang , Cheng-Lin Yang , Yun-Nung Chen

Reasoning-based language models have demonstrated strong performance across various domains, with the most notable gains seen in mathematical and coding tasks. Recent research has shown that reasoning also offers significant benefits for…

Artificial Intelligence · Computer Science 2025-05-27 Makesh Narsimhan Sreedhar , Traian Rebedea , Christopher Parisien

Large vision-language models (LVLMs) have achieved remarkable progress in vision-language reasoning tasks, yet ensuring their safety remains a critical challenge. Recent input-side defenses detect unsafe images with CLIP and prepend safety…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xingyu Zhu , Beier Zhu , Junfeng Fang , Shuo Wang , Yin Zhang , Xiang Wang , Xiangnan He

Multimodal large language models (MLLMs) have demonstrated impressive reasoning and instruction-following capabilities, yet their expanded modality space introduces new compositional safety risks that emerge from complex text-image…

Cryptography and Security · Computer Science 2025-11-18 Xuankun Rong , Wenke Huang , Tingfeng Wang , Daiguo Zhou , Bo Du , Mang Ye

Maintaining the safety of large language models (LLMs) is crucial as they are increasingly deployed in real-world applications. Existing safety guardrails typically rely on single-pass classification or, more recently, distilled reasoning.…

Artificial Intelligence · Computer Science 2026-05-29 Siddharth Sai , Xiaofei Wen , Muhao Chen

Large Vision-Language Models face growing safety challenges with multimodal inputs. This paper introduces the concept of Implicit Reasoning Safety, a vulnerability in LVLMs. Benign combined inputs trigger unsafe LVLM outputs due to flawed…

Artificial Intelligence · Computer Science 2025-08-13 Wei Cai , Jian Zhao , Yuchu Jiang , Tianle Zhang , Xuelong Li

While the safety risks of image-based large language models (Image LLMs) have been extensively studied, their video-based counterparts (Video LLMs) remain critically under-examined. To systematically study this problem, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yiwei Sun , Peiqi Jiang , Chuanbin Liu , Luohao Lin , Zhiying Lu , Hongtao Xie

As large language models (LLMs) become deeply embedded in daily life, the urgent need for safer moderation systems that distinguish between naive and harmful requests while upholding appropriate censorship boundaries has never been greater.…

Computation and Language · Computer Science 2026-03-23 Naseem Machlovi , Maryam Saleki , Ruhul Amin , Mohamed Rahouti , Shawqi Al-Maliki , Junaid Qadir , Mohamed M. Abdallah , Ala Al-Fuqaha

Large language models increasingly rely on explicit chain-of-thought reasoning to solve complex tasks, yet the safety of the reasoning process itself remains largely unaddressed. Existing work focuses predominantly on content safety (i.e.,…

Artificial Intelligence · Computer Science 2026-05-07 Xunguang Wang , Yuguang Zhou , Qingyue Wang , Zongjie Li , Ruixuan Huang , Zhenlan Ji , Pingchuan Ma , Shuai Wang

Large Reasoning Models (LRMs) have demonstrated remarkable performance on tasks such as mathematics and code generation. Motivated by these strengths, recent work has empirically demonstrated the effectiveness of LRMs as guard models in…

Cryptography and Security · Computer Science 2025-09-29 Jiawei Zhao , Yuang Qi , Weiming Zhang , Nenghai Yu , Kejiang Chen

Large Reasoning Models (LRMs) have achieved remarkable success on reasoning-intensive tasks such as mathematics and programming. However, their enhanced reasoning capabilities do not necessarily translate to improved safety performance-and…

Computation and Language · Computer Science 2026-04-21 Zhexin Zhang , Xian Qi Loye , Victor Shea-Jay Huang , Junxiao Yang , Qi Zhu , Shiyao Cui , Fei Mi , Lifeng Shang , Yingkang Wang , Hongning Wang , Minlie Huang

Large Vision-Language Models (VLMs) have achieved remarkable performance across a wide range of tasks. However, their deployment in safety-critical domains poses significant challenges. Existing safety fine-tuning methods, which focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yi Ding , Lijun Li , Bing Cao , Jing Shao

Large Reasoning Models (LRMs) have significantly improved problem-solving through explicit Chain-of-Thought (CoT) reasoning. However, this capability creates a Safety-Helpfulness Paradox: the reasoning process itself can be misused to…

Artificial Intelligence · Computer Science 2026-01-27 Xin Gao , Shaohan Yu , Zerui Chen , Yueming Lyu , Weichen Yu , Guanghao Li , Jiyao Liu , Jianxiong Gao , Jian Liang , Ziwei Liu , Chenyang Si

Safety evaluation of multimodal foundation models often treats vision and language inputs separately, missing risks from joint interpretation where benign content becomes harmful in combination. Existing approaches also fail to distinguish…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Shruti Palaskar , Leon Gatys , Mona Abdelrahman , Mar Jacobo , Larry Lindsey , Rutika Moharir , Gunnar Lund , Yang Xu , Navid Shiee , Jeffrey Bigham , Charles Maalouf , Joseph Yitan Cheng

Process Reward Models (PRMs) provide step-level supervision that improves the reliability of reasoning in large language models. While PRMs have been extensively studied in text-based domains, their extension to Vision Language Models…

Artificial Intelligence · Computer Science 2025-10-08 Brandon Ong , Tej Deep Pala , Vernon Toh , William Chandra Tjhi , Soujanya Poria

Omni-modal Large Language Models (OLLMs) that process text, images, videos, and audio introduce new challenges for safety and value guardrails in human-AI interaction. Prior guardrail research largely targets unimodal settings and typically…

Artificial Intelligence · Computer Science 2025-12-03 Boyu Zhu , Xiaofei Wen , Wenjie Jacky Mo , Tinghui Zhu , Yanan Xie , Peng Qi , Muhao Chen

Reinforcement Learning (RL) has shown promise in improving the reasoning abilities of Large Language Models (LLMs). However, the specific challenges of adapting RL to multimodal data and formats remain relatively unexplored. In this work,…

Machine Learning · Computer Science 2025-05-20 Zirun Guo , Minjie Hong , Tao Jin

Powered by remarkable advancements in Large Language Models (LLMs), Multimodal Large Language Models (MLLMs) demonstrate impressive capabilities in manifold tasks. However, the practical application scenarios of MLLMs are intricate,…

Computation and Language · Computer Science 2024-06-18 Tianle Gu , Zeyang Zhou , Kexin Huang , Dandan Liang , Yixu Wang , Haiquan Zhao , Yuanqi Yao , Xingge Qiao , Keqing Wang , Yujiu Yang , Yan Teng , Yu Qiao , Yingchun Wang

Vision-language models (VLMs) are increasingly applied to identify unsafe or inappropriate images due to their internal ethical standards and powerful reasoning abilities. However, it is still unclear whether they can recognize various…

Cryptography and Security · Computer Science 2025-07-16 Yiting Qu , Michael Backes , Yang Zhang

Jailbreak attacks reveal critical vulnerabilities in Large Language Models (LLMs) by causing them to generate harmful or unethical content. Evaluating these threats is particularly challenging due to the evolving nature of LLMs and the…

Machine Learning · Computer Science 2025-07-11 Peiyan Zhang , Haibo Jin , Liying Kang , Haohan Wang