English
Related papers

Related papers: GuardTrace-VL: Detecting Unsafe Multimodel Reasoni…

200 papers

Large Language Models have shown impressive generative capabilities across diverse tasks, but their safety remains a critical concern. Existing post-training alignment methods, such as SFT and RLHF, reduce harmful outputs yet leave LLMs…

Cryptography and Security · Computer Science 2025-10-21 Zhengyue Zhao , Yingzi Ma , Somesh Jha , Marco Pavone , Patrick McDaniel , Chaowei Xiao

Conventional construction safety inspection methods are often inefficient as they require navigating through large volume of information. Recent advances in large vision-language models (LVLMs) provide opportunities to automate safety…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Chenxin Wang , Elyas Asadi Shamsabadi , Zhaohui Chen , Luming Shen , Alireza Ahmadian Fard Fini , Daniel Dias-da-Costa

Large Language Models (LLMs) are increasingly deployed for code generation in high-stakes software development, yet their limited transparency in security reasoning and brittleness to evolving vulnerability patterns raise critical…

Software Engineering · Computer Science 2026-03-03 Manisha Mukherjee , Vincent J. Hellendoorn

Multimodal Large Language Models (MLLMs) are increasingly used for content moderation, yet their robustness in short-form video contexts remains underexplored. Current safety evaluations often rely on unimodal attacks, failing to address…

Guardrail models (a.k.a. safety checkers) are widely deployed to screen user inputs before they reach large language models (LLMs), serving as a primary defense against prompt injection attacks. Due to strict context constraints, these…

Cryptography and Security · Computer Science 2026-05-25 Yuanbo Zhou , Changjia Zhu , Junyu Wang , Xu He , Yan Zhai , Kun Sun , Mingkui Wei , Junjie Xiong

Reward models play an essential role in training vision-language models (VLMs) by assessing output quality to enable aligning with human preferences. Despite their importance, the research community lacks comprehensive open benchmarks for…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Michihiro Yasunaga , Luke Zettlemoyer , Marjan Ghazvininejad

Long-form video understanding, characterized by long-range temporal dependencies and multiple events, remains a challenge. Existing methods often rely on static reasoning or external visual-language models (VLMs), which face issues like…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yuan Xie , Tianshui Chen , Zheng Ge , Lionel Ni

Multimodal large language models (MLLMs) are increasingly deployed as assistants that interact through text and images, making it crucial to evaluate contextual safety when risk depends on both the visual scene and the evolving dialogue.…

Computation and Language · Computer Science 2026-01-13 Zheyuan Liu , Dongwhi Kim , Yixin Wan , Xiangchi Yuan , Zhaoxuan Tan , Fengran Mo , Meng Jiang

With the rapid advancement of Large Vision-Language Models (LVLMs), ensuring their safety has emerged as a crucial area of research. This survey provides a comprehensive analysis of LVLM safety, covering key aspects such as attacks,…

Cryptography and Security · Computer Science 2025-02-24 Mang Ye , Xuankun Rong , Wenke Huang , Bo Du , Nenghai Yu , Dacheng Tao

Vision-Language Models (VLMs) continue to struggle to make morally salient judgments in multimodal and socially ambiguous contexts. Prior works typically rely on binary or pairwise supervision, which often fail to capture the continuous and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Eunkyu Park , Wesley Hanwen Deng , Cheyon Jin , Matheus Kunzler Maldaner , Jordan Wheeler , Jason I. Hong , Hong Shen , Adam Perer , Ken Holstein , Motahhare Eslami , Gunhee Kim

The increasing availability of traffic videos functioning on a 24/7/365 time scale has the great potential of increasing the spatio-temporal coverage of traffic accidents, which will help improve traffic safety. However, analyzing footage…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Ruixuan Zhang , Beichen Wang , Juexiao Zhang , Zilin Bian , Chen Feng , Kaan Ozbay

Safety concerns of Multimodal large language models (MLLMs) have gradually become an important problem in various applications. Surprisingly, previous works indicate a counterintuitive phenomenon that using textual unlearning to align MLLMs…

Cryptography and Security · Computer Science 2025-05-20 Xuhao Hu , Dongrui Liu , Hao Li , Xuanjing Huang , Jing Shao

Improving the multi-step reasoning ability of Large Language Models (LLMs) is a critical yet challenging task. The dominant paradigm, outcome-supervised reinforcement learning (RLVR), rewards only correct final answers, often propagating…

Artificial Intelligence · Computer Science 2025-10-14 Beining Wang , Weihang Su , Hongtao Tian , Tao Yang , Yujia Zhou , Ting Yao , Qingyao Ai , Yiqun Liu

Vision-language reinforcement learning (RL) has primarily focused on narrow domains (e.g. geometry or chart reasoning). This leaves broader training scenarios and resources underexplored, limiting the exploration and learning of Vision…

Recent studies reveal that integrating new modalities into Large Language Models (LLMs), such as Vision-Language Models (VLMs), creates a new attack surface that bypasses existing safety training techniques like Supervised Fine-tuning (SFT)…

Computation and Language · Computer Science 2025-10-15 Trishna Chakraborty , Erfan Shayegani , Zikui Cai , Nael Abu-Ghazaleh , M. Salman Asif , Yue Dong , Amit K. Roy-Chowdhury , Chengyu Song

Large Reasoning Models like DeepSeek-R1 mark a fundamental shift in how LLMs approach complex problems. Instead of directly producing an answer for a given input, DeepSeek-R1 creates detailed multi-step reasoning chains, seemingly…

Multimodal document question answering requires retrieving dispersed evidence from visually rich long documents and performing reliable reasoning over heterogeneous information. Existing multimodal RAG systems remain limited by two…

Information Retrieval · Computer Science 2026-03-18 Jiashu Yang , Chi Zhang , Abudukelimu Wuerkaixi , Xuxin Cheng , Cao Liu , Ke Zeng , Xu Jia , Xunliang Cai

Building on the success of text-based reasoning models like DeepSeek-R1, extending these capabilities to multimodal reasoning holds great promise. While recent works have attempted to adapt DeepSeek-R1-style reinforcement learning (RL)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jie Yang , Feipeng Ma , Zitian Wang , Dacheng Yin , Kang Rong , Fengyun Rao , Ruimao Zhang

Platform content moderation applies explicit policy rules and context-dependent conditions to decide whether user content is allowed, restricted, or removed. A correct moderation outcome must therefore depend on which rules a case…

Artificial Intelligence · Computer Science 2026-05-11 Zhifeng Lu , Dianyuan Wang , Yuhu Shang , Zhenbo Xu

The emergence of Vision-Language Models (VLMs) is a significant advancement in integrating computer vision with Large Language Models (LLMs) to enhance multi-modal machine learning capabilities. However, this progress has also made VLMs…

Artificial Intelligence · Computer Science 2024-12-24 Zaitang Li , Pin-Yu Chen , Tsung-Yi Ho
‹ Prev 1 8 9 10 Next ›