English
Related papers

Related papers: RedDiffuser: Auditing Multimodal Safety Failures i…

200 papers

Traditional approaches to safety event analysis in autonomous systems have relied on complex machine learning models and extensive datasets for high accuracy and reliability. However, the advent of Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Mohammad Abu Tami , Huthaifa I. Ashqar , Mohammed Elhenawy

Recent progress in multimodal large language models (MLLMs) has demonstrated promising performance on medical benchmarks and in preliminary trials as clinical assistants. Yet, our pilot audit of diagnostic cases uncovers a critical failure…

Artificial Intelligence · Computer Science 2025-09-30 Hongjun Liu , Yinghao Zhu , Yuhui Wang , Yitao Long , Zeyu Lai , Lequan Yu , Chen Zhao

Diffusion-based large language models (dLLMs) have recently emerged as a powerful alternative to autoregressive LLMs, offering faster inference and greater interactivity via parallel decoding and bidirectional modeling. However, despite…

Safety concerns of Multimodal large language models (MLLMs) have gradually become an important problem in various applications. Surprisingly, previous works indicate a counterintuitive phenomenon that using textual unlearning to align MLLMs…

Cryptography and Security · Computer Science 2025-05-20 Xuhao Hu , Dongrui Liu , Hao Li , Xuanjing Huang , Jing Shao

Vision-language models (VLMs) are increasingly deployed in socially sensitive applications, yet their behavior with respect to disability remains underexplored. We study disability aware descriptions for person centric images, where models…

Artificial Intelligence · Computer Science 2026-01-27 Srikant Panda , Sourabh Singh Yadav , Palkesh Malviya

Generating textual rationales from large vision-language models (LVLMs) to support trainable multimodal misinformation detectors has emerged as a promising paradigm. However, its effectiveness is fundamentally limited by three core…

Computation and Language · Computer Science 2025-08-15 Herun Wan , Jiaying Wu , Minnan Luo , Xiangzheng Kong , Zihan Ma , Zhi Zeng

Web applications remain the dominant attack surface in cybersecurity, where vulnerabilities such as SQL injection, XSS, and business logic flaws continue to cause significant data breaches. While penetration testing is effective for…

Cryptography and Security · Computer Science 2026-03-31 Tran Vy Khang , Nguyen Dang Nguyen Khang , Nghi Hoang Khoa , Do Thi Thu Hien , Van-Hau Pham , Phan The Duy

Large language models (LLMs) have demonstrated that large-scale pretraining enables systems to adapt rapidly to new problems with little supervision in the language domain. This success, however, has not translated as effectively to the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Pablo Acuaviva , Aram Davtyan , Mariam Hassan , Sebastian Stapf , Ahmad Rahimi , Alexandre Alahi , Paolo Favaro

Large visual-language models (LVLMs) integrate aligned large language models (LLMs) with visual modules to process multimodal inputs. However, the safety mechanisms developed for text-based LLMs do not naturally extend to visual modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Shen Li , Liuyi Yao , Wujia Niu , Lan Zhang , Yaliang Li

The rapid evolution of Large Vision-Language Models (LVLMs) has highlighted the necessity for comprehensive evaluation frameworks that assess these models across diverse dimensions. While existing benchmarks focus on specific aspects such…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jie Zhang , Zheng Yuan , Zhongqi Wang , Bei Yan , Sibo Wang , Xiangkui Cao , Zonghui Guo , Shiguang Shan , Xilin Chen

Reinforcement Learning with Verifiable Rewards (RLVR) has become a core training stage in recent large language models (LLMs). Its reliance on non-public, high-value prompt sets raises concerns about unauthorized data use, creating a need…

Cryptography and Security · Computer Science 2026-05-12 Yule Liu , Heyi Zhang , Jinyi Zheng , Zhen Sun , Zifan Peng , Jiaheng Wei , Tianshuo Cong , Yilong Yang , Xinlei He

A critical challenge for reinforcement learning (RL) is making decisions based on incomplete and noisy observations, especially in perturbed and partially observable Markov decision processes (P$^2$OMDPs). Existing methods fail to mitigate…

Machine Learning · Computer Science 2025-12-02 Na Li , Hangguan Shan , Wei Ni , Wenjie Zhang , Xinyu Li , Yamin Wang

Unified Multimodal Models (UMMs) have demonstrated remarkable performance in text-to-image generation (T2I) and editing (TI2I), whether instantiated as assembled unified frameworks which couple powerful vision-language model (VLM) with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuxin Song , Wenkai Dong , Shizun Wang , Qi Zhang , Song Xue , Tao Yuan , Hu Yang , Haocheng Feng , Hang Zhou , Xinyan Xiao , Jingdong Wang

Vision-language models (VLMs) predominantly rely on autoregressive decoding, which generates tokens one at a time and fundamentally limits inference throughput. This limitation is especially acute in physical AI scenarios such as robotics…

Computation and Language · Computer Science 2026-04-13 Chengyue Wu , Shiyi Lan , Yonggan Fu , Sensen Gao , Jin Wang , Jincheng Yu , Jose M. Alvarez , Pavlo Molchanov , Ping Luo , Song Han , Ligeng Zhu , Enze Xie

Vision language models (VLMs) extend the reasoning capabilities of large language models (LLMs) to cross-modal settings, yet remain highly vulnerable to multimodal jailbreak attacks. Existing defenses predominantly rely on safety…

Artificial Intelligence · Computer Science 2026-04-14 Mengxuan Wang , Yuxin Chen , Gang Xu , Tao He , Hongjie Jiang , Ming Li

Large Vision Language Models (LVLMs) excel in various vision-language tasks. Yet, their robustness to visual variations in position, scale, orientation, and context that objects in natural scenes inevitably exhibit due to changes in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zhiyuan Fan , Yumeng Wang , Sandeep Polisetty , Yi R. Fung

Vision-Large-Language-models(VLMs) have great application prospects in autonomous driving. Despite the ability of VLMs to comprehend and make decisions in complex scenarios, their integration into safety-critical autonomous driving systems…

Cryptography and Security · Computer Science 2024-04-23 Zhenyang Ni , Rui Ye , Yuxi Wei , Zhen Xiang , Yanfeng Wang , Siheng Chen

Large language models (LLMs) have recently shown strong potential in vulnerability detection (VD). However, accurately detecting vulnerabilities in real-world repositories requires reasoning over complex contextual interactions. Existing…

Cryptography and Security · Computer Science 2026-05-28 Youpeng Li , Fuxun Yu , Weiliang Qi , Xinda Wang

A robust Multimodal Large Language Model (MLLM) for Earth Observation should maintain consistent interpretation and reasoning under realistic input variations. However, current Remote Sensing MLLMs fail to meet this requirement. Trained on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Rui Min , Liang Yao , Shiyu Miao , Shengxiang Xu , Yuxuan Liu , Chuanyi Zhang , Shimin Di , Fan Liu

Large Vision-Language Models face growing safety challenges with multimodal inputs. This paper introduces the concept of Implicit Reasoning Safety, a vulnerability in LVLMs. Benign combined inputs trigger unsafe LVLM outputs due to flawed…

Artificial Intelligence · Computer Science 2025-08-13 Wei Cai , Jian Zhao , Yuchu Jiang , Tianle Zhang , Xuelong Li
‹ Prev 1 4 5 6 7 8 10 Next ›