English
Related papers

Related papers: Risk Awareness Injection: Calibrating Vision-Langu…

200 papers

Large Vision Language Models (VLMs) extend and enhance the perceptual abilities of Large Language Models (LLMs). Despite offering new possibilities for LLM applications, these advancements raise significant security and ethical concerns,…

Machine Learning · Computer Science 2024-07-23 Yi Liu , Chengjun Cai , Xiaoli Zhang , Xingliang Yuan , Cong Wang

Large Language Models (LLMs) have gained widespread adoption across various domains, including chatbots and auto-task completion agents. However, these models are susceptible to safety vulnerabilities such as jailbreaking, prompt injection,…

Cryptography and Security · Computer Science 2024-09-10 Divyanshu Kumar , Anurakt Kumar , Sahil Agarwal , Prashanth Harshangi

With the integration of an additional modality, large vision-language models (LVLMs) exhibit greater vulnerability to safety risks (e.g., jailbreaking) compared to their language-only predecessors. Although recent studies have devoted…

Machine Learning · Computer Science 2025-01-07 Ziwei Zheng , Junyao Zhao , Le Yang , Lijun He , Fan Li

Large language models (LLMs) remain vulnerable to jailbreak prompts that elicit harmful or policy-violating outputs, while many existing defenses rely on expensive fine-tuning, intrusive prompt rewriting, or external guardrails that add…

Cryptography and Security · Computer Science 2026-02-17 Weiming Song , Xuan Xie , Ruiping Yin

While safety mechanisms have significantly progressed in filtering harmful text inputs, MLLMs remain vulnerable to multimodal jailbreaks that exploit their cross-modal reasoning capabilities. We present MIRAGE, a novel multimodal jailbreak…

Computation and Language · Computer Science 2025-03-26 Wenhao You , Bryan Hooi , Yiwei Wang , Youke Wang , Zong Ke , Ming-Hsuan Yang , Zi Huang , Yujun Cai

Multimodal Large Language Models (MLLMs) extend text-only LLMs with visual reasoning, but also introduce new safety failure modes under visually grounded instructions. We study comic-template jailbreaks that embed harmful goals inside…

Cryptography and Security · Computer Science 2026-04-24 Rui Yang Tan , Yujia Hu , Roy Ka-Wei Lee

Vision-language alignment in Large Vision-Language Models (LVLMs) successfully enables LLMs to understand visual input. However, we find that existing vision-language alignment methods fail to transfer the existing safety mechanism for text…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Shicheng Xu , Liang Pang , Yunchang Zhu , Huawei Shen , Xueqi Cheng

Large language models (LLMs) excel in various tasks but remain vulnerable to jailbreak attacks, where adversaries manipulate prompts to generate harmful outputs. Examining jailbreak prompts helps uncover the shortcomings of LLMs. However,…

Computation and Language · Computer Science 2024-12-18 Weixiong Zheng , Peijian Zeng , Yiwei Li , Hongyan Wu , Nankai Lin , Junhao Chen , Aimin Yang , Yongmei Zhou

Vision-Language-Action (VLA) models have achieved remarkable success in robotic manipulation. However, their robustness to linguistic nuances remains a critical, under-explored safety concern, posing a significant safety risk to real-world…

Robotics · Computer Science 2026-04-08 Baoshun Tong , Haoran He , Ling Pan , Yang Liu , Liang Lin

Large Reasoning Models (LRMs) face a distinct safety vulnerability: their internal reasoning chains may generate harmful content even when the final output appears benign. To address this overlooked risk, we first propose a novel attack…

Artificial Intelligence · Computer Science 2026-01-01 Jianhao Chen , Mayi Xu , Haoyang Chen , Xiaohu Li , Xiangyu Zhang , Jianjie Huang , Zheng Wang , Xiaochun Cao , Tieyun Qian

Contextual priming, where earlier stimuli covertly bias later judgments, offers an unexplored attack surface for large language models (LLMs). We uncover a contextual priming vulnerability in which the previous response in the dialogue can…

Computation and Language · Computer Science 2025-11-24 Ziqi Miao , Lijun Li , Yuan Xiong , Zhenhua Liu , Pengyu Zhu , Jing Shao

Visual token compression is widely adopted to improve the inference efficiency of Large Vision-Language Models (LVLMs), enabling their deployment in latency-sensitive and resource-constrained scenarios. However, existing work has mainly…

Cryptography and Security · Computer Science 2026-01-21 Xiaomei Zhang , Zhaoxi Zhang , Leo Yu Zhang , Yanjun Zhang , Guanhong Tao , Shirui Pan

Autonomous driving policy learning with reinforcement learning (RL) is fundamentally limited by low sample efficiency, weak generalization, and a dependence on unsafe online trial-and-error interactions. Although safe RL introduces explicit…

Robotics · Computer Science 2026-03-31 Yansong Qu , Zilin Huang , Zihao Sheng , Jiancong Chen , Yue Leng , Samuel Labi , Sikai Chen

The emergence of vision-language-action models (VLAs) for end-to-end control is reshaping the field of robotics by enabling the fusion of multimodal sensory inputs at the billion-parameter scale. The capabilities of VLAs stem primarily from…

Vision-Language Models (VLMs) have achieved remarkable progress in multimodal reasoning tasks through enhanced chain-of-thought capabilities. However, this advancement also introduces novel safety risks, as these models become increasingly…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yinan Xia , Yilei Jiang , Yingshui Tan , Xiaoyong Zhu , Xiangyu Yue , Bo Zheng

Artificial Intelligence (AI) is revolutionizing scientific research, yet its growing integration into laboratory environments presents critical safety challenges. Large language models (LLMs) and vision language models (VLMs) now assist in…

Vision Language Action (VLA) models close the perception action loop by translating multimodal instructions into executable behaviors, but this very capability magnifies safety risks: jailbreaks that merely yield toxic text in LLMs can…

Robotics · Computer Science 2026-03-24 Siqi Wen , Shu Yang , Shaopeng Fu , Jingfeng Zhang , Lijie Hu , Di Wang

As multimodal reasoning improves the overall capabilities of Large Vision Language Models (LVLMs), recent studies have begun to explore safety-oriented reasoning, aiming to enhance safety awareness by analyzing potential safety risks during…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Fenghua Weng , Chaochao Lu , Xia Hu , Wenqi Shao , Wenjie Wang

Vision-language models (VLMs) often inherit the biases and unsafe associations present within their large-scale training dataset. While recent approaches mitigate unsafe behaviors, their evaluation focuses on how safe the model is on unsafe…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Moreno D'Incà , Elia Peruzzo , Xingqian Xu , Humphrey Shi , Nicu Sebe , Massimiliano Mancini

Robust verbal confidence generated by large language models (LLMs) is crucial for the deployment of LLMs to help ensure transparency, trust, and safety in many applications, including those involving human-AI interactions. In this paper, we…

Computation and Language · Computer Science 2025-12-19 Stephen Obadinma , Xiaodan Zhu
‹ Prev 1 3 4 5 6 7 10 Next ›