English
Related papers

Related papers: MIRAGE: Multimodal Immersive Reasoning and Guided …

200 papers

Multimodal Large Language Models (MLLMs) are increasingly used for content moderation, yet their robustness in short-form video contexts remains underexplored. Current safety evaluations often rely on unimodal attacks, failing to address…

Large language models (LLMs) excel in various tasks but remain vulnerable to jailbreak attacks, where adversaries manipulate prompts to generate harmful outputs. Examining jailbreak prompts helps uncover the shortcomings of LLMs. However,…

Computation and Language · Computer Science 2024-12-18 Weixiong Zheng , Peijian Zeng , Yiwei Li , Hongyan Wu , Nankai Lin , Junhao Chen , Aimin Yang , Yongmei Zhou

Autonomous vehicles depend on online HD map construction to perceive lane boundaries, dividers, and pedestrian crossings -- safety-critical road elements that directly govern motion planning. While existing pixel perturbation attacks can…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Chenyi Wang , Ruoyu Song , Raymond Muller , Jean-Philippe Monteuuis , Jonathan Petit , Z. Berkay Celik , Ryan Gerdes , Ming F. Li

Despite substantial advancements in aligning large language models (LLMs) with human values, current safety mechanisms remain susceptible to jailbreak attacks. We hypothesize that this vulnerability stems from distributional discrepancies…

Computation and Language · Computer Science 2026-04-27 Jingyu Peng , Maolin Wang , Nan Wang , Jiatong Li , Yuchen Li , Yuyang Ye , Wanyu Wang , Pengyue Jia , Kai Zhang , Xiangyu Zhao

Large language models (LLMs) remain vulnerable to jailbreak prompts that are fluent and semantically coherent, and therefore difficult to detect with standard heuristics. A particularly challenging failure mode occurs when an attacker tries…

Artificial Intelligence · Computer Science 2026-02-24 Amirhossein Farzam , Majid Behabahani , Mani Malek , Yuriy Nevmyvaka , Guillermo Sapiro

Recent progress in task-optimized neural networks has established encoding models as a powerful tool for predicting brain responses to naturalistic stimuli, yet most existing approaches rely on unimodal representations. The emergence of…

Machine Learning · Computer Science 2026-05-29 Abdulkadir Gokce , Badr AlKhamissi , Martin Schrimpf

Large Language Models (LLMs) have shown impressive capabilities across various tasks but remain vulnerable to meticulously crafted jailbreak attacks. In this paper, we identify a critical safety gap: while LLMs are adept at detecting…

Computation and Language · Computer Science 2025-05-20 Peng Ding , Jun Kuang , Zongyu Wang , Xuezhi Cao , Xunliang Cai , Jiajun Chen , Shujian Huang

As multimodal reasoning improves the overall capabilities of Large Vision Language Models (LVLMs), recent studies have begun to explore safety-oriented reasoning, aiming to enhance safety awareness by analyzing potential safety risks during…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Fenghua Weng , Chaochao Lu , Xia Hu , Wenqi Shao , Wenjie Wang

Multimodal Large Language Models (MLLMs) pose unique safety challenges due to their integration of visual and textual data, thereby introducing new dimensions of potential attacks and complex risk combinations. In this paper, we begin with…

Recently, multimodal large language models (MLLMs) have been widely applied to reasoning tasks. However, they suffer from limited multi-rationale semantic modeling, insufficient logical robustness, and are susceptible to misleading…

Artificial Intelligence · Computer Science 2025-12-08 Chuang Yu , Jinmiao Zhao , Mingxuan Zhao , Yunpeng Liu , Xiujun Shu , Yuanhao Feng , Bo Wang , Xiangyu Yue

Large Language Models (LLMs) have been equipped with safety mechanisms to prevent harmful outputs, but these guardrails can often be bypassed through "jailbreak" prompts. This paper introduces a novel graph-based approach to systematically…

Cryptography and Security · Computer Science 2025-04-18 Sinan He , An Wang

Large Language Models(LLMs) have been successful in numerous fields. Alignment has usually been applied to prevent them from harmful purposes. However, aligned LLMs remain vulnerable to jailbreak attacks that deliberately mislead them into…

Cryptography and Security · Computer Science 2026-02-17 Shang Liu , Hanyu Pei , Zeyan Liu

Defending large language models (LLMs) against jailbreak attacks is crucial for ensuring their safe deployment. Existing defense strategies typically rely on predefined static criteria to differentiate between harmful and benign prompts.…

Cryptography and Security · Computer Science 2025-05-21 Rui Pu , Chaozhuo Li , Rui Ha , Litian Zhang , Lirong Qiu , Xi Zhang

While large language models (LLMs) have demonstrated increasing power, they have also given rise to a wide range of harmful behaviors. As representatives, jailbreak attacks can provoke harmful or unethical responses from LLMs, even after…

Computation and Language · Computer Science 2024-03-01 Nan Xu , Fei Wang , Ben Zhou , Bang Zheng Li , Chaowei Xiao , Muhao Chen

With the rapid advancement of large language models (LLMs), the safety of LLMs has become a critical concern. Despite significant efforts in safety alignment, current LLMs remain vulnerable to jailbreaking attacks. However, the root causes…

Artificial Intelligence · Computer Science 2026-03-10 Yonghong Deng , Zhen Yang , Ping Jian , Xinyue Zhang , Zhongbin Guo , Chengzhi Li

Safeguarding vision-language models (VLMs) is a critical challenge, as existing methods often suffer from over-defense, which harms utility, or rely on shallow alignment, failing to detect complex threats that require deep reasoning. To…

Cryptography and Security · Computer Science 2026-04-03 Nanxi Li , Zhengyue Zhao , G. Edward Suh , Marco Pavone , Chaowei Xiao

Recent advances in Multimodal Large Language Models (MLLMs) have significantly enhanced the naturalness and flexibility of human computer interaction by enabling seamless understanding across text, vision, and audio modalities. Among these,…

Computation and Language · Computer Science 2025-05-27 Binhao Ma , Hanqing Guo , Zhengping Jay Luo , Rui Duan

Large Vision-Language Models (LVLMs) augmented with Retrieval-Augmented Generation (RAG) are increasingly employed in medical AI to enhance factual grounding through external clinical image-text retrieval. However, this reliance creates a…

Machine Learning · Computer Science 2026-01-06 Kaiwen Zuo , Zelin Liu , Raman Dutt , Ziyang Wang , Zhongtian Sun , Fan Mo , Pietro Liò

The trustworthiness of Multimodal Large Language Models (MLLMs) remains an intense concern despite the significant progress in their capabilities. Existing evaluation and mitigation approaches often focus on narrow aspects and overlook…

Computation and Language · Computer Science 2025-08-22 Yichi Zhang , Yao Huang , Yifan Wang , Yitong Sun , Chang Liu , Zhe Zhao , Zhengwei Fang , Huanran Chen , Xiao Yang , Xingxing Wei , Hang Su , Yinpeng Dong , Jun Zhu

Large Language Models (LLMs) have transformed artificial intelligence by advancing natural language understanding and generation, enabling applications across fields beyond healthcare, software engineering, and conversational systems.…