中文
相关论文

相关论文: STaR-Attack: A Spatio-Temporal and Narrative Reaso…

200 篇论文

While safety mechanisms have significantly progressed in filtering harmful text inputs, MLLMs remain vulnerable to multimodal jailbreaks that exploit their cross-modal reasoning capabilities. We present MIRAGE, a novel multimodal jailbreak…

计算与语言 · 计算机科学 2025-03-26 Wenhao You , Bryan Hooi , Yiwei Wang , Youke Wang , Zong Ke , Ming-Hsuan Yang , Zi Huang , Yujun Cai

Unified Multimodal Models (UMMs) integrate both visual understanding and generation within a single framework. Their ultimate aspiration is to create a cycle where understanding and generation mutually reinforce each other. While recent…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Zihan Su , Hongyang Wei , Kangrui Cen , Yong Wang , Guanhua Chen , Chun Yuan , Xiangxiang Chu

Recent advances in Large Language Models (LLMs) and Text-to-Image (T2I) models have led to the emergence of Unified Multimodal Models (UMMs), where multimodal understanding and image generation are tightly integrated within a shared…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Kaishen Wang , Heng Huang

Jailbreak attacks on multimodal AI systems remain underexplored, even though unsafe image generation can have more severe consequences than unsafe text and current defenses are relatively immature. We introduce PAST2HARM, a simple yet…

计算与语言 · 计算机科学 2026-05-28 Snehasis Mukhopadhyay

The rapid evolution of multimodal foundation models has led to significant advancements in cross-modal understanding and generation across diverse modalities, including text, images, audio, and video. However, these models remain…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Xuannan Liu , Xing Cui , Peipei Li , Zekun Li , Huaibo Huang , Shuhan Xia , Miaoxuan Zhang , Yueying Zou , Ran He

Multimodal Large Language Models (MLLMs) have become widely deployed, yet their safety alignment remains fragile under adversarial inputs. Previous work has shown that increasing inference steps can disrupt safety mechanisms and lead MLLMs…

计算机视觉与模式识别 · 计算机科学 2026-04-17 Xiangdong Hu , Yangyang Jiang , Qin Hu , Xiaojun Jia

Modern text-to-image (T2I) generation systems (e.g., DALL$\cdot$E 3) exploit the memory mechanism, which captures key information in multi-turn interactions for faithful generation. Despite its practicality, the security analyses of this…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Shiqian Zhao , Jiayang Liu , Yiming Li , Runyi Hu , Xiaojun Jia , Wenshu Fan , Xiao Bao , Xinfeng Li , Jie Zhang , Wei Dong , Tianwei Zhang , Luu Anh Tuan

Multi-turn jailbreak attacks simulate real-world human interactions by engaging large language models (LLMs) in iterative dialogues, exposing critical safety vulnerabilities. However, existing methods often struggle to balance semantic…

Multimodal large language models (MLLMs) exhibit remarkable capabilities but remain susceptible to jailbreak attacks exploiting cross-modal vulnerabilities. In this work, we introduce a novel method that leverages sequential comic-style…

密码学与安全 · 计算机科学 2025-10-20 Deyue Zhang , Dongdong Yang , Junjie Mu , Quancheng Zou , Zonghao Ying , Wenzhuo Xu , Zhao Liu , Xuan Wang , Xiangzheng Zhang

Multimodal large language models (MLLMs) play a pivotal role in advancing the quest for general artificial intelligence. However, achieving unified target for multimodal understanding and generation remains challenging due to optimization…

计算机视觉与模式识别 · 计算机科学 2025-12-17 Jie Qin , Jiancheng Huang , Limeng Qiao , Lin Ma

Recently, unified multimodal models (UMMs) have made remarkable progress in integrating visual understanding and generation, demonstrating strong potential for complex text-to-image (T2I) tasks. Despite their theoretical promise, a…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Jiadong Pan , Liang Li , Yuxin Peng , Yu-Ming Tang , Shuohuan Wang , Yu Sun , Hua Wu , Qingming Huang , Haifeng Wang

Unified multimodal models (UMMs) strive to consolidate visual understanding and visual generation within a single architecture. However, prevailing training paradigms independently optimize understanding via sparse text signals and…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Songsong Yu , Yuxin Chen , Ying Shan , Yanwei Li

Text-to-Image (T2I) models have advanced significantly, but their growing popularity raises security concerns due to their potential to generate harmful images. To address these issues, we propose UPAM, a novel framework to evaluate the…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Duo Peng , Qiuhong Ke , Mark He Huang , Ping Hu , Jun Liu

Large Language Models (LLMs) have evolved into Multimodal Large Language Models (MLLMs), significantly enhancing their capabilities by integrating visual information and other types, thus aligning more closely with the nature of human…

密码学与安全 · 计算机科学 2025-06-03 Youze Wang , Wenbo Hu , Yinpeng Dong , Jing Liu , Hanwang Zhang , Richang Hong

Despite the remarkable generation capabilities of diffusion models, recent studies have shown that they can memorize and create harmful content when given specific text prompts. Although fine-tuning approaches have been developed to…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Siyi Chen , Yimeng Zhang , Sijia Liu , Qing Qu

Large Language Models (LLMs) have demonstrated remarkable performance across a wide range of applications, e.g., medical question-answering, mathematical sciences, and code generation. However, they also exhibit inherent limitations, such…

密码学与安全 · 计算机科学 2025-06-23 Yang Jiao , Xiaodong Wang , Kai Yang

Recent advances in image generation models (IGMs), particularly diffusion-based architectures such as Stable Diffusion (SD), have markedly enhanced the quality and diversity of AI-generated visual content. However, their generative…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Renyang Liu , Guanlin Li , Tianwei Zhang , See-Kiong Ng

Multimodal Large Language Models (MLLMs) are widely used in various fields due to their powerful cross-modal comprehension and generation capabilities. However, more modalities bring more vulnerabilities to being utilized for jailbreak…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Shiji Zhao , Shukun Xiong , Yao Huang , Yan Jin , Zhenyu Wu , Jiyang Guan , Ranjie Duan , Jialing Tao , Hui Xue , Xingxing Wei

Advanced multimodal Retrieval-Augmented Generation (MRAG) techniques have been widely applied to enhance the capabilities of Large Multimodal Models (LMMs), but they also bring along novel safety issues. Existing adversarial research has…

计算机视觉与模式识别 · 计算机科学 2025-11-20 Linyin Luo , Yujuan Ding , Yunshan Ma , Wenqi Fan , Hanjiang Lai

Recent LLMs increasingly integrate reasoning mechanisms like Chain-of-Thought (CoT). However, this explicit reasoning exposes a new attack surface for inference-time backdoors, which inject malicious reasoning paths without altering model…

计算与语言 · 计算机科学 2026-01-14 Seong-Gyu Park , Sohee Park , Jisu Lee , Hyunsik Na , Daeseon Choi
‹ 上一页 1 2 3 10 下一页 ›