中文
相关论文

相关论文: Relationship-Aware Safety Unlearning for Multimoda…

200 篇论文

Large Vision-Language Models (LVLMs) have achieved impressive performance across multimodal understanding and reasoning tasks, yet their internal safety mechanisms remain opaque and poorly controlled. In this work, we present a…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Jinhu Fu , Yihang Lou , Qingyi Si , Shudong Zhang , Yan Bai , Sen Su

Vision-language models (VLMs) may memorize undesirable information from training data, motivating growing interest in machine unlearning. In this work, we present the first systematic survey and robustness analysis of VLM unlearning. We…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Yujie Lin , Kaidi Jia , Jiayao Ma , Chengyi Yang , Jinsong Su

The robust safety of Vision-Language Large Models (VLLMs) against joint multilingual and multimodal threats remains severely underexplored. Current benchmarks typically isolate these dimensions, being either multilingual but text-only, or…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Enyi Shi , Pengyang Shao , Yanxin Zhang , Chenhang Cui , Jiayi Lyu , Xiaobo Xia , Fei Shen , Tat-Seng Chua

Multimodal large language models (MLLMs) have shown impressive reasoning abilities. However, they are also more vulnerable to jailbreak attacks than their LLM predecessors. Although still capable of detecting the unsafe responses, we…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Yunhao Gou , Kai Chen , Zhili Liu , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung , James T. Kwok , Yu Zhang

Large language models (LLMs) possess strong semantic understanding, driving significant progress in data mining applications. This is further enhanced by large reasoning models (LRMs), which provide explicit multi-step reasoning traces. On…

机器学习 · 计算机科学 2026-04-07 Aobo Chen , Chenxu Zhao , Chenglin Miao , Mengdi Huai

Machine unlearning offers a practical alternative to avoid full model re-training by approximately removing the influence of specific user data. While existing methods certify unlearning via statistical indistinguishability from re-trained…

机器学习 · 计算机科学 2026-02-02 Hsiang Hsu , Pradeep Niroula , Zichang He , Ivan Brugere , Freddy Lecue , Chun-Fu Chen

Benefiting from massive corpora and advanced hardware, large language models (LLMs) exhibit remarkable capabilities in language understanding and generation. However, their performance degrades in scenarios where multiple tasks are…

计算与语言 · 计算机科学 2023-10-24 Xiao Wang , Tianze Chen , Qiming Ge , Han Xia , Rong Bao , Rui Zheng , Qi Zhang , Tao Gui , Xuanjing Huang

Recent vision language models (VLMs) have made remarkable strides in generative modeling with multimodal inputs, particularly text and images. However, their susceptibility to generating harmful content when exposed to unsafe queries raises…

人工智能 · 计算机科学 2026-03-06 Yiwei Chen , Yuguang Yao , Yihua Zhang , Bingquan Shen , Gaowen Liu , Sijia Liu

Multimodal large language models (MLLMs) have revolutionized vision-language understanding but remain vulnerable to multimodal jailbreak attacks, where adversarial inputs are meticulously crafted to elicit harmful or inappropriate…

计算与语言 · 计算机科学 2025-02-03 Sejoon Oh , Yiqiao Jin , Megha Sharma , Donghyun Kim , Eric Ma , Gaurav Verma , Srijan Kumar

Recent advances in large-scale diffusion models have intensified concerns about their potential misuse, particularly in generating realistic yet harmful or socially disruptive content. This challenge has spurred growing interest in…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Piotr Wójcik , Maksym Petrenko , Wojciech Gromski , Przemysław Spurek , Maciej Zieba

Laboratories are prone to severe injuries from minor unsafe actions, yet continuous safety monitoring -- beyond mandatory pre-lab safety training -- is limited by human availability. Vision language models (VLMs) offer promise for…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Trishna Chakraborty , Udita Ghosh , Aldair Ernesto Gongora , Ruben Glatt , Yue Dong , Jiachen Li , Amit K. Roy-Chowdhury , Chengyu Song

Recent advances in large-scale text-to-image diffusion models have heightened concerns about their potential misuse, especially in generating harmful or misleading content. This underscores the urgent need for effective machine unlearning,…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Agnieszka Polowczyk , Alicja Polowczyk , Dawid Malarz , Artur Kasymov , Marcin Mazur , Jacek Tabor , Przemysław Spurek

Instruction fine-tuning of large language models (LLMs) is a powerful method for improving task-specific performance, but it can inadvertently lead to a phenomenon where models generate harmful responses when faced with malicious prompts.…

计算与语言 · 计算机科学 2025-08-13 Satya Swaroop Gudipudi , Sreeram Vipparla , Harpreet Singh , Shashwat Goel , Ponnurangam Kumaraguru

Humans are prone to cognitive distortions -- biased thinking patterns that lead to exaggerated responses to specific stimuli, albeit in very different contexts. This paper demonstrates that advanced Multimodal Large Language Models (MLLMs)…

计算与语言 · 计算机科学 2024-06-27 Xirui Li , Hengguang Zhou , Ruochen Wang , Tianyi Zhou , Minhao Cheng , Cho-Jui Hsieh

Large language models (LLMs) possess vast knowledge acquired from extensive training corpora, but they often cannot remove specific pieces of information when needed, which makes it hard to handle privacy, bias mitigation, and knowledge…

机器学习 · 计算机科学 2025-12-09 Yezi Liu , Hanning Chen , Wenjun Huang , Yang Ni , Mohsen Imani

Current LLM unlearning methods face a critical security vulnerability that undermines their fundamental purpose: while they appear to successfully remove sensitive or harmful knowledge, this ``forgotten" information remains precariously…

机器学习 · 计算机科学 2025-10-01 Wenhan Wu , Zheyuan Liu , Chongyang Gao , Ren Wang , Kaize Ding

Traditional approaches to safety event analysis in autonomous systems have relied on complex machine learning models and extensive datasets for high accuracy and reliability. However, the advent of Multimodal Large Language Models (MLLMs)…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Mohammad Abu Tami , Huthaifa I. Ashqar , Mohammed Elhenawy

While Multimodal Large Language Models (MLLMs) have made remarkable progress in vision-language reasoning, they are also more susceptible to producing harmful content compared to models that focus solely on text. Existing defensive…

计算与语言 · 计算机科学 2024-12-30 Yilei Jiang , Yingshui Tan , Xiangyu Yue

The safety alignment ability of Vision-Language Models (VLMs) is prone to be degraded by the integration of the vision module compared to its LLM backbone. We investigate this phenomenon, dubbed as ''safety alignment degradation'' in this…

With the growing deployment of Vision-Language Models (VLMs) in real-world applications, previously overlooked safety risks are becoming increasingly evident. In particular, seemingly innocuous multimodal inputs can combine to reveal…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Youngjin Na , Sangheon Jeong , Youngwan Lee , Jian Lee , Dawoon Jeong , Youngman Kim