English
Related papers

Related papers: Relationship-Aware Safety Unlearning for Multimoda…

200 papers

Large Vision-Language Models (LVLMs) have achieved impressive performance across multimodal understanding and reasoning tasks, yet their internal safety mechanisms remain opaque and poorly controlled. In this work, we present a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jinhu Fu , Yihang Lou , Qingyi Si , Shudong Zhang , Yan Bai , Sen Su

Vision-language models (VLMs) may memorize undesirable information from training data, motivating growing interest in machine unlearning. In this work, we present the first systematic survey and robustness analysis of VLM unlearning. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yujie Lin , Kaidi Jia , Jiayao Ma , Chengyi Yang , Jinsong Su

The robust safety of Vision-Language Large Models (VLLMs) against joint multilingual and multimodal threats remains severely underexplored. Current benchmarks typically isolate these dimensions, being either multilingual but text-only, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Enyi Shi , Pengyang Shao , Yanxin Zhang , Chenhang Cui , Jiayi Lyu , Xiaobo Xia , Fei Shen , Tat-Seng Chua

Multimodal large language models (MLLMs) have shown impressive reasoning abilities. However, they are also more vulnerable to jailbreak attacks than their LLM predecessors. Although still capable of detecting the unsafe responses, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Yunhao Gou , Kai Chen , Zhili Liu , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung , James T. Kwok , Yu Zhang

Large language models (LLMs) possess strong semantic understanding, driving significant progress in data mining applications. This is further enhanced by large reasoning models (LRMs), which provide explicit multi-step reasoning traces. On…

Machine Learning · Computer Science 2026-04-07 Aobo Chen , Chenxu Zhao , Chenglin Miao , Mengdi Huai

Machine unlearning offers a practical alternative to avoid full model re-training by approximately removing the influence of specific user data. While existing methods certify unlearning via statistical indistinguishability from re-trained…

Machine Learning · Computer Science 2026-02-02 Hsiang Hsu , Pradeep Niroula , Zichang He , Ivan Brugere , Freddy Lecue , Chun-Fu Chen

Benefiting from massive corpora and advanced hardware, large language models (LLMs) exhibit remarkable capabilities in language understanding and generation. However, their performance degrades in scenarios where multiple tasks are…

Computation and Language · Computer Science 2023-10-24 Xiao Wang , Tianze Chen , Qiming Ge , Han Xia , Rong Bao , Rui Zheng , Qi Zhang , Tao Gui , Xuanjing Huang

Recent vision language models (VLMs) have made remarkable strides in generative modeling with multimodal inputs, particularly text and images. However, their susceptibility to generating harmful content when exposed to unsafe queries raises…

Artificial Intelligence · Computer Science 2026-03-06 Yiwei Chen , Yuguang Yao , Yihua Zhang , Bingquan Shen , Gaowen Liu , Sijia Liu

Multimodal large language models (MLLMs) have revolutionized vision-language understanding but remain vulnerable to multimodal jailbreak attacks, where adversarial inputs are meticulously crafted to elicit harmful or inappropriate…

Computation and Language · Computer Science 2025-02-03 Sejoon Oh , Yiqiao Jin , Megha Sharma , Donghyun Kim , Eric Ma , Gaurav Verma , Srijan Kumar

Recent advances in large-scale diffusion models have intensified concerns about their potential misuse, particularly in generating realistic yet harmful or socially disruptive content. This challenge has spurred growing interest in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Piotr Wójcik , Maksym Petrenko , Wojciech Gromski , Przemysław Spurek , Maciej Zieba

Laboratories are prone to severe injuries from minor unsafe actions, yet continuous safety monitoring -- beyond mandatory pre-lab safety training -- is limited by human availability. Vision language models (VLMs) offer promise for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Trishna Chakraborty , Udita Ghosh , Aldair Ernesto Gongora , Ruben Glatt , Yue Dong , Jiachen Li , Amit K. Roy-Chowdhury , Chengyu Song

Recent advances in large-scale text-to-image diffusion models have heightened concerns about their potential misuse, especially in generating harmful or misleading content. This underscores the urgent need for effective machine unlearning,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Agnieszka Polowczyk , Alicja Polowczyk , Dawid Malarz , Artur Kasymov , Marcin Mazur , Jacek Tabor , Przemysław Spurek

Instruction fine-tuning of large language models (LLMs) is a powerful method for improving task-specific performance, but it can inadvertently lead to a phenomenon where models generate harmful responses when faced with malicious prompts.…

Computation and Language · Computer Science 2025-08-13 Satya Swaroop Gudipudi , Sreeram Vipparla , Harpreet Singh , Shashwat Goel , Ponnurangam Kumaraguru

Humans are prone to cognitive distortions -- biased thinking patterns that lead to exaggerated responses to specific stimuli, albeit in very different contexts. This paper demonstrates that advanced Multimodal Large Language Models (MLLMs)…

Computation and Language · Computer Science 2024-06-27 Xirui Li , Hengguang Zhou , Ruochen Wang , Tianyi Zhou , Minhao Cheng , Cho-Jui Hsieh

Large language models (LLMs) possess vast knowledge acquired from extensive training corpora, but they often cannot remove specific pieces of information when needed, which makes it hard to handle privacy, bias mitigation, and knowledge…

Machine Learning · Computer Science 2025-12-09 Yezi Liu , Hanning Chen , Wenjun Huang , Yang Ni , Mohsen Imani

Current LLM unlearning methods face a critical security vulnerability that undermines their fundamental purpose: while they appear to successfully remove sensitive or harmful knowledge, this ``forgotten" information remains precariously…

Machine Learning · Computer Science 2025-10-01 Wenhan Wu , Zheyuan Liu , Chongyang Gao , Ren Wang , Kaize Ding

Traditional approaches to safety event analysis in autonomous systems have relied on complex machine learning models and extensive datasets for high accuracy and reliability. However, the advent of Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Mohammad Abu Tami , Huthaifa I. Ashqar , Mohammed Elhenawy

While Multimodal Large Language Models (MLLMs) have made remarkable progress in vision-language reasoning, they are also more susceptible to producing harmful content compared to models that focus solely on text. Existing defensive…

Computation and Language · Computer Science 2024-12-30 Yilei Jiang , Yingshui Tan , Xiangyu Yue

The safety alignment ability of Vision-Language Models (VLMs) is prone to be degraded by the integration of the vision module compared to its LLM backbone. We investigate this phenomenon, dubbed as ''safety alignment degradation'' in this…

Computation and Language · Computer Science 2024-10-14 Qin Liu , Chao Shang , Ling Liu , Nikolaos Pappas , Jie Ma , Neha Anna John , Srikanth Doss , Lluis Marquez , Miguel Ballesteros , Yassine Benajiba

With the growing deployment of Vision-Language Models (VLMs) in real-world applications, previously overlooked safety risks are becoming increasingly evident. In particular, seemingly innocuous multimodal inputs can combine to reveal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Youngjin Na , Sangheon Jeong , Youngwan Lee , Jian Lee , Dawoon Jeong , Youngman Kim