English
Related papers

Related papers: Unlearning Sensitive Information in Multimodal LLM…

200 papers

Machine unlearning (MU) for large language models (LLMs), commonly referred to as LLM unlearning, seeks to remove specific undesirable data or knowledge from a trained model, while maintaining its performance on standard tasks. While…

Machine Learning · Computer Science 2026-03-03 Yiwei Chen , Soumyadeep Pal , Yimeng Zhang , Qing Qu , Sijia Liu

The core challenge of machine unlearning is to strike a balance between target knowledge removal and non-target knowledge retention. In the context of Multimodal Large Language Models (MLLMs), this challenge becomes even more pronounced, as…

Artificial Intelligence · Computer Science 2026-05-08 Yuhang Wang , Zhenxing Niu , Haoxuan Ji , Guangyu He , Linlin Zhang , Haichang Gao

Large language model (LLM) unlearning has become a critical mechanism for removing undesired data, knowledge, or behaviors from pre-trained models while retaining their general utility. Yet, with the rise of open-weight LLMs, we ask: can…

Machine Learning · Computer Science 2025-10-21 Bingqi Shang , Yiwei Chen , Yihua Zhang , Bingquan Shen , Sijia Liu

Multimodal large language models (MLLMs) have become integral to a wide range of real-world applications by jointly reasoning over text and visual inputs. However, despite recent advances in safety alignment, MLLMs remain vulnerable to…

Cryptography and Security · Computer Science 2026-03-10 Xinkai Wang , Beibei Li , Zerui Shao , Ao Liu , Guangquan Xu , Shouling Ji

Large language models (LLMs) have recently revolutionized language processing tasks but have also brought ethical and legal issues. LLMs have a tendency to memorize potentially private or copyrighted information present in the training…

Machine Learning · Computer Science 2025-07-21 Tamim Al Mahmud , Najeeb Jebreel , Josep Domingo-Ferrer , David Sanchez

Jailbreaking attacks can enable Large Language Models (LLMs) to bypass the safeguard and generate harmful content. Existing jailbreaking defense methods have failed to address the fundamental issue that harmful knowledge resides within the…

Computation and Language · Computer Science 2024-07-04 Weikai Lu , Ziqian Zeng , Jianwei Wang , Zhengdong Lu , Zelin Chen , Huiping Zhuang , Cen Chen

Multimodal large language models (MLLMs) have achieved rapid progress, yet their scaling behavior remains less clearly characterized and often less predictable than that of text-only LLMs. Increasing model size and task diversity often…

Computation and Language · Computer Science 2026-04-16 Hongjian Zou , Yue Ge , Qi Ding , Yixuan Liao , Xiaoxin Chen

Multimodal Large Language Models (MLLMs) have endowed LLMs with the ability to perceive and understand multi-modal signals. However, most of the existing MLLMs mainly adopt vision encoders pretrained on coarsely aligned image-text pairs,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Gongwei Chen , Leyang Shen , Rui Shao , Xiang Deng , Liqiang Nie

Generative multimodal models can exhibit safety failures that are inherently relational: two benign concepts can become unsafe when linked by a specific action or relation (e.g., child-drinking-wine). Existing unlearning and concept-erasure…

Artificial Intelligence · Computer Science 2026-03-26 Vishnu Narayanan Anilkumar , Abhijith Sreesylesh Babu , Trieu Hai Vo , Mohankrishna Kolla , Alexander Cuneo

Unlearning in Large Language Models (LLMs) is crucial for protecting private data and removing harmful knowledge. Most existing approaches rely on fine-tuning to balance unlearning efficiency with general language capabilities. However,…

Computation and Language · Computer Science 2025-11-12 Yaxuan Wang , Chris Yuhao Liu , Quan Liu , Jinglong Pang , Wei Wei , Yujia Bao , Yang Liu

While Large Language Models (LLMs) have demonstrated impressive performance in various domains and tasks, concerns about their safety are becoming increasingly severe. In particular, since models may store unsafe knowledge internally,…

Machine Learning · Computer Science 2025-08-22 Chengcan Wu , Zeming Wei , Huanran Chen , Yinpeng Dong , Meng Sun

As AI models are trained on ever-expanding datasets, the ability to remove the influence of specific data from trained models has become essential for privacy protection and regulatory compliance. Unlearning addresses this challenge by…

Artificial Intelligence · Computer Science 2026-01-21 Shizhou Xu , Yuan Ni , Stefan Broecker , Thomas Strohmer

The explosive growth of multimodal data has driven the rapid development of multimodal entity linking (MEL) models. However, existing studies have not systematically investigated the impact of visual adversarial attacks on MEL models. We…

Information Retrieval · Computer Science 2025-08-22 Fang Wang , Yongjie Wang , Zonghao Yang , Minghao Hu , Xiaoying Bai

Vision-Language Models (VLMs) have shown remarkable performance, yet their security remains insufficiently understood. Existing adversarial studies focus almost exclusively on the digital setting, leaving physical-world threats largely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yingying Zhao , Chengyin Hu , Qike Zhang , Xin Li , Xin Wang , Yiwei Wei , Jiujiang Guo , Jiahuan Long , Tingsong Jiang , Wen Yao

Language models (LMs) risk inadvertently memorizing and divulging sensitive or personally identifiable information (PII) seen in training data, causing privacy concerns. Current approaches to address this issue involve costly dataset…

Computation and Language · Computer Science 2025-09-09 Tomer Ashuach , Martin Tutek , Yonatan Belinkov

Multi-modal large language models (MLLMs), capable of processing text, images, and audio, have been widely adopted in various AI applications. However, recent MLLMs integrating images and text remain highly vulnerable to coordinated…

Cryptography and Security · Computer Science 2025-12-19 Zihao Wang , Kar Wai Fok , Vrizlynn L. L. Thing

Driven by privacy protection laws and regulations, unlearning in Large Language Models (LLMs) is gaining increasing attention. However, current research often neglects the interpretability of the unlearning process, particularly concerning…

Machine Learning · Computer Science 2025-04-10 Xiaohua Feng , Yuyuan Li , Chengye Wang , Junlin Liu , Li Zhang , Chaochao Chen

Multimodal large language models (MLLMs) excel in vision-language tasks but also pose significant risks of generating harmful content, particularly through jailbreak attacks. Jailbreak attacks refer to intentional manipulations that bypass…

Cryptography and Security · Computer Science 2025-07-18 Yi Nian , Shenzhe Zhu , Yuehan Qin , Li Li , Ziyi Wang , Chaowei Xiao , Yue Zhao

Large language models (LLMs) serve as giant information stores, often including personal or copyrighted data, and retraining them from scratch is not a viable option. This has led to the development of various fast, approximate unlearning…

Computation and Language · Computer Science 2024-10-18 Minseok Choi , ChaeHun Park , Dohyun Lee , Jaegul Choo

Objectives: The rapid advancement of Multimodal Large Language Models (MLLMs) has significantly enhanced their reasoning capabilities, enabling a wide range of intelligent applications. However, these advancements also raise critical…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Xian Zhang , Xiang Cheng