English
Related papers

Related papers: Holistic Unlearning Benchmark: A Multi-Faceted Eva…

200 papers

Large language models (LLMs) inevitably memorize sensitive, copyrighted, and harmful knowledge from the training corpus; therefore, it is crucial to erase this knowledge from the models. Machine unlearning is a promising solution for…

Computation and Language · Computer Science 2024-06-18 Zhuoran Jin , Pengfei Cao , Chenhao Wang , Zhitao He , Hongbang Yuan , Jiachun Li , Yubo Chen , Kang Liu , Jun Zhao

Machine unlearning (MU) is a promising cost-effective method to cleanse undesired information (generated concepts, biases, or patterns) from foundational diffusion models. While MU is orders of magnitude less costly than retraining a…

Machine Learning · Computer Science 2025-07-11 Eric Yeats , Darryl Hannan , Henry Kvinge , Timothy Doster , Scott Mahan

Multimodal large language models (MLLMs) have achieved remarkable success in vision-language tasks, but their reliance on vast, internet-sourced data raises significant privacy and security concerns. Machine unlearning (MU) has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Zhaopan Xu , Pengfei Zhou , Weidong Tang , Jiaxin Ai , Wangbo Zhao , Kai Wang , Xiaojiang Peng , Wenqi Shao , Hongxun Yao , Kaipeng Zhang

Unsupervised visual object tracking is a challenging task that requires following arbitrary targets in videos without training on ground-truth annotations. Despite considerable progress, existing state-of-the-art unsupervised trackers often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Zhengbo Zhang , Zhigang Tu , Junsong Yuan , De Wen Soh , Bo Du

Unsupervised learning of keypoints and landmarks has seen significant progress with the help of modern neural network architectures, but performance is yet to match the supervised counterpart, making their practicability questionable. We…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Eric Hedlin , Gopal Sharma , Shweta Mahajan , Xingzhe He , Hossam Isack , Abhishek Kar Helge Rhodin , Andrea Tagliasacchi , Kwang Moo Yi

Large language models (LLMs) are increasingly deployed in real-world applications, raising concerns about the unauthorized use of copyrighted or sensitive data. Machine unlearning aims to remove such 'forget' data while preserving utility…

Computation and Language · Computer Science 2025-06-03 Wonje Jeung , Sangyeon Yoon , Hyesoo Hong , Soeun Kim , Seungju Han , Youngjae Yu , Albert No

Text-to-image models suffer from various safety issues that may limit their suitability for deployment. Previous methods have separately addressed individual issues of bias, copyright, and offensive content in text-to-image models. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Rohit Gandikota , Hadas Orgad , Yonatan Belinkov , Joanna Materzyńska , David Bau

Security concerns surrounding text-to-image diffusion models have driven researchers to unlearn inappropriate concepts through fine-tuning. Recent fine-tuning methods typically align the prediction distributions of unsafe prompts with those…

Machine Learning · Computer Science 2025-01-03 Mengnan Zhao , Lihe Zhang , Xingyi Yang , Tianhang Zheng , Baocai Yin

Pre-trained Large Language Models (LLMs) have demonstrated remarkable capabilities but also pose risks by learning and generating copyrighted material, leading to significant legal and ethical concerns. In a potential real-world scenario,…

Computation and Language · Computer Science 2025-02-12 Guangyao Dou

The widespread adoption of text-to-image (T2I) diffusion models has raised concerns about their potential to generate copyrighted, inappropriate, or sensitive imagery. As a practical solution, machine unlearning aims to erase unwanted…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Kaiyuan Deng , Bo Hui , Gen Li , Jie Ji , Minghai Qin , Geng Yuan , Xiaolong Ma

The task of "unlearning" certain concepts in large language models (LLMs) has attracted immense attention recently, due to its importance in mitigating undesirable model behaviours, such as the generation of harmful, private, or incorrect…

Computation and Language · Computer Science 2025-09-03 Yihuai Hong , Lei Yu , Haiqin Yang , Shauli Ravfogel , Mor Geva

Machine unlearning for large language models (LLMs) aims to remove undesired data, knowledge, and behaviors (e.g., for safety, privacy, or copyright) while preserving useful model capabilities. Despite rapid progress over the past two…

Machine Learning · Computer Science 2025-10-10 Chongyu Fan , Changsheng Wang , Yancheng Huang , Soumyadeep Pal , Sijia Liu

This work delves into the complexities of machine unlearning in the face of distributional shifts, particularly focusing on the challenges posed by non-uniform feature and label removal. With the advent of regulations like the GDPR…

Machine Learning · Computer Science 2024-03-14 Ling Han , Nanqing Luo , Hao Huang , Jing Chen , Mary-Anne Hartley

Although Multimodal Large Language Models (MLLMs) have achieved remarkable progress across many domains, their training on large-scale multimodal datasets raises serious privacy concerns, making effective machine unlearning increasingly…

Artificial Intelligence · Computer Science 2026-05-08 Yuhang Wang , Wenjie Mei , Junkai Zhang , Guangyu He , Zhenxing Niu , Haichang Gao

Large Language Models (LLMs) trained on extensive corpora inevitably retain sensitive data, such as personal privacy information and copyrighted material. Recent advancements in knowledge unlearning involve updating LLM parameters to erase…

Computation and Language · Computer Science 2024-10-08 Bozhong Tian , Xiaozhuan Liang , Siyuan Cheng , Qingbin Liu , Mengru Wang , Dianbo Sui , Xi Chen , Huajun Chen , Ningyu Zhang

Text-to-image diffusion models have emerged as powerful tools for generating high-quality images from textual descriptions. However, their increasing popularity has raised significant copyright concerns, as these models can be misused to…

Cryptography and Security · Computer Science 2024-11-21 Naen Xu , Changjiang Li , Tianyu Du , Minxi Li , Wenjie Luo , Jiacheng Liang , Yuyuan Li , Xuhong Zhang , Meng Han , Jianwei Yin , Ting Wang

Reliable evaluation benchmarks designed for replicability and comprehensiveness have driven progress in machine learning. Due to the lack of a multilingual benchmark, however, vision-and-language research has mostly focused on English…

Computation and Language · Computer Science 2022-07-19 Emanuele Bugliarello , Fangyu Liu , Jonas Pfeiffer , Siva Reddy , Desmond Elliott , Edoardo Maria Ponti , Ivan Vulić

Despite the remarkable generation capabilities of diffusion models, recent studies have shown that they can memorize and create harmful content when given specific text prompts. Although fine-tuning approaches have been developed to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Siyi Chen , Yimeng Zhang , Sijia Liu , Qing Qu

While large-scale text-to-image diffusion models have demonstrated impressive image-generation capabilities, there are significant concerns about their potential misuse for generating unsafe content, violating copyright, and perpetuating…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Ruchika Chavhan , Da Li , Timothy Hospedales

Large language models (LLMs) have achieved remarkable success across natural language processing tasks, yet their widespread deployment raises pressing concerns around privacy, copyright, security, and bias. Machine unlearning has emerged…

Computation and Language · Computer Science 2026-01-21 Tyler Lizzo , Larry Heck