English
Related papers

Related papers: OFMU: Optimization-Driven Framework for Machine Un…

200 papers

Large Language Models (LLMs) inevitably acquire harmful information during training on massive datasets. LLM unlearning aims to eliminate the influence of such harmful information while maintaining the model's overall performance. Existing…

Computation and Language · Computer Science 2025-03-07 Wenyu Wang , Mengqi Zhang , Xiaotian Ye , Zhaochun Ren , Zhumin Chen , Pengjie Ren

There has been a growing interest in Machine Unlearning recently, primarily due to legal requirements such as the General Data Protection Regulation (GDPR) and the California Consumer Privacy Act. Thus, multiple approaches were presented to…

Machine Learning · Computer Science 2022-09-20 Alexander Becker , Thomas Liebig

Despite legal mandates for the right to be forgotten, AI operators routinely fail to comply with data deletion requests. While machine unlearning (MU) provides a technical solution to remove personal data's influence from trained models,…

Machine Learning · Computer Science 2026-02-17 Qinqi Lin , Ningning Ding , Lingjie Duan , Jianwei Huang

Class-level machine unlearning aims to remove the influence of specified classes while preserving model utility on retained classes. Existing methods are commonly evaluated by retain-set accuracy, forget-set accuracy, and unlearning time,…

Machine Learning · Computer Science 2026-05-12 Weidong Zheng , Kongyang Chen , Yuanwei Guo , Yatie Xiao

Large language models (LLMs) frequently memorize sensitive information during training, posing risks when deploying publicly accessible models. Current machine unlearning methods struggle to selectively remove specific data associations…

Computation and Language · Computer Science 2025-04-18 Saransh Agrawal , Kuan-Hao Huang

Machine unlearning seeks to remove the influence of designated training data while preserving performance on the remaining data. Approximate unlearning can be viewed as a local editing problem; in min-max unlearning, the key local object is…

Machine Learning · Computer Science 2026-05-08 Junhao Cai , Dohun Kim , Dowon Kim , Sung Il Choi , Chengjun Jin , Juhyun Park , Changhee Joo

Continual learning in multimodal large language models (MLLMs) aims to sequentially acquire knowledge while mitigating catastrophic forgetting, yet existing methods face inherent limitations: architecture-based approaches incur additional…

Machine Learning · Computer Science 2026-05-15 Yuehao Liu , Shanyan Guan , Weijia Zhang , Xuanming Shang , Yanhao Ge , Wei Li , Chao Ma

Machine unlearning, as a post-hoc processing technique, has gained widespread adoption in addressing challenges like bias mitigation and robustness enhancement, colloquially, machine unlearning for fairness and robustness. However, existing…

Machine Learning · Computer Science 2025-05-27 Xinbao Qiao , Ningning Ding , Yushi Cheng , Meng Zhang

As large language models (LLMs) are increasingly deployed across various applications, privacy and copyright concerns have heightened the need for more effective LLM unlearning techniques. Many existing unlearning methods aim to suppress…

Computation and Language · Computer Science 2025-09-22 Tomoya Yamashita , Akira Ito , Yuuki Yamanaka , Masanori Yamada , Takayuki Miura , Toshiki Shibahara

When introducing Large Language Models (LLMs) into industrial applications, such as healthcare and education, the risk of generating harmful content becomes a significant challenge. While existing machine unlearning methods can erase…

Computation and Language · Computer Science 2026-04-08 Mutsumi Sasaki , Kouta Nakayama , Yusuke Miyao , Yohei Oseki , Masaru Isonuma

Machine unlearning aims to remove specific information, e.g. sensitive or undesirable content, from large language models (LLMs) while preserving overall performance. We propose an inference-time unlearning algorithm that uses contrastive…

Computation and Language · Computer Science 2025-06-17 Vinith M. Suriyakumar , Ayush Sekhari , Ashia Wilson

Machine Unlearning (MU) is an increasingly important topic in machine learning safety, aiming at removing the contribution of a given data point from a training procedure. Federated Unlearning (FU) consists in extending MU to unlearn a…

Machine Learning · Computer Science 2024-03-19 Yann Fraboni , Martin Van Waerebeke , Kevin Scaman , Richard Vidal , Laetitia Kameni , Marco Lorenzi

The past a few years have witnessed the great success of large language models, demonstrating powerful capabilities in comprehending textual data and generating human-like languages. Large language models achieve success by being trained on…

Computation and Language · Computer Science 2025-03-20 Estrid He , Tabinda Sarwar , Ibrahim Khalil , Xun Yi , Ke Wang

Federated learning (FL) enables multiple clients to train a machine learning model collaboratively without exchanging their local data. Federated unlearning is an inverse FL process that aims to remove a specified target client's…

Machine Learning · Computer Science 2023-02-27 Guanghao Li , Li Shen , Yan Sun , Yue Hu , Han Hu , Dacheng Tao

Despite significant progress in safety alignment, large language models (LLMs) remain susceptible to jailbreak attacks. Existing defense mechanisms have not fully deleted harmful knowledge in LLMs, which allows such attacks to bypass…

Computation and Language · Computer Science 2025-05-27 Zesheng Shi , Yucheng Zhou , Jing Li

Machine learning models are vulnerable to adversarial attacks, including attacks that leak information about the model's training data. There has recently been an increase in interest about how to best address privacy concerns, especially…

Machine Learning · Computer Science 2024-05-30 Keltin Grimes , Collin Abidi , Cole Frank , Shannon Gallagher

As multimodal models like CLIP become integral to downstream systems, the need to remove sensitive information is critical. However, machine unlearning for contrastively-trained encoders remains underexplored, and existing evaluations fail…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Cai Selvas-Sala , Lei Kang , Lluis Gomez

Unlearning seeks to remove specific knowledge from large language models (LLMs), but its effectiveness remains contested. On one side, "forgotten" knowledge can often be recovered through interventions such as light fine-tuning; on the…

Computation and Language · Computer Science 2025-09-30 Qingjie Zhang , Haoting Qian , Zhicong Huang , Cheng Hong , Minlie Huang , Ke Xu , Chao Zhang , Han Qiu

The security of biomedical Multimodal Large Language Models (MLLMs) has attracted increasing attention. However, training samples easily contain private information and incorrect knowledge that are difficult to detect, potentially leading…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Dunyuan Xu , Xikai Yang , Yaoqian Li , Jinpeng Li , Pheng-Ann Heng

Learning approaches rely on hyperparameters that impact the algorithm's performance and affect the knowledge extraction process from data. Recently, Nonnegative Matrix Factorization (NMF) has attracted a growing interest as a learning…

Numerical Analysis · Mathematics 2023-06-29 Nicoletta Del Buono , Flavia Esposito , Laura Selicato , Rafal Zdunek