English
Related papers

Related papers: Unlearning with Asymmetric Sources: Improved Unlea…

200 papers

The growing use of large language models in sensitive domains has exposed a critical weakness: the inability to ensure that private information can be permanently forgotten. Yet these systems still lack reliable mechanisms to guarantee that…

Machine Learning · Computer Science 2025-11-14 James Jin Kang , Dang Bui , Thanh Pham , Huo-Chong Ling

Lifelong learning algorithms enable models to incrementally acquire new knowledge without forgetting previously learned information. Contrarily, the field of machine unlearning focuses on explicitly forgetting certain previous knowledge…

Machine Learning · Computer Science 2025-05-19 Ozan Özdenizci , Elmar Rueckert , Robert Legenstein

Machine Unlearning (MU) technology facilitates the removal of the influence of specific data instances from trained models on request. Despite rapid advancements in MU technology, its vulnerabilities are still underexplored, posing…

Machine Learning · Computer Science 2025-06-25 Zhihao Sui , Liang Hu , Jian Cao , Dora D. Liu , Usman Naseem , Zhongyuan Lai , Qi Zhang

Large Language Models (LLMs) inevitably memorize sensitive information during training, posing significant privacy risks. Machine unlearning has emerged as a promising solution to selectively remove such information without full retraining.…

Machine Learning · Computer Science 2026-04-02 Yuze Wang , Yujia Tong , Xuan Liu , Junhao Dong

Today, computer systems hold large amounts of personal data. Yet while such an abundance of data allows breakthroughs in artificial intelligence, and especially machine learning (ML), its existence can be a threat to user privacy, and it…

Despite advances in Preference Alignment (PA) for Large Language Models (LLMs), mainstream methods like Reinforcement Learning with Human Feedback (RLHF) face notable challenges. These approaches require high-quality datasets of positive…

Machine Learning · Computer Science 2025-04-10 Xiaohua Feng , Yuyuan Li , Huwei Ji , Jiaming Zhang , Li Zhang , Tianyu Du , Chaochao Chen

Machine unlearning (MU) seeks to remove the influence of specified data from a trained model in response to privacy requests or data poisoning. While certified unlearning has been analyzed in centralized and server-orchestrated federated…

Machine Learning · Computer Science 2025-12-10 Hithem Lamri , Michail Maniatakos

Large language models (LLMs) exhibit powerful capabilities but risk memorizing sensitive personally identifiable information (PII) from their training data, posing significant privacy concerns. While machine unlearning techniques aim to…

Cryptography and Security · Computer Science 2026-01-23 Xinjie Zhou , Zhihui Yang , Lechao Cheng , Sai Wu , Gang Chen

As large language models (LLMs) are increasingly deployed in real-world systems, they must support post-hoc removal of specific content to meet privacy and governance requirements. This motivates selective unlearning, which suppresses…

Computation and Language · Computer Science 2026-05-28 Chenchen Tan , Xinghao Li , Shujie Cui , Youyang Qu , Cunjian Chen , Longxiang Gao

Large language models (LLMs) often memorize private information during training, raising serious privacy concerns. While machine unlearning has emerged as a promising solution, its true effectiveness against privacy attacks remains unclear.…

Machine Learning · Computer Science 2026-04-27 Xiaoyi Chen , Haoyuan Wang , Siyuan Tang , Sijia Liu , Liya Su , XiaoFeng Wang , Haixu Tang

Large language models trained on web-scale data can memorize private or sensitive knowledge, raising significant privacy risks. Although some unlearning methods mitigate these risks, they remain vulnerable to "relearning" during subsequent…

Machine Learning · Computer Science 2026-03-05 Nakyeong Yang , Dong-Kyum Kim , Jea Kwon , Minsung Kim , Kyomin Jung , Meeyoung Cha

Machine unlearning offers a promising solution to privacy and safety concerns in large language models (LLMs) by selectively removing targeted knowledge while preserving utility. However, current methods are highly sensitive to downstream…

Privacy regulations like the GDPR in Europe and the CCPA in the US allow users the right to remove their data ML applications. Machine unlearning addresses this by modifying the ML parameters in order to forget the influence of a specific…

Cryptography and Security · Computer Science 2024-10-15 Ayush K. Varshney , Vicenç Torra

Machine Unlearning (MU) aims to remove target training data from a trained model so that the removed data no longer influences the model's behavior, fulfilling "right to be forgotten" obligations under data privacy laws. Yet, we observe…

Cryptography and Security · Computer Science 2026-01-27 Jaeung Lee , Suhyeon Yu , Yurim Jang , Simon S. Woo , Jaemin Jo

With the continued advancement and widespread adoption of machine learning (ML) models across various domains, ensuring user privacy and data security has become a paramount concern. In compliance with data privacy regulations, such as…

Machine Learning · Computer Science 2024-07-09 Nexhi Sula , Abhinav Kumar , Jie Hou , Han Wang , Reza Tourani

The increasing demand for privacy-preserving machine learning has spurred interest in federated unlearning, which enables the selective removal of data from models trained in federated systems. However, developing federated unlearning…

Machine Learning · Computer Science 2025-05-19 Yang Zhao , Jiaxi Yang , Yiling Tao , Lixu Wang , Xiaoxiao Li , Dusit Niyato , H. Vincent Poor

Certified unlearning based on differential privacy offers strong guarantees but remains largely impractical: the noisy fine-tuning approaches proposed so far achieve these guarantees but severely reduce model accuracy. We propose sequential…

Machine Learning · Computer Science 2026-01-09 Polina Dolgova , Sebastian U. Stich

We present new mechanisms for \emph{label differential privacy}, a relaxation of differentially private machine learning that only protects the privacy of the labels in the training set. Our mechanisms cluster the examples in the training…

Machine Learning · Computer Science 2021-10-06 Hossein Esfandiari , Vahab Mirrokni , Umar Syed , Sergei Vassilvitskii

Certified machine unlearning can be achieved via noise injection leading to differential privacy guarantees, where noise is calibrated to worst-case sensitivity. Such conservative calibration often results in performance degradation,…

Machine Learning · Computer Science 2026-05-25 Hanna Benarroch , Jamal Atif , Olivier Cappé

Machine learning models are vulnerable to adversarial attacks, including attacks that leak information about the model's training data. There has recently been an increase in interest about how to best address privacy concerns, especially…

Machine Learning · Computer Science 2024-05-30 Keltin Grimes , Collin Abidi , Cole Frank , Shannon Gallagher