中文
相关论文

相关论文: What makes unlearning hard and what to do about it

200 篇论文

Machine unlearning aims to remove the influence of problematic training data after a model has been trained. The primary challenge in machine unlearning is ensuring that the process effectively removes specified data without compromising…

机器学习 · 计算机科学 2026-03-10 Aviv Shamsian , Eitan Shaar , Aviv Navon , Gal Chechik , Ethan Fetaya

Machine Unlearning has emerged as a significant area of research, focusing on `removing' specific subsets of data from a trained model. Fine-tuning (FT) methods have become one of the fundamental approaches for approximating unlearning, as…

机器学习 · 计算机科学 2025-11-25 Meng Ding , Rohan Sharma , Changyou Chen , Jinhui Xu , Kaiyi Ji

Large Language Models (LLMs) are foundational to AI advancements, facilitating applications like predictive text generation. Nonetheless, they pose risks by potentially memorizing and disseminating sensitive, biased, or copyrighted…

人工智能 · 计算机科学 2024-03-26 Youyang Qu , Ming Ding , Nan Sun , Kanchana Thilakarathna , Tianqing Zhu , Dusit Niyato

Machine Unlearning (MUL) is crucial for privacy protection and content regulation, yet recent studies reveal that traces of forgotten information persist in unlearned models, enabling adversaries to resurface removed knowledge. Existing…

机器学习 · 计算机科学 2025-04-22 Hao Xuan , Xingyu Li

Machine unlearning algorithms aim to remove the influence of specific training samples, ideally recovering the model that would have resulted from training on the remaining data alone. We study unlearning in the overparameterized setting,…

机器学习 · 计算机科学 2025-10-24 Jacob L. Block , Aryan Mokhtari , Sanjay Shakkottai

Machine learning models based on neural networks (NNs) are enjoying ever-increasing attention in the DB community. However, an important issue has been largely overlooked, namely the challenge of dealing with the highly dynamic nature of…

数据库 · 计算机科学 2023-11-30 Meghdad Kurmanji , Eleni Triantafillou , Peter Triantafillou

Despite legal mandates for the right to be forgotten, AI operators routinely fail to comply with data deletion requests. While machine unlearning (MU) provides a technical solution to remove personal data's influence from trained models,…

机器学习 · 计算机科学 2026-02-17 Qinqi Lin , Ningning Ding , Lingjie Duan , Jianwei Huang

Machine unlearning seeks to selectively remove the "influence" of specific training data on a model's outputs. The ideal goal is Retrain Equivalence--behavior identical to a model trained from scratch on only the retained data. This goal…

机器学习 · 计算机科学 2025-10-31 Jiatong Yu , Yinghui He , Anirudh Goyal , Sanjeev Arora

Machine unlearning techniques, which involve retracting data records and reducing influence of said data on trained models, help with the user privacy protection objective but incur significant computational costs. Weight perturbation-based…

机器学习 · 计算机科学 2025-01-16 Zhiwei Zuo , Zhuo Tang , Kenli Li , Anwitaman Datta

Machine unlearning has become an important area of research due to an increasing need for machine learning (ML) applications to comply with the emerging data privacy regulations. It facilitates the provision for removal of certain set or…

机器学习 · 计算机科学 2023-06-01 Vikram S Chundawat , Ayush K Tarun , Murari Mandal , Mohan Kankanhalli

We address the problem of machine unlearning, where the goal is to remove the influence of specific training data from a model upon request, motivated by privacy concerns and regulatory requirements such as the "right to be forgotten."…

机器学习 · 计算机科学 2025-06-12 Anastasia Koloskova , Youssef Allouah , Animesh Jha , Rachid Guerraoui , Sanmi Koyejo

Unlearning in large language models (LLMs) aims to remove specified data, but its efficacy is typically assessed with task-level metrics like accuracy and perplexity. We show that these metrics can be misleading, as models can appear to…

计算与语言 · 计算机科学 2026-05-19 Xiaoyu Xu , Xiang Yue , Yang Liu , Qingqing Ye , Huadi Zheng , Peizhao Hu , Minxin Du , Haibo Hu

Machine unlearning is a prominent and challenging field, driven by regulatory demands for user data deletion and heightened privacy awareness. Existing approaches involve retraining model or multiple finetuning steps for each deletion…

机器学习 · 计算机科学 2024-08-07 Sangamesh Kodge , Gobinda Saha , Kaushik Roy

Machine unlearning (MU) aims to remove the influence of specific training samples from a well-trained model, a task of growing importance due to the ``right to be forgotten.'' The unlearned model should approach the retrained model, where…

机器学习 · 计算机科学 2026-03-10 Xinwen Cheng , Zhehao Huang , Wenxin Zhou , Zhengbao He , Ruikai Yang , Yingwen Wu , Xiaolin Huang

As AI systems become more capable, widely deployed, and increasingly autonomous in critical areas such as cybersecurity, biological research, and healthcare, ensuring their safety and alignment with human values is paramount. Machine…

The growing use of large language models in sensitive domains has exposed a critical weakness: the inability to ensure that private information can be permanently forgotten. Yet these systems still lack reliable mechanisms to guarantee that…

机器学习 · 计算机科学 2025-11-14 James Jin Kang , Dang Bui , Thanh Pham , Huo-Chong Ling

As the right to be forgotten has been legislated worldwide, many studies attempt to design unlearning mechanisms to protect users' privacy when they want to leave machine learning service platforms. Specifically, machine unlearning is to…

密码学与安全 · 计算机科学 2026-04-21 Weiqi Wang , Zhiyi Tian , Chenhan Zhang , Shui Yu

Machine unlearning enables pre-trained models to remove the effect of certain portions of training data. Previous machine unlearning schemes have mainly focused on unlearning a cluster of instances or all instances belonging to a specific…

密码学与安全 · 计算机科学 2024-06-18 Heng Xu , Tianqing Zhu , Wanlei Zhou , Wei Zhao

The deployment of large language models (LLMs) like ChatGPT and Gemini has shown their powerful natural language generation capabilities. However, these models can inadvertently learn and retain sensitive information and harmful content…

密码学与安全 · 计算机科学 2025-10-14 Shang Wang , Tianqing Zhu , Dayong Ye , Wanlei Zhou

Nowadays, machine learning models, especially neural networks, become prevalent in many real-world applications.These models are trained based on a one-way trip from user data: as long as users contribute their data, there is no way to…

机器学习 · 计算机科学 2021-08-03 Yang Liu , Zhuo Ma , Ximeng Liu , Jian Liu , Zhongyuan Jiang , Jianfeng Ma , Philip Yu , Kui Ren