中文
相关论文

相关论文: Machine Unlearning with Minimal Gradient Dependenc…

200 篇论文

With the growing adoption of data privacy regulations, the ability to erase private or copyrighted information from trained models has become a crucial requirement. Traditional unlearning methods often assume access to the complete training…

机器学习 · 计算机科学 2025-12-22 Umit Yigit Basaran , Sk Miraj Ahmed , Amit Roy-Chowdhury , Basak Guler

Machine unlearning aims to remove sensitive or undesired data from large language models. However, recent studies suggest that unlearning is often shallow, claiming that removed knowledge can easily be recovered. In this work, we critically…

As Large Language Models (LLMs) grow dramatically in size, there is an increasing trend in compressing and speeding up these models. Previous studies have highlighted the usefulness of gradients for importance scoring in neural network…

计算与语言 · 计算机科学 2024-07-17 Hongrong Cheng , Miao Zhang , Javen Qinfeng Shi

Machine Learning (ML) models have been shown to potentially leak sensitive information, thus raising privacy concerns in ML-driven applications. This inspired recent research on removing the influence of specific data samples from a trained…

机器学习 · 计算机科学 2023-10-30 Youyang Qu , Xin Yuan , Ming Ding , Wei Ni , Thierry Rakotoarivelo , David Smith

Machine learning models leak information about the datasets on which they are trained. An adversary can build an algorithm to trace the individual members of a model's training dataset. As a fundamental inference attack, he aims to…

机器学习 · 统计学 2018-07-17 Milad Nasr , Reza Shokri , Amir Houmansadr

Machine unlearning poses the challenge of ``how to eliminate the influence of specific data from a pretrained model'' in regard to privacy concerns. While prior research on approximated unlearning has demonstrated accuracy and efficiency in…

机器学习 · 计算机科学 2025-04-21 Khoa Tran , Simon S. Woo

The rapid proliferation of image generation models and other artificial intelligence (AI) systems has intensified concerns regarding data privacy and user consent. As the availability of public datasets declines, major technology companies…

Machine Unlearning (MU) aims at removing the influence of specific data points from a trained model, striving to achieve this at a fraction of the cost of full model retraining. In this paper, we analyze the efficiency of unlearning methods…

机器学习 · 统计学 2025-06-24 Martin Van Waerebeke , Marco Lorenzi , Giovanni Neglia , Kevin Scaman

The right to be forgotten states that a data owner has the right to erase their data from an entity storing it. In the context of machine learning (ML), the right to be forgotten requires an ML model owner to remove the data owner's data…

密码学与安全 · 计算机科学 2021-09-15 Min Chen , Zhikun Zhang , Tianhao Wang , Michael Backes , Mathias Humbert , Yang Zhang

Machine unlearning is motivated by desire for data autonomy: a person can request to have their data's influence removed from deployed models, and those models should be updated as if they were retrained without the person's data. We show…

机器学习 · 计算机科学 2024-05-31 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu

Large Language Models (LLMs) are increasingly integrated into real-world applications, raising concerns about privacy, security and the need to remove undesirable knowledge. Machine Unlearning has emerged as a promising solution, yet faces…

机器学习 · 计算机科学 2025-10-22 Yisheng Zhong , Zhengbang Yang , Zhuangdi Zhu

The increasing demand for privacy-preserving machine learning has spurred interest in federated unlearning, which enables the selective removal of data from models trained in federated systems. However, developing federated unlearning…

机器学习 · 计算机科学 2025-05-19 Yang Zhao , Jiaxi Yang , Yiling Tao , Lixu Wang , Xiaoxiao Li , Dusit Niyato , H. Vincent Poor

Driven by privacy protection laws and regulations, unlearning in Large Language Models (LLMs) is gaining increasing attention. However, current research often neglects the interpretability of the unlearning process, particularly concerning…

机器学习 · 计算机科学 2025-04-10 Xiaohua Feng , Yuyuan Li , Chengye Wang , Junlin Liu , Li Zhang , Chaochao Chen

Machine Unlearning (MU) aims at removing the influence of specific data from a pretrained model while preserving performance on the remaining data. In this work, a novel perspective for MU is presented upon low-dimensional feature…

机器学习 · 计算机科学 2026-02-02 Kun Fang , Qinghua Tao , Junxu Liu , Yaxin Xiao , Qingqing Ye , Jian Sun , Haibo Hu

As pretrained models are increasingly shared on the web, ensuring that models can forget or delete sensitive, copyrighted, or private information upon request has become crucial. Machine unlearning has been proposed to address this…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Yurim Jang , Jaeung Lee , Dohyun Kim , Jaemin Jo , Simon S. Woo

Machine unlearning in foundation models (e.g., language and vision transformers) is essential for privacy and safety; however, existing approaches are unstable and unreliable. A widely used strategy, the gradient difference method, applies…

机器学习 · 计算机科学 2026-03-19 Arpit Garg , Hemanth Saratchandran , Ravi Garg , Simon Lucey

Machine unlearning updates machine learning models to remove information from specific training samples, complying with data protection regulations that allow individuals to request the removal of their personal data. Despite the recent…

机器学习 · 计算机科学 2025-11-06 Yiwen Tu , Pingbang Hu , Jiaqi Ma

Machine unlearning refers to the task of removing a subset of training data, thereby removing its contributions to a trained model. Approximate unlearning are one class of methods for this task which avoid the need to retrain the model from…

机器学习 · 计算机科学 2022-09-14 Ambrish Rawat , James Requeima , Wessel Bruinsma , Richard Turner

Once users have shared their data online, it is generally difficult for them to revoke access and ask for the data to be deleted. Machine learning (ML) exacerbates this problem because any model trained with said data may have memorized it,…

The growing use of large language models in sensitive domains has exposed a critical weakness: the inability to ensure that private information can be permanently forgotten. Yet these systems still lack reliable mechanisms to guarantee that…

机器学习 · 计算机科学 2025-11-14 James Jin Kang , Dang Bui , Thanh Pham , Huo-Chong Ling