English
Related papers

Related papers: A unified PAC-Bayesian framework for machine unlea…

200 papers

Due to growing privacy concerns, machine unlearning, which aims at enabling machine learning models to ``forget" specific training data, has received increasing attention. Among existing methods, influence-based unlearning has emerged as a…

Machine Learning · Computer Science 2025-08-01 Jiawei Liu , Chenwang Wu , Defu Lian , Enhong Chen

As models are getting larger and are trained on increasing amounts of data, there has been an explosion of interest into how we can ``delete'' specific data points or behaviours from a trained model, after the fact. This goal has been…

Machine unlearning is gaining increasing attention as a way to remove adversarial data poisoning attacks from already trained models and to comply with privacy and AI regulations. The objective is to unlearn the effect of undesired data…

Machine Learning · Computer Science 2024-12-03 Jose Miguel Lara Rangel , Stefan Schoepf , Jack Foster , David Krueger , Usman Anwar

In the rapid advancement of artificial intelligence, privacy protection has become crucial, giving rise to machine unlearning. Machine unlearning is a technique that removes specific data influences from trained models without the need for…

Machine Learning · Computer Science 2025-06-23 Wenhan Chang , Tianqing Zhu , Ping Xiong , Yufeng Wu , Faqian Guan , Wanlei Zhou

Given the prevalence of large language models (LLMs) and the prohibitive cost of training these models from scratch, dynamically forgetting specific knowledge e.g., private or proprietary, without retraining the model has become an…

Computation and Language · Computer Science 2024-08-09 Tyler Lizzo , Larry Heck

We study the problem of deleting user data from machine learning models trained using empirical risk minimization. Our focus is on learning algorithms which return the empirical risk minimizer and approximate unlearning algorithms that…

Machine Learning · Statistics 2022-09-27 Vinith M. Suriyakumar , Ashia C. Wilson

Quantum Machine Unlearning has emerged as a foundational challenge at the intersection of quantum information theory privacypreserving computation and trustworthy artificial intelligence This paper advances QMU by establishing a formal…

Quantum Physics · Physics 2026-01-14 Thanveer Shaik , Xiaohui Tao , Haoran Xie

Machine unlearning aims to efficiently eliminate the memory about deleted data from trained models and address the right to be forgotten. Despite the success of existing unlearning algorithms, unlearning in sparse models has not yet been…

Machine Learning · Computer Science 2025-12-04 Yang Xiao , Gen Li , Jie Ji , Ruimeng Ye , Xiaolong Ma , Bo Hui

Machine unlearning algorithms aim to efficiently remove data from a model without retraining it from scratch, in order to remove corrupted or outdated data or respect a user's ``right to be forgotten." Certified machine unlearning is a…

Machine Learning · Computer Science 2025-12-16 Siqiao Mu , Diego Klabjan

Recent legislation of the "right to be forgotten" has led to the interest in machine unlearning, where the learned models are endowed with the function to forget information about specific training instances as if they have never existed in…

Computation and Language · Computer Science 2023-05-12 Lingzhi Wang , Tong Chen , Wei Yuan , Xingshan Zeng , Kam-Fai Wong , Hongzhi Yin

The trustworthy machine learning (ML) community is increasingly recognizing the crucial need for models capable of selectively 'unlearning' data points after training. This leads to the problem of machine unlearning (MU), aiming to…

Machine Learning · Computer Science 2024-07-10 Chongyu Fan , Jiancheng Liu , Alfred Hero , Sijia Liu

Machine unlearning seeks to selectively remove the "influence" of specific training data on a model's outputs. The ideal goal is Retrain Equivalence--behavior identical to a model trained from scratch on only the retained data. This goal…

Machine Learning · Computer Science 2025-10-31 Jiatong Yu , Yinghui He , Anirudh Goyal , Sanjeev Arora

Large Language Models (LLMs) offer extensive knowledge across various domains, but they may inadvertently memorize sensitive, unauthorized, or malicious data, such as personal information in the medical and financial sectors. Machine…

Computation and Language · Computer Science 2024-10-16 YuXuan Wu , Bonaventure F. P. Dossou , Dianbo Liu

Recently machine unlearning (MU) is proposed to remove the imprints of revoked samples from the already trained model parameters, to solve users' privacy concern. Different from the runtime expensive retraining from scratch, there exist two…

Machine Learning · Computer Science 2024-12-20 Mingxin Li , Yizhen Yu , Ning Wang , Zhigang Wang , Xiaodong Wang , Haipeng Qu , Jia Xu , Shen Su , Zhichao Yin

In the context of machine unlearning, the primary challenge lies in effectively removing traces of private data from trained models while maintaining model performance and security against privacy attacks like membership inference attacks.…

Machine Learning · Computer Science 2024-06-26 Tao Huang , Ziyang Chen , Jiayang Meng , Qingyu Huang , Xu Yang , Xun Yi , Ibrahim Khalil

Our goal is to learn control policies for robots that provably generalize well to novel environments given a dataset of example environments. The key technical idea behind our approach is to leverage tools from generalization theory in…

Robotics · Computer Science 2020-08-27 Anirudha Majumdar , Alec Farid , Anoopkumar Sonar

We derive a novel PAC-Bayesian generalization bound for reinforcement learning that explicitly accounts for Markov dependencies in the data, through the chain's mixing time. This contributes to overcoming challenges in obtaining…

Machine Learning · Computer Science 2026-02-10 Abdelkrim Zitouni , Mehdi Hennequin , Juba Agoun , Ryan Horache , Nadia Kabachi , Omar Rivasplata

Machine unlearning, the process of selectively removing data from trained models, is increasingly crucial for addressing privacy concerns and knowledge gaps post-deployment. Despite this importance, existing approaches are often heuristic…

Machine Learning · Computer Science 2025-02-13 Youssef Allouah , Joshua Kazdan , Rachid Guerraoui , Sanmi Koyejo

In parametric Bayesian learning, a prior is assumed on the parameter $W$ which determines the distribution of samples. In this setting, Minimum Excess Risk (MER) is defined as the difference between the minimum expected loss achievable when…

Machine Learning · Computer Science 2021-07-20 Hassan Hafez-Kolahi , Behrad Moniri , Shohreh Kasaei , Mahdieh Soleymani Baghshah

Large language models trained on web-scale corpora can memorize undesirable data containing misinformation, copyrighted material, or private or sensitive information. Recently, several machine unlearning algorithms have been proposed to…

Computation and Language · Computer Science 2025-05-27 Keivan Rezaei , Khyathi Chandu , Soheil Feizi , Yejin Choi , Faeze Brahman , Abhilasha Ravichander