中文
相关论文

相关论文: Forget by Uncertainty: Orthogonal Entropy Unlearni…

200 篇论文

Machine unlearning is gaining increasing attention as a way to remove adversarial data poisoning attacks from already trained models and to comply with privacy and AI regulations. The objective is to unlearn the effect of undesired data…

机器学习 · 计算机科学 2024-12-03 Jose Miguel Lara Rangel , Stefan Schoepf , Jack Foster , David Krueger , Usman Anwar

Modern computer systems store vast amounts of personal data, enabling advances in AI and ML but risking user privacy and trust. For privacy reasons, it is sometimes desired for an ML model to forget part of the data it was trained on. In…

机器学习 · 计算机科学 2025-12-30 Amartya Hatua , Trung T. Nguyen , Filip Cano , Andrew H. Sung

Machine unlearning has great significance in guaranteeing model security and protecting user privacy. Additionally, many legal provisions clearly stipulate that users have the right to demand model providers to delete their own data from…

机器学习 · 计算机科学 2021-05-14 Yingzhe He , Guozhu Meng , Kai Chen , Jinwen He , Xingbo Hu

Orthogonal Gradient Descent (OGD) has emerged as a powerful method for continual learning. However, its Euclidean projections do not leverage the underlying information-geometric structure of the problem, which can lead to suboptimal…

机器学习 · 计算机科学 2025-12-09 Yajat Yadav , Patrick Mendoza , Jathin Korrapati

Optimization with matrix gradient orthogonalization has recently demonstrated impressive results in the training of deep neural networks (Jordan et al., 2024; Liu et al., 2025). In this paper, we provide a theoretical analysis of this…

机器学习 · 计算机科学 2025-04-09 Dmitry Kovalev

Large Language Models (LLMs) have demonstrated strong capabilities in memorizing vast amounts of knowledge across diverse domains. However, the ability to selectively forget specific knowledge is critical for ensuring the safety and…

计算与语言 · 计算机科学 2025-05-20 Zhijie Deng , Chris Yuhao Liu , Zirui Pang , Xinlei He , Lei Feng , Qi Xuan , Zhaowei Zhu , Jiaheng Wei

Tree ensembles are widely recognized for their effectiveness in classification tasks, achieving state-of-the-art performance across diverse domains, including bioinformatics, finance, and medical diagnosis. With increasing emphasis on data…

机器学习 · 计算机科学 2025-09-01 Ziheng Chen , Jin Huang , Jiali Cheng , Yuchan Guo , Mengjie Wang , Lalitesh Morishetti , Kaushiki Nag , Hadi Amiri

``The right to be forgotten'' ensured by laws for user data privacy becomes increasingly important. Machine unlearning aims to efficiently remove the effect of certain data points on the trained model parameters so that it can be…

机器学习 · 计算机科学 2025-02-04 Eli Chien , Haoyu Wang , Ziang Chen , Pan Li

Unlearning in Large Language Models (LLMs) aims to enhance safety, mitigate biases, and comply with legal mandates, such as the right to be forgotten. However, existing unlearning methods are brittle: minor query modifications, such as…

人工智能 · 计算机科学 2026-03-13 Raj Sanjay Shah , Jing Huang , Keerthiram Murugesan , Nathalie Baracaldo , Diyi Yang

We consider the problem of learning multiple tasks in a continual learning setting in which data from different tasks is presented to the learner in a streaming fashion. A key challenge in this setting is the so-called "catastrophic…

机器学习 · 计算机科学 2023-09-22 Christiaan Lamers , Rene Vidal , Nabil Belbachir , Niki van Stein , Thomas Baeck , Paris Giampouras

In computer vision, machine unlearning aims to remove the influence of specific visual concepts or training images without retraining from scratch. Studies show that existing approaches often modify the classifier while leaving internal…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Anjie Le , Can Peng , Yuyuan Liu , J. Alison Noble

Large language models (LLMs) exhibit remarkable generative capabilities but raise ethical and security concerns by memorizing sensitive data, reinforcing biases, and producing harmful content. These risks have spurred interest in LLM…

机器学习 · 计算机科学 2025-10-13 Changsheng Wang , Yihua Zhang , Dennis Wei , Jinghan Jia , Pin-Yu Chen , Sijia Liu

With the introduction of data protection and privacy regulations, it has become crucial to remove the lineage of data on demand from a machine learning (ML) model. In the last few years, there have been notable developments in machine…

机器学习 · 计算机科学 2023-06-01 Ayush K Tarun , Vikram S Chundawat , Murari Mandal , Mohan Kankanhalli

Machine unlearning (MU) aims to remove the influence of specific data from a trained model. However, approximate unlearning methods, often formulated as a single-objective optimization (SOO) problem, face a critical trade-off between…

机器学习 · 计算机科学 2025-10-23 Youngsik Hwang , Dong-Young Lim

Federated Learning (FL) has received much attention in recent years. However, although clients are not required to share their data in FL, the global model itself can implicitly remember clients' local data. Therefore, it's necessary to…

机器学习 · 计算机科学 2024-12-31 Zibin Pan , Zhichao Wang , Chi Li , Kaiyan Zheng , Boqi Wang , Xiaoying Tang , Junhua Zhao

Continual learning (CL) presents a fundamental challenge in training neural networks on sequential tasks without experiencing catastrophic forgetting. Traditionally, the dominant approach in CL has been gradient-based optimization, where…

机器学习 · 计算机科学 2025-04-03 Grzegorz Rypeść

Lifelong learning algorithms enable models to incrementally acquire new knowledge without forgetting previously learned information. Contrarily, the field of machine unlearning focuses on explicitly forgetting certain previous knowledge…

机器学习 · 计算机科学 2025-05-19 Ozan Özdenizci , Elmar Rueckert , Robert Legenstein

Machine unlearning has raised significant interest with the adoption of laws ensuring the ``right to be forgotten''. Researchers have provided a probabilistic notion of approximate unlearning under a similar definition of Differential…

机器学习 · 计算机科学 2025-09-25 Eli Chien , Haoyu Wang , Ziang Chen , Pan Li

The right to be forgotten mandates that machine learning models enable the erasure of a data owner's data and information from a trained model. Removing data from the dataset alone is inadequate, as machine learning models can memorize…

机器学习 · 计算机科学 2024-10-16 Xiaoyu Xia , Ziqi Wang , Ruoxi Sun , Bowen Liu , Ibrahim Khalil , Minhui Xue

Ensuring the reliability and safety of machine learning models in open-world deployment is a central challenge in AI safety. This thesis develops both algorithmic and theoretical foundations to address key reliability issues arising from…

机器学习 · 计算机科学 2025-05-22 Xuefeng Du