English
Related papers

Related papers: Train Once, Forget Precisely: Anchored Optimizatio…

200 papers

Lifelong learning algorithms enable models to incrementally acquire new knowledge without forgetting previously learned information. Contrarily, the field of machine unlearning focuses on explicitly forgetting certain previous knowledge…

Machine Learning · Computer Science 2025-05-19 Ozan Özdenizci , Elmar Rueckert , Robert Legenstein

Due to their black-box and data-hungry nature, deep learning techniques are not yet widely adopted for real-world applications in critical domains, like healthcare and justice. This paper presents Memory Wrap, a plug-and-play extension to…

Machine Learning · Computer Science 2023-10-30 Biagio La Rosa , Roberto Capobianco , Daniele Nardi

Despite remarkable successes achieved by modern neural networks in a wide range of applications, these networks perform best in domain-specific stationary environments where they are trained only once on large-scale controlled data…

Neural and Evolutionary Computing · Computer Science 2019-04-23 Pouya Bashivan , Martin Schrimpf , Robert Ajemian , Irina Rish , Matthew Riemer , Yuhai Tu

Machine unlearning, the study of efficiently removing the impact of specific training instances on a model, has garnered increased attention in recent years due to regulatory guidelines such as the \emph{Right to be Forgotten}. Achieving…

Machine Learning · Computer Science 2024-06-07 Martin Pawelczyk , Seth Neel , Himabindu Lakkaraju

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

Machine Learning · Computer Science 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

We present a machine unlearning approach that is both retraining- and label-free. Most existing machine unlearning approaches require a model to be fine-tuned to remove information while preserving performance. This is computationally…

Machine Learning · Computer Science 2024-03-01 Jack Foster , Stefan Schoepf , Alexandra Brintrup

We present HyperMorph, a learning-based strategy for deformable image registration that removes the need to tune important registration hyperparameters during training. Classical registration methods solve an optimization problem to find a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Andrew Hoopes , Malte Hoffmann , Bruce Fischl , John Guttag , Adrian V. Dalca

Real-image super-resolution (Real-ISR) seeks to recover HR images from LR inputs with mixed, unknown degradations. While diffusion models surpass GANs in perceptual quality, they under-reconstruct high-frequency (HF) details due to a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Seungho Choi , Jeahun Sung , Jihyong Oh

The advent of Large Language Models (LLMs) has revolutionized natural language processing, enabling advanced understanding and reasoning capabilities across a variety of tasks. Fine-tuning these models for specific domains, particularly…

Artificial Intelligence · Computer Science 2025-04-21 Chenlu Ding , Jiancan Wu , Yancheng Yuan , Jinda Lu , Kai Zhang , Alex Su , Xiang Wang , Xiangnan He

This paper studies a new design of the optimization algorithm for training deep learning models with a fixed architecture of the classification network in a continual learning framework. The training data is non-stationary and the…

Machine Learning · Computer Science 2022-07-05 Yunfei Teng , Anna Choromanska , Murray Campbell , Songtao Lu , Parikshit Ram , Lior Horesh

Humans accumulate knowledge in a lifelong fashion. Modern deep neural networks, on the other hand, are susceptible to catastrophic forgetting: when adapted to perform new tasks, they often fail to preserve their performance on previously…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Mengyao Zhai , Lei Chen , Jiawei He , Megha Nawhal , Frederick Tung , Greg Mori

Deep networks can learn to accurately recognize objects of a category by training on a large number of annotated images. However, a meta-learning challenge known as a low-shot image recognition task comes when only a few images with…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Mengting Chen , Xinggang Wang , Heng Luo , Yifeng Geng , Wenyu Liu

Machine unlearning, which enables a model to forget specific data, is crucial for ensuring data privacy and model reliability. However, its effectiveness can be severely undermined in real-world scenarios where models learn unintended…

Machine Learning · Computer Science 2026-02-26 JuneHyoung Kwon , MiHyeon Kim , Eunju Lee , Yoonji Lee , Seunghoon Lee , YoungBin Kim

Machine unlearning (MU) has gained significant attention as a means to remove specific data from trained models without requiring a full retraining process. While progress has been made in unimodal domains like text and image…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Tianyu Yang , Lisen Dai , Xiangqi Wang , Minhao Cheng , Yapeng Tian , Xiangliang Zhang

The impressive capability of modern text-to-image models to generate realistic visuals has come with a serious drawback: they can be misused to create harmful, deceptive or unlawful content. This has accelerated the push for machine…

Machine Learning · Computer Science 2025-11-26 Agnieszka Polowczyk , Alicja Polowczyk , Joanna Waczyńska , Piotr Borycki , Przemysław Spurek

We explore the problem of selectively forgetting categories from trained CNN classification models in the federated learning (FL). Given that the data used for training cannot be accessed globally in FL, our insights probe deep into the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Junxiao Wang , Song Guo , Xin Xie , Heng Qi

To comply with AI and data regulations, the need to forget private or copyrighted information from trained machine learning models is increasingly important. The key challenge in unlearning is forgetting the necessary data in a timely…

Machine Learning · Computer Science 2024-12-03 Jack Foster , Kyle Fogarty , Stefan Schoepf , Zack Dugue , Cengiz Öztireli , Alexandra Brintrup

Machine unlearning is the task of updating machine learning (ML) models after a subset of the training data they were trained on is deleted. Methods for the task are desired to combine effectiveness and efficiency, i.e., they should…

Machine Learning · Computer Science 2021-08-17 Ananth Mahadevan , Michael Mathioudakis

Estimating how well a machine learning model performs during inference is critical in a variety of scenarios (for example, to quantify uncertainty, or to choose from a library of available models). However, the standard accuracy estimate of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Xuechen Zhang , Samet Oymak , Jiasi Chen

Machine unlearning methods take a model trained on a dataset and a forget set, then attempt to produce a model as if it had only been trained on the examples not in the forget set. We empirically show that an adversary is able to…

Machine Learning · Computer Science 2025-05-14 Brennon Brimhall , Philip Mathew , Neil Fendley , Yinzhi Cao , Matthew Green