English
Related papers

Related papers: Have you forgotten? A method to assess if machine …

200 papers

Heart rate prediction is vital for personalized health monitoring and fitness, while it frequently faces a critical challenge in real-world deployment: data heterogeneity. We classify it in two key dimensions: source heterogeneity from…

Machine Learning · Computer Science 2026-02-25 Zhengdong Huang , Zicheng Xie , Wentao Tian , Jingyu Liu , Lunhong Dong , Peng Yang

A central challenge in developing versatile machine learning systems is catastrophic forgetting: a model trained on tasks in sequence will suffer significant performance drops on earlier tasks. Despite the ubiquity of catastrophic…

Machine Learning · Computer Science 2020-07-16 Vinay V. Ramasesh , Ethan Dyer , Maithra Raghu

The infrequent occurrence of overfitting in deep neural networks is perplexing: contrary to theoretical expectations, increasing model size often enhances performance in practice. But what if overfitting does occur, though restricted to…

Machine Learning · Computer Science 2025-01-08 Uri Stern , Tomer Yaacoby , Daphna Weinshall

Data heterogeneity plays a pivotal role in determining the performance of machine learning (ML) systems. Traditional algorithms, which are typically designed to optimize average performance, often overlook the intrinsic diversity within…

Machine Learning · Computer Science 2025-06-03 Jiashuo Liu , Peng Cui

In many machine learning for healthcare tasks, standard datasets are constructed by amassing data across many, often fundamentally dissimilar, sources. But when does adding more data help, and when does it hinder progress on desired model…

Machine Learning · Computer Science 2024-08-09 Judy Hanwen Shen , Inioluwa Deborah Raji , Irene Y. Chen

Continual learning consists of algorithms that learn from a stream of data/tasks continuously and adaptively thought time, enabling the incremental development of ever more complex knowledge and skills. The lack of consensus in evaluating…

Artificial Intelligence · Computer Science 2018-11-01 Natalia Díaz-Rodríguez , Vincenzo Lomonaco , David Filliat , Davide Maltoni

Current deep learning methods are regarded as favorable if they empirically perform well on dedicated test sets. This mentality is seamlessly reflected in the resurfacing area of continual learning, where consecutively arriving data is…

Machine Learning · Computer Science 2023-01-25 Martin Mundt , Yongwon Hong , Iuliia Pliushch , Visvanathan Ramesh

Machine unlearning is a crucial tool for enabling a classification model to forget specific data that are used in the training time. Recently, various studies have presented machine unlearning algorithms and evaluated their methods on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Dasol Choi , Dongbin Na

It has been demonstrated that deep neural networks outperform traditional machine learning. However, deep networks lack generalisability, that is, they will not perform as good as in a new (testing) set drawn from a different distribution…

Machine Learning · Computer Science 2022-06-28 Bruno Casella , Alessio Barbaro Chisari , Sebastiano Battiato , Mario Valerio Giuffrida

Catastrophic forgetting remains a formidable obstacle to building an omniscient model in large language models (LLMs). Despite the pioneering research on task-level forgetting in LLM fine-tuning, there is scant focus on forgetting during…

Computation and Language · Computer Science 2024-10-23 Chonghua Liao , Ruobing Xie , Xingwu Sun , Haowen Sun , Zhanhui Kang

Machine learning models are vulnerable to adversarial attacks, including attacks that leak information about the model's training data. There has recently been an increase in interest about how to best address privacy concerns, especially…

Machine Learning · Computer Science 2024-05-30 Keltin Grimes , Collin Abidi , Cole Frank , Shannon Gallagher

As massive medical data become available with an increasing number of scans, expanding classes, and varying sources, prevalent training paradigms -- where AI is trained with multiple passes over fixed, finite datasets -- face significant…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Yu-Cheng Chou , Zongwei Zhou , Alan Yuille

Large language models trained on web-scale corpora can memorize undesirable data containing misinformation, copyrighted material, or private or sensitive information. Recently, several machine unlearning algorithms have been proposed to…

Computation and Language · Computer Science 2025-05-27 Keivan Rezaei , Khyathi Chandu , Soheil Feizi , Yejin Choi , Faeze Brahman , Abhilasha Ravichander

We address the problem of machine unlearning, where the goal is to remove the influence of specific training data from a model upon request, motivated by privacy concerns and regulatory requirements such as the "right to be forgotten."…

Machine Learning · Computer Science 2025-06-12 Anastasia Koloskova , Youssef Allouah , Animesh Jha , Rachid Guerraoui , Sanmi Koyejo

Modern computer systems store vast amounts of personal data, enabling advances in AI and ML but risking user privacy and trust. For privacy reasons, it is sometimes desired for an ML model to forget part of the data it was trained on. In…

Machine Learning · Computer Science 2025-12-30 Amartya Hatua , Trung T. Nguyen , Filip Cano , Andrew H. Sung

A plain well-trained deep learning model often does not have the ability to learn new knowledge without forgetting the previously learned knowledge, which is known as catastrophic forgetting. Here we propose a novel method, SupportNet, to…

Neural and Evolutionary Computing · Computer Science 2018-12-31 Yu Li , Zhongxiao Li , Lizhong Ding , Yijie Pan , Chao Huang , Yuhui Hu , Wei Chen , Xin Gao

Forgetting is often seen as an unwanted characteristic in both human and machine learning. However, we propose that forgetting can in fact be favorable to learning. We introduce "forget-and-relearn" as a powerful paradigm for shaping the…

Machine Learning · Computer Science 2022-02-02 Hattie Zhou , Ankit Vani , Hugo Larochelle , Aaron Courville

Machine unlearning is the process through which a deployed machine learning model is made to forget about some of its training data points. While naively retraining the model from scratch is an option, it is almost always associated with…

Machine Learning · Computer Science 2022-03-03 Anvith Thudi , Gabriel Deza , Varun Chandrasekaran , Nicolas Papernot

Forgetting - or variable elimination - is an operation that allows the removal, from a knowledge base, of middle variables no longer deemed relevant. In recent years, many different approaches for forgetting in Answer Set Programming have…

Artificial Intelligence · Computer Science 2021-12-08 Ricardo Gonçalves , Matthias Knorr , João Leite

Machine unlearning (MU) aims to remove the influence of specific training samples from a well-trained model, a task of growing importance due to the ``right to be forgotten.'' The unlearned model should approach the retrained model, where…

Machine Learning · Computer Science 2026-03-10 Xinwen Cheng , Zhehao Huang , Wenxin Zhou , Zhengbao He , Ruikai Yang , Yingwen Wu , Xiaolin Huang