English
Related papers

Related papers: Retain-Neutral Surrogates for Min-Max Unlearning

200 papers

As researchers increasingly rely on machine learning models and LLMs to annotate unstructured data, such as texts or images, various approaches have been proposed to correct bias in downstream statistical analysis. However, existing methods…

Machine Learning · Computer Science 2025-12-29 Kentaro Nakamura

A fundamental challenge in machine learning is the choice of a loss as it characterizes our learning task, is minimized in the training phase, and serves as an evaluation criterion for estimators. Proper losses are commonly chosen, ensuring…

Machine Learning · Statistics 2026-03-04 Han Bao , Asuka Takatsu

This paper proposes a technique for training a neural network by minimizing a surrogate loss that approximates the target evaluation metric, which may be non-differentiable. The surrogate is learned via a deep embedding where the Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Yash Patel , Tomas Hodan , Jiri Matas

Machine Unlearning (MU) aims to remove the influence of specific data from a trained model while preserving its performance on the remaining data. Although a few works suggest connections between memorisation and augmentation, the role of…

Machine Learning · Computer Science 2025-08-27 Andreza M. C. Falcao , Filipe R. Cordeiro

Resistive memory (RM) based neuromorphic systems can emulate synaptic plasticity and thus support continual learning, but they generally lack biologically inspired mechanisms for active forgetting, which are critical for meeting modern data…

Machine unlearning aims to remove specific data influences from trained models, a capability essential for adhering to copyright laws and ensuring AI safety. Current unlearning metrics typically measure success by monitoring the model's…

Cryptography and Security · Computer Science 2025-12-24 Hengrui Jia , Taoran Li , Jonas Guan , Varun Chandrasekaran

Machine unlearning, where users can request the deletion of a forget dataset, is becoming increasingly important because of numerous privacy regulations. Initial works on ``exact'' unlearning (e.g., retraining) incur large computational…

Machine Learning · Computer Science 2025-11-17 Ali Ebrahimpour-Boroojeny , Hari Sundaram , Varun Chandrasekaran

Large language models (LLMs) can internalize private or harmful content, motivating unlearning that removes a forget set while preserving retaining knowledge. However, forgetting updates often cause collateral degradation on retaining…

Machine Learning · Computer Science 2026-02-03 Duo Zhou , Yuji Zhang , Tianxin Wei , Ruizhong Qiu , Ke Yang , Xiao Lin , Cheng Qian , Jingrui He , Hanghang Tong , Chengxiang Zhai , Heng Ji , Huan Zhang

As a means to balance the growth of the AI industry with the need for privacy protection, machine unlearning plays a crucial role in realizing the ``right to be forgotten'' in artificial intelligence. This technique enables AI systems to…

Machine Learning · Computer Science 2026-04-22 Eun-Ju Park , Youjin Shin , Simon S. Woo

Session-based recommendation predicts users' future interests from previous interactions in a session. Despite the memorizing of historical samples, the request of unlearning, i.e., to remove the effect of certain training samples, also…

Information Retrieval · Computer Science 2023-12-25 Xin Xin , Liu Yang , Ziqi Zhao , Pengjie Ren , Zhumin Chen , Jun Ma , Zhaochun Ren

Machine unlearning (MUL) refers to the problem of making a pre-trained model selectively forget some training instances or class(es) while retaining performance on the remaining dataset. Existing MUL research involves fine-tuning using a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Soumya Roy , Soumya Banerjee , Vinay Verma , Soumik Dasgupta , Deepak Gupta , Piyush Rai

Machine unlearning is the problem of removing the effect of a subset of training data (the ''forget set'') from a trained model without damaging the model's utility e.g. to comply with users' requests to delete their data, or remove…

Machine Learning · Computer Science 2024-11-01 Kairan Zhao , Meghdad Kurmanji , George-Octavian Bărbulescu , Eleni Triantafillou , Peter Triantafillou

Certified machine unlearning aims to provably remove the influence of a deletion set $U$ from a model trained on a dataset $S$, by producing an unlearned output that is statistically indistinguishable from retraining on the retain set…

Machine Learning · Computer Science 2026-03-04 Carolin Heinzler , Kasra Malihi , Amartya Sanyal

Retargeting human kinematic reference motion onto a robot's morphology remains a formidable challenge. Existing methods often produce physical inconsistencies, such as foot sliding, self-collisions, or dynamically infeasible motions, which…

Robotics · Computer Science 2026-05-08 David Müller , Agon Serifi , Sammy Christen , Ruben Grandia , Espen Knoop , Moritz Bächer

With evolving data regulations, machine unlearning (MU) has become an important tool for fostering trust and safety in today's AI models. However, existing MU methods focusing on data and/or weight perspectives often suffer limitations in…

Machine Learning · Computer Science 2024-04-05 Chongyu Fan , Jiancheng Liu , Yihua Zhang , Eric Wong , Dennis Wei , Sijia Liu

Although Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of tasks, growing concerns have emerged over the misuse of sensitive, copyrighted, or harmful data during training. To address these…

Cryptography and Security · Computer Science 2025-06-03 Jie Ren , Zhenwei Dai , Xianfeng Tang , Yue Xing , Shenglai Zeng , Hui Liu , Jingying Zeng , Qiankun Peng , Samarth Varshney , Suhang Wang , Qi He , Charu C. Aggarwal , Hui Liu

Deep learning has proven to be effective in a wide variety of loss minimization problems. However, many applications of interest, like minimizing projected Bellman error and min-max optimization, cannot be modelled as minimizing a scalar…

Machine Learning · Computer Science 2025-05-27 Ryan D'Orazio , Danilo Vucetic , Zichu Liu , Junhyung Lyle Kim , Ioannis Mitliagkas , Gauthier Gidel

Machine unlearning in foundation models (e.g., language and vision transformers) is essential for privacy and safety; however, existing approaches are unstable and unreliable. A widely used strategy, the gradient difference method, applies…

Machine Learning · Computer Science 2026-03-19 Arpit Garg , Hemanth Saratchandran , Ravi Garg , Simon Lucey

In computer vision, machine unlearning aims to remove the influence of specific visual concepts or training images without retraining from scratch. Studies show that existing approaches often modify the classifier while leaving internal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Anjie Le , Can Peng , Yuyuan Liu , J. Alison Noble

We study an extension of contextual stochastic linear optimization (CSLO) that, in contrast to most of the existing literature, involves inequality constraints that depend on uncertain parameters predicted by a machine learning model. To…

Machine Learning · Computer Science 2025-05-30 Hyungki Im , Wyame Benslimane , Paul Grigas