English
Related papers

Related papers: Gaussian Certified Unlearning in High Dimensions: …

200 papers

Machine unlearning focuses on the computationally efficient removal of specific training data from trained models, ensuring that the influence of forgotten data is effectively eliminated without the need for full retraining. Despite…

Machine Learning · Statistics 2025-05-13 Haolin Zou , Arnab Auddy , Yongchan Kwon , Kamiar Rahnama Rad , Arian Maleki

We study the problem of $(\epsilon,\delta)$-certified machine unlearning for minimax models. Most of the existing works focus on unlearning from standard statistical learning models that have a single variable and their unlearning steps…

Machine Learning · Computer Science 2024-10-31 Jiaqi Liu , Jian Lou , Zhan Qin , Kui Ren

We study the fundamental problem of learning the parameters of a high-dimensional Gaussian in the presence of noise -- where an $\varepsilon$-fraction of our samples were chosen by an adversary. We give robust estimators that achieve…

Data Structures and Algorithms · Computer Science 2017-11-07 Ilias Diakonikolas , Gautam Kamath , Daniel M. Kane , Jerry Li , Ankur Moitra , Alistair Stewart

``The right to be forgotten'' ensured by laws for user data privacy becomes increasingly important. Machine unlearning aims to efficiently remove the effect of certain data points on the trained model parameters so that it can be…

Machine Learning · Computer Science 2025-02-04 Eli Chien , Haoyu Wang , Ziang Chen , Pan Li

Certified machine unlearning can be achieved via noise injection leading to differential privacy guarantees, where noise is calibrated to worst-case sensitivity. Such conservative calibration often results in performance degradation,…

Machine Learning · Computer Science 2026-05-25 Hanna Benarroch , Jamal Atif , Olivier Cappé

Certified machine unlearning aims to provably remove the influence of a deletion set $U$ from a model trained on a dataset $S$, by producing an unlearned output that is statistically indistinguishable from retraining on the retain set…

Machine Learning · Computer Science 2026-03-04 Carolin Heinzler , Kasra Malihi , Amartya Sanyal

The Gaussian mechanism is an essential building block used in multitude of differentially private data analysis algorithms. In this paper we revisit the Gaussian mechanism and show that the original analysis has several important…

Machine Learning · Computer Science 2018-06-08 Borja Balle , Yu-Xiang Wang

We address the problem of machine unlearning, where the goal is to remove the influence of specific training data from a model upon request, motivated by privacy concerns and regulatory requirements such as the "right to be forgotten."…

Machine Learning · Computer Science 2025-06-12 Anastasia Koloskova , Youssef Allouah , Animesh Jha , Rachid Guerraoui , Sanmi Koyejo

Certified unlearning based on differential privacy offers strong guarantees but remains largely impractical: the noisy fine-tuning approaches proposed so far achieve these guarantees but severely reduce model accuracy. We propose sequential…

Machine Learning · Computer Science 2026-01-09 Polina Dolgova , Sebastian U. Stich

The Newton method has been widely adopted to achieve certified unlearning. A critical assumption in existing approaches is that the data requested for unlearning are selected i.i.d.(independent and identically distributed). However,the…

Machine Learning · Computer Science 2026-01-13 Jinduo Guo , Yinzhi Cao

Providing accurate uncertainty estimations is essential for producing reliable machine learning models, especially in safety-critical applications such as accelerator systems. Gaussian process models are generally regarded as the gold…

With the growing adoption of data privacy regulations, the ability to erase private or copyrighted information from trained models has become a crucial requirement. Traditional unlearning methods often assume access to the complete training…

Machine Learning · Computer Science 2025-12-22 Umit Yigit Basaran , Sk Miraj Ahmed , Amit Roy-Chowdhury , Basak Guler

In the field of machine unlearning, certified unlearning has been extensively studied in convex machine learning models due to its high efficiency and strong theoretical guarantees. However, its application to deep neural networks (DNNs),…

Machine Learning · Computer Science 2026-04-23 Binchi Zhang , Yushun Dong , Tianhao Wang , Jundong Li

Deep neural networks achieve high prediction accuracy when the train and test distributions coincide. In practice though, various types of corruptions occur which deviate from this setup and cause severe performance degradations. Few…

Machine Learning · Computer Science 2023-05-30 Theodoros Tsiligkaridis , Athanasios Tsiligkaridis

Pairwise Euclidean distance calculation is a fundamental step in many machine learning and data analysis algorithms. In real-world applications, however, these distances are frequently distorted by heteroskedastic noise$\unicode{x2014}$a…

Machine Learning · Statistics 2025-09-12 Keyi Li , Yuval Kluger , Boris Landa

Deep neural networks (DNNs) have achieved remarkable success across diverse domains, but their performance can be severely degraded by noisy or corrupted training data. Conventional noise mitigation methods often rely on explicit…

Machine Learning · Computer Science 2025-06-16 Deliang Jin , Gang Chen , Shuo Feng , Yufeng Ling , Haoran Zhu

Machine unlearning has raised significant interest with the adoption of laws ensuring the ``right to be forgotten''. Researchers have provided a probabilistic notion of approximate unlearning under a similar definition of Differential…

Machine Learning · Computer Science 2025-09-25 Eli Chien , Haoyu Wang , Ziang Chen , Pan Li

Machine unlearning strives to uphold the data owners' right to be forgotten by enabling models to selectively forget specific data. Recent advances suggest pre-computing and storing statistics extracted from second-order information and…

Machine Learning · Computer Science 2025-02-07 Xinbao Qiao , Meng Zhang , Ming Tang , Ermin Wei

Machine Unlearning allows participants to remove their data from a trained machine learning model in order to preserve their privacy, and security. However, the machine unlearning literature for generative models is rather limited. The…

Machine Learning · Computer Science 2025-06-25 Ayush K. Varshney , Vicenç Torra

We investigate unbiased high-dimensional mean estimators in differential privacy. We consider differentially private mechanisms whose expected output equals the mean of the input dataset, for every dataset drawn from a fixed bounded…

Statistics Theory · Mathematics 2023-12-22 Aleksandar Nikolov , Haohua Tang
‹ Prev 1 2 3 10 Next ›