English
Related papers

Related papers: Label Leakage Attacks in Machine Unlearning: A Par…

200 papers

Cybersecurity is a domain where there is constant change in patterns of attack, and we need ways to make our Cybersecurity systems more adaptive to handle new attacks and categorize for appropriate action. We present a novel approach to…

Cryptography and Security · Computer Science 2021-06-29 Dattaraj Rao , Shraddha Mane

Modern privacy regulations grant citizens the right to be forgotten by products, services and companies. In case of machine learning (ML) applications, this necessitates deletion of data not only from storage archives but also from ML…

Machine Learning · Computer Science 2023-06-01 Vikram S Chundawat , Ayush K Tarun , Murari Mandal , Mohan Kankanhalli

As pretrained models are increasingly shared on the web, ensuring that models can forget or delete sensitive, copyrighted, or private information upon request has become crucial. Machine unlearning has been proposed to address this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yurim Jang , Jaeung Lee , Dohyun Kim , Jaemin Jo , Simon S. Woo

Backdoor attacks compromise the integrity and reliability of machine learning models by embedding a hidden trigger during the training process, which can later be activated to cause unintended misbehavior. We propose a novel backdoor…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Felix Hsieh , Huy H. Nguyen , AprilPyone MaungMaung , Dmitrii Usynin , Isao Echizen

Machine unlearning (MU) aims to expunge a designated forget set from a trained model without costly retraining, yet the existing techniques overlook two critical blind spots: "over-unlearning" that deteriorates retained data near the forget…

Machine Learning · Computer Science 2026-02-02 SeungBum Ha , Saerom Park , Sung Whan Yoon

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases. In this paper, we…

Machine Learning · Computer Science 2023-12-27 Yixuan Zhang , Boyu Li , Zenan Ling , Feng Zhou

Machine unlearning -- efficiently removing the effect of a small "forget set" of training data on a pre-trained machine learning model -- has recently attracted significant research interest. Despite this interest, however, recent work…

Machine Learning · Computer Science 2024-11-13 Kristian Georgiev , Roy Rinberg , Sung Min Park , Shivam Garg , Andrew Ilyas , Aleksander Madry , Seth Neel

With the development of information science and technology, various industries have generated massive amounts of data, and machine learning is widely used in the analysis of big data. However, if the privacy of machine learning…

Cryptography and Security · Computer Science 2023-01-11 Jingyi Ge

Machine unlearning has garnered significant attention due to its ability to selectively erase knowledge obtained from specific training data samples in an already trained machine learning model. This capability enables data holders to…

Machine Learning · Computer Science 2024-03-13 Vinay Chakravarthi Gogineni , Esmaeil S. Nadimi

Recently enacted legislation grants individuals certain rights to decide in what fashion their personal data may be used, and in particular a "right to be forgotten". This poses a challenge to machine learning: how to proceed when an…

Machine Learning · Computer Science 2020-07-09 Thomas Baumhauer , Pascal Schöttle , Matthias Zeppelzauer

Sequence models, such as Large Language Models (LLMs) and autoregressive image generators, have a tendency to memorize and inadvertently leak sensitive information. While this tendency has critical legal implications, existing tools are…

Cryptography and Security · Computer Science 2025-06-06 Lorenzo Rossi , Michael Aerni , Jie Zhang , Florian Tramèr

Machine unlearning has emerged as a new paradigm to deliberately forget data samples from a given model in order to adhere to stringent regulations. However, existing machine unlearning methods have been primarily focused on classification…

Machine Learning · Computer Science 2024-02-05 Guihong Li , Hsiang Hsu , Chun-Fu Chen , Radu Marculescu

We address the problem of machine unlearning, where the goal is to remove the influence of specific training data from a model upon request, motivated by privacy concerns and regulatory requirements such as the "right to be forgotten."…

Machine Learning · Computer Science 2025-06-12 Anastasia Koloskova , Youssef Allouah , Animesh Jha , Rachid Guerraoui , Sanmi Koyejo

How much does a machine learning algorithm leak about its training data, and why? Membership inference attacks are used as an auditing tool to quantify this leakage. In this paper, we present a comprehensive \textit{hypothesis testing…

Machine Learning · Computer Science 2022-09-14 Jiayuan Ye , Aadyaa Maddi , Sasi Kumar Murakonda , Vincent Bindschaedler , Reza Shokri

Bias in classifiers is a severe issue of modern deep learning methods, especially for their application in safety- and security-critical areas. Often, the bias of a classifier is a direct consequence of a bias in the training dataset,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Christian Reimers , Paul Bodesheim , Jakob Runge , Joachim Denzler

Graph unlearning emerges as a crucial advancement in the pursuit of responsible AI, providing the means to remove sensitive data traces from trained models, thereby upholding the \textit{right to be forgotten}. It is evident that graph…

Machine Learning · Computer Science 2025-10-16 Anwar Said , Ngoc N. Tran , Yuying Zhao , Tyler Derr , Mudassir Shabbir , Waseem Abbas , Xenofon Koutsoukos

Deep learning models have achieved unprecedented performance in the domain of object detection, resulting in breakthroughs in areas such as autonomous driving and security. However, deep learning models are vulnerable to backdoor attacks.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Jeongjin Shin

This paper studies model-inversion attacks, in which the access to a model is abused to infer information about the training data. Since its first introduction, such attacks have raised serious concerns given that training data usually…

Machine Learning · Computer Science 2020-04-21 Yuheng Zhang , Ruoxi Jia , Hengzhi Pei , Wenxiao Wang , Bo Li , Dawn Song

As a privacy-preserving method for implementing Vertical Federated Learning, Split Learning has been extensively researched. However, numerous studies have indicated that the privacy-preserving capability of Split Learning is insufficient.…

Machine Learning · Computer Science 2023-08-21 Haoze Qiu , Fei Zheng , Chaochao Chen , Xiaolin Zheng

The arms race between attacks and defenses for machine learning models has come to a forefront in recent years, in both the security community and the privacy community. However, one big limitation of previous research is that the security…

Machine Learning · Statistics 2019-08-27 Liwei Song , Reza Shokri , Prateek Mittal