English
Related papers

Related papers: Label Leakage Attacks in Machine Unlearning: A Par…

200 papers

Lifelong learning algorithms enable models to incrementally acquire new knowledge without forgetting previously learned information. Contrarily, the field of machine unlearning focuses on explicitly forgetting certain previous knowledge…

Machine Learning · Computer Science 2025-05-19 Ozan Özdenizci , Elmar Rueckert , Robert Legenstein

Semi-supervised machine learning models learn from a (small) set of labeled training examples, and a (large) set of unlabeled training examples. State-of-the-art models can reach within a few percentage points of fully-supervised training,…

Machine Learning · Computer Science 2021-08-11 Nicholas Carlini

Recent work has demonstrated the successful extraction of training data from generative language models. However, it is not evident whether such extraction is feasible in text classification models since the training objective is to predict…

Computation and Language · Computer Science 2022-06-10 Adel Elmahdy , Huseyin A. Inan , Robert Sim

The right to privacy, enshrined in various human rights declarations, faces new challenges in the age of artificial intelligence (AI). This paper explores the concept of the Right to be Forgotten (RTBF) within AI systems, contrasting it…

Machine Learning · Computer Science 2025-01-22 Rickard Brännvall , Laurynas Adomaitis , Olof Görnerup , Anass Sedrati

Most recent studies have shown several vulnerabilities to attacks with the potential to jeopardize the integrity of the model, opening in a few recent years a new window of opportunity in terms of cyber-security. The main interest of this…

Face recognition systems rely on learning highly discriminative and compact identity clusters to enable accurate retrieval. However, as with other surveillance-oriented technologies, such systems raise serious privacy concerns due to their…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Mikhail Zakharov

With growing demands for privacy protection, security, and legal compliance (e.g., GDPR), machine unlearning has emerged as a critical technique for ensuring the controllability and regulatory alignment of machine learning models. However,…

Machine Learning · Computer Science 2026-04-08 Lulu Xue , Shengshan Hu , Wei Lu , Yan Shen , Dongxu Li , Peijin Guo , Ziqi Zhou , Minghui Li , Yanjun Zhang , Leo Yu Zhang

Modern computer systems store vast amounts of personal data, enabling advances in AI and ML but risking user privacy and trust. For privacy reasons, it is sometimes desired for an ML model to forget part of the data it was trained on. In…

Machine Learning · Computer Science 2025-12-30 Amartya Hatua , Trung T. Nguyen , Filip Cano , Andrew H. Sung

The task of "unlearning" certain concepts in large language models (LLMs) has attracted immense attention recently, due to its importance in mitigating undesirable model behaviours, such as the generation of harmful, private, or incorrect…

Computation and Language · Computer Science 2025-09-03 Yihuai Hong , Lei Yu , Haiqin Yang , Shauli Ravfogel , Mor Geva

Large Language Models (LLMs) are foundational to AI advancements, facilitating applications like predictive text generation. Nonetheless, they pose risks by potentially memorizing and disseminating sensitive, biased, or copyrighted…

Artificial Intelligence · Computer Science 2024-03-26 Youyang Qu , Ming Ding , Nan Sun , Kanchana Thilakarathna , Tianqing Zhu , Dusit Niyato

Large language models (LLMs) often memorize private information during training, raising serious privacy concerns. While machine unlearning has emerged as a promising solution, its true effectiveness against privacy attacks remains unclear.…

Machine Learning · Computer Science 2026-04-27 Xiaoyi Chen , Haoyuan Wang , Siyuan Tang , Sijia Liu , Liya Su , XiaoFeng Wang , Haixu Tang

Unlearning algorithms aim to remove deleted data's influence from trained models at a cost lower than full retraining. However, prior guarantees of unlearning in literature are flawed and don't protect the privacy of deleted records. We…

Machine Learning · Statistics 2023-02-15 Rishav Chourasia , Neil Shah

We study the task of teaching a machine to classify objects using features and labels. We introduce the Error-Driven-Featuring design pattern for teaching using features and labels in which a teacher prefers to introduce features only if…

Artificial Intelligence · Computer Science 2016-11-21 Christopher Meek , Patrice Simard , Xiaojin Zhu

Adversarial attacks on machine learning-based classifiers, along with defense mechanisms, have been widely studied in the context of single-label classification problems. In this paper, we shift the attention to multi-label classification,…

Machine Learning · Computer Science 2022-12-07 Stefano Melacci , Gabriele Ciravegna , Angelo Sotgiu , Ambra Demontis , Battista Biggio , Marco Gori , Fabio Roli

With growing concerns surrounding privacy and regulatory compliance, the concept of machine unlearning has gained prominence, aiming to selectively forget or erase specific learned information from a trained model. In response to this…

Machine Learning · Computer Science 2024-01-18 Yoonhwa Jung , Ikhyun Cho , Shun-Hsiang Hsu , Julia Hockenmaier

Federated learning is considered as an effective privacy-preserving learning mechanism that separates the client's data and model training process. However, federated learning is still under the risk of privacy leakage because of the…

Machine Learning · Computer Science 2022-06-03 Yuxuan Wan , Han Xu , Xiaorui Liu , Jie Ren , Wenqi Fan , Jiliang Tang

Many machine learning systems rely on data collected in the wild from untrusted sources, exposing the learning algorithms to data poisoning. Attackers can inject malicious data in the training dataset to subvert the learning process,…

Machine Learning · Statistics 2018-10-04 Andrea Paudice , Luis Muñoz-González , Emil C. Lupu

With an increase in low-cost machine learning APIs, advanced machine learning models may be trained on private datasets and monetized by providing them as a service. However, privacy researchers have demonstrated that these models may leak…

Detecting cyber-anomalies and attacks are becoming a rising concern these days in the domain of cybersecurity. The knowledge of artificial intelligence, particularly, the machine learning techniques can be used to tackle these issues.…

Cryptography and Security · Computer Science 2021-04-19 Iqbal H. Sarker

Machine unlearning (MU), which seeks to erase the influence of specific unwanted data from already-trained models, is becoming increasingly vital in model editing, particularly to comply with evolving data regulations like the ``right to be…

Machine Learning · Computer Science 2025-03-18 Changchang Sun , Ren Wang , Yihua Zhang , Jinghan Jia , Jiancheng Liu , Gaowen Liu , Yan Yan , Sijia Liu