English
Related papers

Related papers: U-CAN: Utility-Aware Contrastive Attenuation for E…

200 papers

Due to increasing privacy regulations and regulatory compliance, Machine Unlearning (MU) has become essential. The goal of unlearning is to remove information related to a specific class from a model. Traditional approaches achieve exact…

Machine Learning · Computer Science 2024-11-20 Atharv Mittal

The right to be forgotten mandates that machine learning models enable the erasure of a data owner's data and information from a trained model. Removing data from the dataset alone is inadequate, as machine learning models can memorize…

Machine Learning · Computer Science 2024-10-16 Xiaoyu Xia , Ziqi Wang , Ruoxi Sun , Bowen Liu , Ibrahim Khalil , Minhui Xue

Mitigating the retention of sensitive or private information in large language models is essential for enhancing privacy and safety. Existing unlearning methods, like Gradient Ascent and Negative Preference Optimization, directly tune…

Computation and Language · Computer Science 2024-10-17 Yijiang River Dong , Hongzhou Lin , Mikhail Belkin , Ramon Huerta , Ivan Vulić

Data augmentation using generative models has emerged as a powerful paradigm for enhancing performance in computer vision tasks. However, most existing augmentation approaches primarily focus on optimizing intrinsic data attributes -- such…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Jiyu Guo , Shuo Yang , Yiming Huang , Yancheng Long , Xiaobo Xia , Xiu Su , Bo Zhao , Zeke Xie , Liqiang Nie

The widespread adoption of diffusion models in image generation has increased the demand for privacy-compliant unlearning. However, due to the high-dimensional nature and complex feature representations of diffusion models, achieving…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Zhenyu Yu , Mohd Yamani Inda Idris , Pei Wang

The technological advancements in diffusion models (DMs) have demonstrated unprecedented capabilities in text-to-image generation and are widely used in diverse applications. However, they have also raised significant societal concerns,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Yihua Zhang , Chongyu Fan , Yimeng Zhang , Yuguang Yao , Jinghan Jia , Jiancheng Liu , Gaoyuan Zhang , Gaowen Liu , Ramana Rao Kompella , Xiaoming Liu , Sijia Liu

Unlearning in large language models is becoming increasingly important due to regulatory compliance, copyright protection, and privacy concerns. However, a key challenge in LLM unlearning is unintended forgetting, where the removal of…

Machine Learning · Computer Science 2025-10-23 Peizhi Niu , Evelyn Ma , Huiting Zhou , Duo Zhou , Huan Zhang , S. Rasoul Etesami , Olgica Milenkovic

Machine unlearning (MUL) focuses on removing the influence of specific subsets of data (such as noisy, poisoned, or privacy-sensitive data) from pretrained models. MUL methods typically rely on specialized forms of fine-tuning. Recent…

Machine Learning · Computer Science 2024-11-05 Kairan Zhao , Peter Triantafillou

Recently, Large Language Models (LLMs) have been widely employed in Conversational Recommender Systems (CRSs). Unlike traditional language model approaches that focus on training, all existing LLMs-based approaches are mainly centered…

Computation and Language · Computer Science 2025-09-26 Jianyu Wen , Jingyun Wang , Cilin Yan , Jiayin Cai , Xiaolong Jiang , Ying Zhang

Large language models (LLMs) trained on unfiltered corpora inherently risk retaining sensitive information, necessitating selective knowledge unlearning for regulatory compliance and ethical safety. However, existing parameter-modifying…

Machine Learning · Computer Science 2026-05-18 Zhaokun Wang , Jinyu Guo , Jingwen Pu , Hongli Pu , Meng Yang , Xunlei Chen , Jie Ou , Wenyi Li , Guangchun Luo , Wenhong Tian

Machine unlearning focuses on efficiently removing specific data from trained models, addressing privacy and compliance concerns with reasonable costs. Although exact unlearning ensures complete data removal equivalent to retraining, it is…

Cryptography and Security · Computer Science 2025-06-17 Nima Naderloui , Shenao Yan , Binghui Wang , Jie Fu , Wendy Hui Wang , Weiran Liu , Yuan Hong

Machine unlearning, the process of selectively removing data from trained models, is increasingly crucial for addressing privacy concerns and knowledge gaps post-deployment. Despite this importance, existing approaches are often heuristic…

Machine Learning · Computer Science 2025-02-13 Youssef Allouah , Joshua Kazdan , Rachid Guerraoui , Sanmi Koyejo

Mitigating sensitive and harmful outputs is fundamental to ensuring safe deployment of LLMs. Existing approaches typically follow two paradigms: Knowledge Deletion (KD), which erases undesirable information during training, and…

Machine Learning · Computer Science 2026-05-19 Puning Yang , Junchi Yu , Qizhou Wang , Philip Torr , Bo Han , Xiuying Chen

Machine unlearning, the ability to erase the effect of specific training samples without retraining from scratch, is critical for privacy, regulation, and efficiency. However, most progress in unlearning has been empirical, with little…

Machine Learning · Computer Science 2026-02-04 Wei-Kai Chang , Rajiv Khanna

As generative models become increasingly powerful and pervasive, the ability to unlearn specific data, whether due to privacy concerns, legal requirements, or the correction of harmful content, has become increasingly important. Unlike in…

Machine Learning · Computer Science 2025-09-26 Pinak Mandal , Georg A. Gottwald

Machine unlearning enables the removal of specific data from ML models to uphold the right to be forgotten. While approximate unlearning algorithms offer efficient alternatives to full retraining, this work reveals that they fail to…

Machine Learning · Computer Science 2025-07-29 Yaxin Xiao , Qingqing Ye , Li Hu , Huadi Zheng , Haibo Hu , Zi Liang , Haoyang Li , Yijie Jiao

Large language models have been widely applied, but can inadvertently encode sensitive or harmful information, raising significant safety concerns. Machine unlearning has emerged to alleviate this concern; however, existing training-time…

Computation and Language · Computer Science 2025-10-22 Jinwei Hu , Zhenglin Huang , Xiangyu Yin , Wenjie Ruan , Guangliang Cheng , Yi Dong , Xiaowei Huang

Machine unlearning aims to erase requested data from trained models without full retraining. For Reasoning Multimodal Large Language Models (RMLLMs), this is uniquely challenging: intermediate chain-of-thought steps can still leak sensitive…

Computation and Language · Computer Science 2025-12-23 Hongji Li , Junchi yao , Manjiang Yu , Priyanka Singh , Xue Li , Di Wang , Lijie Hu

Accurately quantifying a large language model's (LLM) predictive uncertainty is crucial for judging the reliability of its answers. While most existing research focuses on short, directly answerable questions with closed-form outputs (e.g.,…

Computation and Language · Computer Science 2025-08-08 Yinghao Li , Rushi Qiang , Lama Moukheiber , Chao Zhang

Although Multimodal Large Language Models (MLLMs) have achieved remarkable progress across many domains, their training on large-scale multimodal datasets raises serious privacy concerns, making effective machine unlearning increasingly…

Artificial Intelligence · Computer Science 2026-05-08 Yuhang Wang , Wenjie Mei , Junkai Zhang , Guangyu He , Zhenxing Niu , Haichang Gao