中文
相关论文

相关论文: Towards Aligned Data Removal via Twin Machine Unle…

200 篇论文

Large language models (LLMs) have achieved significant progress from pre-training on and memorizing a wide range of textual data, however, this process might suffer from privacy issues and violations of data protection regulations. As a…

计算与语言 · 计算机科学 2023-11-01 Jiaao Chen , Diyi Yang

Learning algorithms and data are the driving forces for machine learning to bring about tremendous transformation of industrial intelligence. However, individuals' right to retract their personal data and relevant data privacy regulations…

机器学习 · 计算机科学 2023-05-23 Junde Li , Swaroop Ghosh

The right to be forgotten requires the removal or "unlearning" of a user's data from machine learning models. However, in the context of Machine Learning as a Service (MLaaS), retraining a model from scratch to fulfill the unlearning…

密码学与安全 · 计算机科学 2024-01-17 Hongsheng Hu , Shuo Wang , Jiamin Chang , Haonan Zhong , Ruoxi Sun , Shuang Hao , Haojin Zhu , Minhui Xue

The development of artificial intelligence demands that models incrementally update knowledge by Continual Learning (CL) to adapt to open-world environments. To meet privacy and security requirements, Continual Unlearning (CU) emerges as an…

Regulations introduced by General Data Protection Regulation (GDPR) in the EU or California Consumer Privacy Act (CCPA) in the US have included provisions on the \textit{right to be forgotten} that mandates industry applications to remove…

计算与语言 · 计算机科学 2022-12-20 Vinayshekhar Bannihatti Kumar , Rashmi Gangadharaiah , Dan Roth

Machine unlearning is the task of updating a trained model to forget specific training data without retraining from scratch. In this paper, we investigate how unlearning of deep neural networks (DNNs) is affected by the model…

机器学习 · 计算机科学 2026-05-20 Gal Alon , Yehuda Dar

Machine unlearning (MU) aims to efficiently remove sensitive or harmful memory from a pre-trained model. The key challenge is to balance the potential tradeoff between unlearning efficacy and utility preservation, which involves forgetting…

机器学习 · 计算机科学 2026-02-04 Shiji Zhou , Tianbai Yu , Zhi Zhang , Heng Chang , Xiao Zhou , Dong Wu , Han Zhao

Large language models (LLMs) have achieved remarkable success across natural language processing tasks, yet their widespread deployment raises pressing concerns around privacy, copyright, security, and bias. Machine unlearning has emerged…

计算与语言 · 计算机科学 2026-01-21 Tyler Lizzo , Larry Heck

Despite significant progress in safety alignment, large language models (LLMs) remain susceptible to jailbreak attacks. Existing defense mechanisms have not fully deleted harmful knowledge in LLMs, which allows such attacks to bypass…

计算与语言 · 计算机科学 2025-05-27 Zesheng Shi , Yucheng Zhou , Jing Li

Machine unlearning is a process to remove specific data points from a trained model while maintaining the performance on the retain data, addressing privacy or legal requirements. Despite its importance, existing unlearning evaluations tend…

机器学习 · 计算机科学 2026-01-30 Yongwoo Kim , Sungmin Cha , Donghyun Kim

Large language models (LLMs) have recently revolutionized language processing tasks but have also brought ethical and legal issues. LLMs have a tendency to memorize potentially private or copyrighted information present in the training…

机器学习 · 计算机科学 2025-07-21 Tamim Al Mahmud , Najeeb Jebreel , Josep Domingo-Ferrer , David Sanchez

Despite advances in Preference Alignment (PA) for Large Language Models (LLMs), mainstream methods like Reinforcement Learning with Human Feedback (RLHF) face notable challenges. These approaches require high-quality datasets of positive…

机器学习 · 计算机科学 2025-04-10 Xiaohua Feng , Yuyuan Li , Huwei Ji , Jiaming Zhang , Li Zhang , Tianyu Du , Chaochao Chen

As privacy concerns escalate in the realm of machine learning, data owners now have the option to utilize machine unlearning to remove their data from machine learning models, following recent legislation. To enhance transparency in machine…

机器学习 · 计算机科学 2026-04-23 Binchi Zhang , Zihan Chen , Cong Shen , Jundong Li

With evolving data regulations, machine unlearning (MU) has become an important tool for fostering trust and safety in today's AI models. However, existing MU methods focusing on data and/or weight perspectives often suffer limitations in…

机器学习 · 计算机科学 2024-04-05 Chongyu Fan , Jiancheng Liu , Yihua Zhang , Eric Wong , Dennis Wei , Sijia Liu

Machine unlearning for large language models often faces a privacy dilemma in which strict constraints prohibit sharing either the server's parameters or the client's forget set. To address this dual non-disclosure constraint, we propose…

机器学习 · 计算机科学 2026-05-15 Tiantong Wang , Xinyu Yan , Tiantong Wu , Yurong Hao , Pengjun Xie , Wei Yang Bryan Lim

Large language models inevitably retain sensitive information, defined as inputs that may induce harmful generations, due to training on massive web corpora, raising concerns for privacy and safety. Existing machine unlearning methods…

机器学习 · 计算机科学 2026-05-21 Yujie Lin , Chengyi Yang , Zhishang Xiang , Yiping Song , Jinsong Su

Recently enacted legislation grants individuals certain rights to decide in what fashion their personal data may be used, and in particular a "right to be forgotten". This poses a challenge to machine learning: how to proceed when an…

机器学习 · 计算机科学 2020-07-09 Thomas Baumhauer , Pascal Schöttle , Matthias Zeppelzauer

Large language model unlearning aims to remove harmful information that LLMs have learnt to prevent their use for malicious purposes. LLMU and RMU have been proposed as two methods for LLM unlearning, achieving impressive results on…

计算与语言 · 计算机科学 2025-02-25 Jai Doshi , Asa Cooper Stickland

Conformal unlearning aims to ensure that a trained conformal predictor miscovers data points with specific shared characteristics, such as those from a particular label class, associated with a specific user, or belonging to a defined…

机器学习 · 计算机科学 2026-02-13 Yahya Alkhatib , Muhammad Ahmar Jamal , Wee Peng Tay

The rapid progress of AI, combined with its unprecedented public adoption and the propensity of large neural networks to memorize training data, has given rise to significant data privacy concerns. To address these concerns, machine…

机器学习 · 计算机科学 2023-11-23 Ali Abbasi , Chayne Thrash , Elaheh Akbari , Daniel Zhang , Soheil Kolouri