English
Related papers

Related papers: Unlearning vs. Obfuscation: Are We Truly Removing …

200 papers

Advanced model dememorization methods, including availability poisoning (unlearnability) and machine unlearning, are emerging as key safeguards against data misuse in machine learning (ML). At the training stage, unlearnability embeds…

Machine Learning · Computer Science 2026-05-13 Mengying Zhang , Derui Wang , Ruoxi Sun , Xiaoyu Xia , Shuang Hao , Minhui Xue

Bold claims about AI's role in science-from "AGI will cure all diseases" to promises of radically accelerated discovery-raise a central epistemic question: do large language models (LLMs) truly generate new knowledge, or do they merely…

Machine Learning · Computer Science 2025-11-26 Robert Yang

Modern computer systems store vast amounts of personal data, enabling advances in AI and ML but risking user privacy and trust. For privacy reasons, it is sometimes desired for an ML model to forget part of the data it was trained on. In…

Machine Learning · Computer Science 2025-12-30 Amartya Hatua , Trung T. Nguyen , Filip Cano , Andrew H. Sung

Neural language models are black-boxes--both linguistic patterns and factual knowledge are distributed across billions of opaque parameters. This entangled encoding makes it difficult to reliably inspect, verify, or update specific facts.…

In this paper, we investigate knowledge forgetting in large language models with a focus on its generalisation, ensuring that models forget not only specific training samples but also related implicit knowledge. To this end, we begin by…

Computation and Language · Computer Science 2025-10-10 Huazheng Wang , Yongcheng Jing , Haifeng Sun , Yingjie Wang , Jingyu Wang , Jianxin Liao , Dacheng Tao

Reliable Large Language Models (LLMs) should abstain when confidence is insufficient. However, prior studies often treat refusal as a generic "I don't know'', failing to distinguish input-level ambiguity (data uncertainty) from capability…

Computation and Language · Computer Science 2026-04-21 Jingyi Ren , Ante Wang , Yunghwei Lai , Xiaolong Wang , Linlu Gong , Weitao Li , Weizhi Ma , Yang Liu

Large Reasoning Models (LRMs) generate structured chains of thought (CoTs) before producing final answers, making them especially vulnerable to knowledge leakage through intermediate reasoning steps. Yet, the memorization of sensitive…

Artificial Intelligence · Computer Science 2026-04-07 Tuan Le , Wei Qian , Mengdi Huai

Machine unlearning has been used to remove unwanted knowledge acquired by large language models (LLMs). In this paper, we examine machine unlearning from an optimization perspective, framing it as a regularized multi-task optimization…

Machine Learning · Computer Science 2025-05-07 Zhiqi Bu , Xiaomeng Jin , Bhanukiran Vinzamuri , Anil Ramakrishna , Kai-Wei Chang , Volkan Cevher , Mingyi Hong

Robust unlearning is crucial for safely deploying large language models (LLMs) in environments where data privacy, model safety, and regulatory compliance must be ensured. Yet the task is inherently challenging, partly due to difficulties…

Computation and Language · Computer Science 2025-11-11 Vineeth Dorna , Anmol Mekala , Wenlong Zhao , Andrew McCallum , Zachary C. Lipton , J. Zico Kolter , Pratyush Maini

Machine unlearning is the process of efficiently removing specific information from a trained machine learning model without retraining from scratch. Existing unlearning methods, which often provide provable guarantees, typically involve…

Machine Learning · Computer Science 2026-02-04 Somnath Basu Roy Chowdhury , Rahul Kidambi , Avinava Dubey , David Wang , Gokhan Mergen , Amr Ahmed , Aranyak Mehta

Large Reasoning Models (LRMs) embed private or copyrighted information not only in their final answers but also throughout multi-step chain-of-thought (CoT) traces, making reliable unlearning far more demanding than in standard LLMs. We…

Computation and Language · Computer Science 2025-05-28 Sangyeon Yoon , Wonje Jeung , Albert No

Federated Learning (FL) has evolved as a powerful tool for collaborative model training across multiple entities, ensuring data privacy in sensitive sectors such as healthcare and finance. However, the introduction of the Right to Be…

Machine Learning · Computer Science 2024-06-06 Kahou Tam , Kewei Xu , Li Li , Huazhu Fu

Large Language Models (LLMs) demonstrate exceptional performance across diverse tasks by leveraging pre-trained (i.e., parametric) and external (i.e., contextual) knowledge. While substantial efforts have been made to enhance the…

Computation and Language · Computer Science 2025-05-19 Hyuhng Joon Kim , Youna Kim , Sang-goo Lee , Taeuk Kim

With the explosive growth of deep learning applications and increasing privacy concerns, the right to be forgotten has become a critical requirement in various AI industries. For example, given a facial recognition system, some individuals…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Dasol Choi , Dongbin Na

Large language models trained on web-scale data can memorize private or sensitive knowledge, raising significant privacy risks. Although some unlearning methods mitigate these risks, they remain vulnerable to "relearning" during subsequent…

Machine Learning · Computer Science 2026-03-05 Nakyeong Yang , Dong-Kyum Kim , Jea Kwon , Minsung Kim , Kyomin Jung , Meeyoung Cha

Today, computer systems hold large amounts of personal data. Yet while such an abundance of data allows breakthroughs in artificial intelligence, and especially machine learning (ML), its existence can be a threat to user privacy, and it…

Large language models (LLMs) contain substantial factual knowledge which is commonly elicited by multiple-choice question-answering prompts. Internally, such models process the prompt through multiple transformer layers, building varying…

Computation and Language · Computer Science 2025-01-31 Didier Chételat , Joseph Cotnareanu , Rylee Thompson , Yingxue Zhang , Mark Coates

Recent masked diffusion language models (MDLMs), such as LLaDA and Dream, have achieved performance comparable to autoregressive large language models. Unlike autoregressive models, which generate text sequentially, MDLMs generate text by…

Computation and Language · Computer Science 2026-05-19 Georu Lee , Seungwon Jeong , Hoki Kim , Jinseong Park , Woojin Lee

Foundation models have transformed multimedia analysis by enabling robust and transferable representations across diverse modalities and tasks. However, their static deployment conflicts with growing societal and regulatory demands --…