中文
相关论文

相关论文: Holistic Audit Dataset Generation for LLM Unlearni…

200 篇论文

Large Language Models (LLMs) are increasingly integrated into real-world applications, raising concerns about privacy, security and the need to remove undesirable knowledge. Machine Unlearning has emerged as a promising solution, yet faces…

机器学习 · 计算机科学 2025-10-22 Yisheng Zhong , Zhengbang Yang , Zhuangdi Zhu

Machine unlearning (MU) seeks to remove knowledge of specific data samples from trained models without the necessity for complete retraining, a task made challenging by the dual objectives of effective erasure of data and maintaining the…

机器学习 · 计算机科学 2024-07-16 Mark He Huang , Lin Geng Foo , Jun Liu

As text-to-image diffusion models gain widespread commercial applications, there are increasing concerns about unethical or harmful use, including the unauthorized generation of copyrighted or sensitive content. Concept unlearning has…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Saemi Moon , Minjong Lee , Sangdon Park , Dongwoo Kim

Retrieval-augmented generation (RAG) is increasingly recognized as an effective approach to mitigating the hallucination of large language models (LLMs) through the integration of external knowledge. While numerous efforts, most studies…

计算与语言 · 计算机科学 2025-10-10 Shuo Yu , Mingyue Cheng , Qi Liu , Daoyu Wang , Jiqian Yang , Jie Ouyang , Yucong Luo , Chenyi Lei , Enhong Chen

Knowledge erasure in large language models (LLMs) is important for ensuring compliance with data and AI regulations, safeguarding user privacy, mitigating bias, and misinformation. Existing unlearning methods aim to make the process of…

密码学与安全 · 计算机科学 2025-06-24 Yash Sinha , Manit Baser , Murari Mandal , Dinil Mon Divakaran , Mohan Kankanhalli

Enabling large language models (LLMs) to unlearn knowledge and capabilities acquired during training has proven vital for ensuring compliance with data regulations and promoting ethical practices in generative AI. Although there are growing…

In today's rapidly evolving landscape of Artificial Intelligence, large language models (LLMs) have emerged as a vibrant research topic. LLMs find applications in various fields and contribute significantly. Despite their powerful language…

计算与语言 · 计算机科学 2024-09-10 Tuan Bui , Oanh Tran , Phuong Nguyen , Bao Ho , Long Nguyen , Thang Bui , Tho Quan

Large language model unlearning has become a critical challenge in ensuring safety and controlled model behavior by removing undesired data-model influences from the pretrained model while preserving general utility. Significant recent…

计算与语言 · 计算机科学 2025-04-17 Soumyadeep Pal , Changsheng Wang , James Diffenderfer , Bhavya Kailkhura , Sijia Liu

Large language models (LLMs) serve as giant information stores, often including personal or copyrighted data, and retraining them from scratch is not a viable option. This has led to the development of various fast, approximate unlearning…

计算与语言 · 计算机科学 2024-10-18 Minseok Choi , ChaeHun Park , Dohyun Lee , Jaegul Choo

Machine unlearning, which selectively removes harmful knowledge from a pre-trained model without retraining from scratch, is crucial for addressing privacy, regulatory compliance, and ethical concerns in Large Language Models (LLMs).…

机器学习 · 计算机科学 2025-11-25 Feng Guo , Yuntao Wen , Shen Gao , Junshuo Zhang , Shuo Shang

Long-context LLMs and Retrieval-Augmented Generation (RAG) systems process information passively, deferring state tracking, contradiction resolution, and evidence aggregation to query time, which becomes brittle under ultra long streams…

机器学习 · 计算机科学 2026-02-24 Kehao Zhang , Shangtong Gui , Sheng Yang , Wei Chen , Yang Feng

Unlearning in large language models (LLMs) involves precisely removing specific information from a pre-trained model. This is crucial to ensure safety of LLMs by deleting private data or harmful knowledge acquired during pre-training.…

机器学习 · 计算机科学 2025-09-04 Naman Deep Singh , Maximilian Müller , Francesco Croce , Matthias Hein

Large language models trained on web-scale corpora can memorize undesirable data containing misinformation, copyrighted material, or private or sensitive information. Recently, several machine unlearning algorithms have been proposed to…

计算与语言 · 计算机科学 2025-05-27 Keivan Rezaei , Khyathi Chandu , Soheil Feizi , Yejin Choi , Faeze Brahman , Abhilasha Ravichander

While Large Vision-Language Models (LVLMs) offer powerful capabilities, they pose privacy risks by unintentionally memorizing sensitive personal information. Current unlearning benchmarks attempt to mitigate this using fictitious identities…

计算机视觉与模式识别 · 计算机科学 2026-05-06 JuneHyoung Kwon , MiHyeon Kim , Eunju Lee , JungMin Yun , Byeonggeuk Lim , YoungBin Kim

Machine unlearning has emerged as a new paradigm to deliberately forget data samples from a given model in order to adhere to stringent regulations. However, existing machine unlearning methods have been primarily focused on classification…

机器学习 · 计算机科学 2024-02-05 Guihong Li , Hsiang Hsu , Chun-Fu Chen , Radu Marculescu

Large Language Models (LLMs) are foundational to AI advancements, facilitating applications like predictive text generation. Nonetheless, they pose risks by potentially memorizing and disseminating sensitive, biased, or copyrighted…

人工智能 · 计算机科学 2024-03-26 Youyang Qu , Ming Ding , Nan Sun , Kanchana Thilakarathna , Tianqing Zhu , Dusit Niyato

Large language models (LLMs) exhibit exceptional performance but pose substantial privacy risks due to training data memorization, particularly within healthcare contexts involving imperfect or privacy-sensitive patient information. We…

机器学习 · 计算机科学 2026-03-12 Yi Zhang , Chao Zhang , Zijian Li , Tianxiang Xu , Kunyu Zhang , Zhan Gao , Meinuo Li , Xiaohan Zhang , Qichao Qi , Bing Chen

During pretraining, LLMs inadvertently memorize sensitive or copyrighted data, posing significant compliance challenges under legal frameworks like the GDPR and the EU AI Act. Fulfilling these mandates demands techniques that can remove…

机器学习 · 计算机科学 2026-03-23 Efstratios Zaradoukas , Bardh Prenkaj , Gjergji Kasneci

Knowledge Tracing (KT) models students' evolving knowledge states to predict future performance, serving as a foundation for personalized education. While traditional deep learning models achieve high accuracy, they often lack…

计算与语言 · 计算机科学 2026-03-25 Runze Li , Kedi Chen , Guwei Feng , Mo Yu , Jun Wang , Wei Zhang

Large language models (LLMs) risk retaining unauthorized or sensitive information from their training data, which raises privacy concerns. LLM unlearning seeks to mitigate these risks by selectively removing specified data while maintaining…

计算与语言 · 计算机科学 2025-05-29 Hwan Chang , Hwanhee Lee