中文
相关论文

相关论文: Exact and Efficient Unlearning for Large Language …

200 篇论文

Generating user-friendly explanations regarding why an item is recommended has become increasingly common, largely due to advances in language generation technology, which can enhance user trust and facilitate more informed decision-making…

信息检索 · 计算机科学 2024-01-04 Yucong Luo , Mingyue Cheng , Hao Zhang , Junyu Lu , Qi Liu , Enhong Chen

In recent years, Large Language Models (LLMs) have achieved remarkable advancements, drawing significant attention from the research community. Their capabilities are largely attributed to large-scale architectures, which require extensive…

LLM unlearning is essential for mitigating safety, copyright, and privacy concerns in pre-trained large language models (LLMs). Compared to preference alignment, it offers a more explicit way by removing undesirable knowledge characterized…

机器学习 · 计算机科学 2026-03-12 Junfeng Liao , Qizhou Wang , Shanshan Ye , Xin Yu , Ling Chen , Zhen Fang

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities across vision-language tasks, yet their large-scale deployment raises pressing concerns about memorized private data, outdated knowledge, and harmful…

机器学习 · 计算机科学 2026-02-03 Chenlu Ding , Jiancan Wu , Leheng Sheng , Fan Zhang , Yancheng Yuan , Xiang Wang , Xiangnan He

Large Language Models (LLMs) inevitably memorize sensitive information during training, posing significant privacy risks. Machine unlearning has emerged as a promising solution to selectively remove such information without full retraining.…

机器学习 · 计算机科学 2026-04-02 Yuze Wang , Yujia Tong , Xuan Liu , Junhao Dong

In recent years, with large language models (LLMs) achieving state-of-the-art performance in context understanding, increasing efforts have been dedicated to developing LLM-enhanced sequential recommendation (SR) methods. Considering that…

信息检索 · 计算机科学 2023-10-04 Bo Peng , Ben Burns , Ziqi Chen , Srinivasan Parthasarathy , Xia Ning

Recently, Large Language Model (LLM)-empowered recommender systems have revolutionized personalized recommendation frameworks and attracted extensive attention. Despite the remarkable success, existing LLM-empowered RecSys have been…

信息检索 · 计算机科学 2025-04-04 Liangbo Ning , Wenqi Fan , Qing Li

The rapid evolution of Large Language Model (LLM) agents has necessitated robust memory systems to support cohesive long-term interaction and complex reasoning. Benefiting from the strong capabilities of LLMs, recent research focus has…

人工智能 · 计算机科学 2026-04-16 Weiquan Huang , Zixuan Wang , Hehai Lin , Sudong Wang , Bo Xu , Qian Li , Beier Zhu , Linyi Yang , Chengwei Qin

Large Language Models have shown remarkable capabilities in the NLP domain. Their effectiveness can mainly be attributed to their ability to adapt to an array of downstream tasks. However, generally, full fine-tuning is a computationally…

计算与语言 · 计算机科学 2025-06-10 Harsh Bihany , Shubham Patel , Ashutosh Modi

Although language models (LMs) demonstrate exceptional capabilities on various tasks, they are potentially vulnerable to extraction attacks, which represent a significant privacy risk. To mitigate the privacy concerns of LMs, machine…

计算与语言 · 计算机科学 2024-06-21 Dohyun Lee , Daniel Rim , Minseok Choi , Jaegul Choo

Recommender systems provide essential web services by learning users' personal preferences from collected data. However, in many cases, systems also need to forget some training data. From the perspective of privacy, several privacy…

信息检索 · 计算机科学 2022-01-26 Chong Chen , Fei Sun , Min Zhang , Bolin Ding

Large Language Models (LLMs) are foundational to AI advancements, facilitating applications like predictive text generation. Nonetheless, they pose risks by potentially memorizing and disseminating sensitive, biased, or copyrighted…

人工智能 · 计算机科学 2024-03-26 Youyang Qu , Ming Ding , Nan Sun , Kanchana Thilakarathna , Tianqing Zhu , Dusit Niyato

Fine-tuning-based unlearning methods prevail for preventing targeted harmful, sensitive, or copyrighted information within large language models while preserving overall capabilities. However, the true effectiveness of these methods is…

计算与语言 · 计算机科学 2024-10-16 Yihuai Hong , Yuelin Zou , Lijie Hu , Ziqian Zeng , Di Wang , Haiqin Yang

Planning for both immediate and long-term benefits becomes increasingly important in recommendation. Existing methods apply Reinforcement Learning (RL) to learn planning capacity by maximizing cumulative reward for long-term recommendation.…

信息检索 · 计算机科学 2024-04-29 Wentao Shi , Xiangnan He , Yang Zhang , Chongming Gao , Xinyue Li , Jizhi Zhang , Qifan Wang , Fuli Feng

Although Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of tasks, growing concerns have emerged over the misuse of sensitive, copyrighted, or harmful data during training. To address these…

Current unlearning methods for LLMs optimize on the private information they seek to remove by incorporating it into their fine-tuning data. We argue this not only risks reinforcing exposure to sensitive data, but also fundamentally…

机器学习 · 计算机科学 2026-03-03 Yan Scholten , Sophie Xhonneux , Leo Schwinn , Stephan Günnemann

Retrieval-Augmented Large Language Models (LLMs), which incorporate the non-parametric knowledge from external knowledge bases into LLMs, have emerged as a promising approach to enhancing response accuracy in several tasks, such as…

计算与语言 · 计算机科学 2024-03-29 Soyeong Jeong , Jinheon Baek , Sukmin Cho , Sung Ju Hwang , Jong C. Park

Representation Misdirection for Unlearning (RMU), which steers model representation in the intermediate layer to a target random representation, is an effective method for large language model (LLM) unlearning. Despite its high performance,…

计算与语言 · 计算机科学 2025-02-07 Dang Huu-Tien , Trung-Tin Pham , Hoang Thanh-Tung , Naoya Inoue

Large Language Models (LLMs) have shown remarkable reasoning capabilities, while their practical applications are limited by severe factual hallucinations due to limitations in the timeliness, accuracy, and comprehensiveness of their…

人工智能 · 计算机科学 2025-06-10 Xinyan Guan , Jiali Zeng , Fandong Meng , Chunlei Xin , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun , Jie Zhou

Training and fine-tuning large language models (LLMs) come with challenges related to memory and computational requirements due to the increasing size of the model weights and the optimizer states. Various techniques have been developed to…

机器学习 · 计算机科学 2025-12-09 Yehonathan Refael , Jonathan Svirsky , Boris Shustin , Wasim Huleihel , Ofir Lindenbaum