中文
相关论文

相关论文: Exact and Efficient Unlearning for Large Language …

200 篇论文

Large Language Models (LLMs) are increasingly integrated into real-world applications, raising concerns about privacy, security and the need to remove undesirable knowledge. Machine Unlearning has emerged as a promising solution, yet faces…

机器学习 · 计算机科学 2025-10-22 Yisheng Zhong , Zhengbang Yang , Zhuangdi Zhu

Large language models (LLMs) have recently revolutionized language processing tasks but have also brought ethical and legal issues. LLMs have a tendency to memorize potentially private or copyrighted information present in the training…

机器学习 · 计算机科学 2025-07-21 Tamim Al Mahmud , Najeeb Jebreel , Josep Domingo-Ferrer , David Sanchez

Pre-trained language models (PLMs) show impressive performance in various downstream NLP tasks. However, pre-training large language models demands substantial memory and training compute. Furthermore, due to the substantial resources…

计算与语言 · 计算机科学 2024-04-01 HyunJin Kim , Young Jin Kim , JinYeong Bak

Recent research efforts have investigated how to integrate Large Language Models (LLMs) into recommendation, capitalizing on their semantic comprehension and open-world knowledge for user behavior understanding. These approaches…

信息检索 · 计算机科学 2025-04-15 Haokai Ma , Yunshan Ma , Ruobing Xie , Lei Meng , Jialie Shen , Xingwu Sun , Zhanhui Kang , Tat-Seng Chua

Current unlearning methods for large language models usually rely on reverse optimization to reduce target token probabilities. However, this paradigm disrupts the subsequent tokens prediction, degrading model performance and linguistic…

计算与语言 · 计算机科学 2025-05-29 Haoming Xu , Ningyuan Zhao , Liming Yang , Sendong Zhao , Shumin Deng , Mengru Wang , Bryan Hooi , Nay Oo , Huajun Chen , Ningyu Zhang

Information removal or suppression in large language models (LLMs) is a desired functionality, useful in AI regulation, legal compliance, safety, and privacy. LLM unlearning methods aim to remove information on demand from LLMs. Current LLM…

人工智能 · 计算机科学 2025-07-09 Debdeep Sanyal , Murari Mandal

Large Language Models (LLMs) have demonstrated strong capabilities in memorizing vast amounts of knowledge across diverse domains. However, the ability to selectively forget specific knowledge is critical for ensuring the safety and…

计算与语言 · 计算机科学 2025-05-20 Zhijie Deng , Chris Yuhao Liu , Zirui Pang , Xinlei He , Lei Feng , Qi Xuan , Zhaowei Zhu , Jiaheng Wei

In this paper, we address the lifelong sequential behavior incomprehension problem in large language models (LLMs) for recommendation, where LLMs struggle to extract useful information from long user behavior sequences, even within their…

信息检索 · 计算机科学 2025-01-24 Rong Shan , Jiachen Zhu , Jianghao Lin , Chenxu Zhu , Bo Chen , Ruiming Tang , Yong Yu , Weinan Zhang

Adapting Large Language Models for Recommendation (LLM4Rec) has shown promising results. However, the challenges of deploying LLM4Rec in real-world scenarios remain largely unexplored. In particular, recommender models need incremental…

信息检索 · 计算机科学 2024-07-31 Tianhao Shi , Yang Zhang , Zhijian Xu , Chong Chen , Fuli Feng , Xiangnan He , Qi Tian

The imperative to eliminate undesirable data memorization underscores the significance of machine unlearning for large language models (LLMs). Recent research has introduced a series of promising unlearning methods, notably boosting the…

机器学习 · 计算机科学 2025-02-26 Qizhou Wang , Bo Han , Puning Yang , Jianing Zhu , Tongliang Liu , Masashi Sugiyama

Recently, large language models (LLMs) have shown great potential in recommender systems, either improving existing recommendation models or serving as the backbone. However, there exists a large semantic gap between LLMs and recommender…

信息检索 · 计算机科学 2024-04-22 Bowen Zheng , Yupeng Hou , Hongyu Lu , Yu Chen , Wayne Xin Zhao , Ming Chen , Ji-Rong Wen

Multimodal Large Language Models (MLLMs) achieve remarkable capabilities but can inadvertently memorize privacy-sensitive information. Although existing unlearning methods can remove such knowledge, they fail to achieve benign forgetting…

人工智能 · 计算机科学 2025-11-26 Zhen Zeng , Leijiang Gu , Zhangling Duan , Feng Li , Zenglin Shi , Cees G. M. Snoek , Meng Wang

With the growing demand for safeguarding sensitive user information in recommender systems, recommendation attribute unlearning is receiving increasing attention. Existing studies predominantly focus on single-attribute unlearning. However,…

机器学习 · 计算机科学 2025-10-24 Fengyuan Yu , Yuyuan Li , Xiaohua Feng , Junjie Fang , Tao Wang , Chaochao Chen

Modern machine learning models are expensive to train, and there is a growing concern about the challenge of retroactively removing specific training data. Achieving exact unlearning in deep learning pipelines--producing models as if…

机器学习 · 计算机科学 2025-10-01 Andrei I. Muresanu , Anvith Thudi , Michael R. Zhang , Nicolas Papernot

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, their tendency to memorize training data raises concerns regarding privacy, copyright compliance, and…

机器学习 · 计算机科学 2025-06-23 Arjun Dosajh , Mihika Sanghi

Recent advances in Large Language Models (LLMs) have driven their adoption in recommender systems through Retrieval-Augmented Generation (RAG) frameworks. However, existing RAG approaches predominantly rely on flat, similarity-based…

信息检索 · 计算机科学 2025-06-10 Vahid Azizi , Fatemeh Koochaki

While large language models have demonstrated impressive performance across various domains and tasks, their security issues have become increasingly severe. Machine unlearning has emerged as a representative approach for model safety and…

机器学习 · 计算机科学 2025-03-04 Chongyang Gao , Lixu Wang , Kaize Ding , Chenkai Weng , Xiao Wang , Qi Zhu

Recommender systems help users navigate information overload by providing personalized recommendations aligned with their preferences. Collaborative Filtering (CF) is a widely adopted approach, but while advanced techniques like graph…

信息检索 · 计算机科学 2024-09-24 Qiyao Ma , Xubin Ren , Chao Huang

The deployment of large language models (LLMs) like ChatGPT and Gemini has shown their powerful natural language generation capabilities. However, these models can inadvertently learn and retain sensitive information and harmful content…

密码学与安全 · 计算机科学 2025-10-14 Shang Wang , Tianqing Zhu , Dayong Ye , Wanlei Zhou

Log Anomaly Detection (LAD) seeks to identify atypical patterns in log data that are crucial to assessing the security and condition of systems. Although Large Language Models (LLMs) have shown tremendous success in various fields, the use…

机器学习 · 计算机科学 2025-03-12 Ying Fu Lim , Jiawen Zhu , Guansong Pang