English
Related papers

Related papers: Towards Efficient and Effective Unlearning of Larg…

200 papers

The deployment of large language models (LLMs) like ChatGPT and Gemini has shown their powerful natural language generation capabilities. However, these models can inadvertently learn and retain sensitive information and harmful content…

Cryptography and Security · Computer Science 2025-10-14 Shang Wang , Tianqing Zhu , Dayong Ye , Wanlei Zhou

Large Language Models (LLMs) have demonstrated strong reasoning and memorization capabilities via pretraining on massive textual corpora. However, this poses risk of privacy and copyright violations, highlighting the need for efficient…

Machine Learning · Computer Science 2025-04-28 Sungmin Cha , Sungjun Cho , Dasol Hwang , Moontae Lee

Large language model (LLM) unlearning has become a critical mechanism for removing undesired data, knowledge, or behaviors from pre-trained models while retaining their general utility. Yet, with the rise of open-weight LLMs, we ask: can…

Machine Learning · Computer Science 2025-10-21 Bingqi Shang , Yiwei Chen , Yihua Zhang , Bingquan Shen , Sijia Liu

Users of a recommender system may want part of their data being deleted, not only from the data repository but also from the underlying machine learning model, for privacy or utility reasons. Such right-to-be-forgotten requests could be…

Information Retrieval · Computer Science 2022-08-16 Wenyan Liu , Juncheng Wan , Xiaoling Wang , Weinan Zhang , Dell Zhang , Hang Li

We explore machine unlearning (MU) in the domain of large language models (LLMs), referred to as LLM unlearning. This initiative aims to eliminate undesirable data influence (e.g., sensitive or illegal information) and the associated model…

The objective of digital forgetting is, given a model with undesirable knowledge or behavior, obtain a new model where the detected issues are no longer present. The motivations for forgetting include privacy protection, copyright…

Cryptography and Security · Computer Science 2025-01-14 Alberto Blanco-Justicia , Najeeb Jebreel , Benet Manzanares , David Sánchez , Josep Domingo-Ferrer , Guillem Collell , Kuan Eeik Tan

Intent learning, which aims to learn users' intents for user understanding and item recommendation, has become a hot research spot in recent years. However, existing methods suffer from complex and cumbersome alternating optimization,…

Information Retrieval · Computer Science 2024-11-12 Yue Liu , Shihao Zhu , Jun Xia , Yingwei Ma , Jian Ma , Xinwang Liu , Shengju Yu , Kejun Zhang , Wenliang Zhong

The recent advancements in Large Language Models (LLMs) have generated considerable interest in their utilization for sequential recommendation tasks. While collaborative signals from similar users are central to recommendation modeling,…

Information Retrieval · Computer Science 2025-04-15 Tong Zhang

Large Language Models (LLMs) have demonstrated strong capabilities in memorizing vast amounts of knowledge across diverse domains. However, the ability to selectively forget specific knowledge is critical for ensuring the safety and…

Computation and Language · Computer Science 2025-05-20 Zhijie Deng , Chris Yuhao Liu , Zirui Pang , Xinlei He , Lei Feng , Qi Xuan , Zhaowei Zhu , Jiaheng Wei

Large Language Models (LLMs) have demonstrated remarkable capabilities and have been extensively deployed across various domains, including recommender systems. Prior research has employed specialized \textit{prompts} to leverage the…

Information Retrieval · Computer Science 2024-04-02 Sichun Luo , Bowei He , Haohan Zhao , Wei Shao , Yanlin Qi , Yinya Huang , Aojun Zhou , Yuxuan Yao , Zongpeng Li , Yuanzhang Xiao , Mingjie Zhan , Linqi Song

Large Language Models (LLMs) deployed in real-world settings increasingly face the need to unlearn sensitive, outdated, or proprietary information. Existing unlearning methods typically formulate forgetting and retention as a regularized…

Computation and Language · Computer Science 2025-10-28 Taha Entesari , Arman Hatami , Rinat Khaziev , Anil Ramakrishna , Mahyar Fazlyab

Language Models (LMs) are prone to ''memorizing'' training data, including substantial sensitive user information. To mitigate privacy risks and safeguard the right to be forgotten, machine unlearning has emerged as a promising approach for…

Cryptography and Security · Computer Science 2025-06-11 Jiacheng Du , Zhibo Wang , Jie Zhang , Xiaoyi Pang , Jiahui Hu , Kui Ren

Unlearning in large foundation models (e.g., LLMs) is essential for enabling dynamic knowledge updates, enforcing data deletion rights, and correcting model behavior. However, existing unlearning methods often require full-model fine-tuning…

Machine Learning · Computer Science 2025-12-09 Yezi Liu , Hanning Chen , Wenjun Huang , Yang Ni , Mohsen Imani

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, their tendency to memorize training data raises concerns regarding privacy, copyright compliance, and…

Machine Learning · Computer Science 2025-06-23 Arjun Dosajh , Mihika Sanghi

Large language model unlearning has garnered increasing attention due to its potential to address security and privacy concerns, leading to extensive research in the field. However, much of this research has concentrated on instance-level…

Computation and Language · Computer Science 2025-05-20 Weitao Ma , Xiaocheng Feng , Weihong Zhong , Lei Huang , Yangfan Ye , Xiachong Feng , Bing Qin

Recently, sequential recommendation has been adapted to the LLM paradigm to enjoy the power of LLMs. LLM-based methods usually formulate recommendation information into natural language and the model is trained to predict the next item in…

Information Retrieval · Computer Science 2024-02-16 Hanbing Wang , Xiaorui Liu , Wenqi Fan , Xiangyu Zhao , Venkataramana Kini , Devendra Yadav , Fei Wang , Zhen Wen , Jiliang Tang , Hui Liu

Large language models (LLMs) are trained on massive datasets that may include private or copyrighted content. Due to growing privacy and ownership concerns, data owners may request the removal of their data from trained models. Machine…

Machine Learning · Computer Science 2026-01-13 Zhihao Liu , Jian Lou , Yuke Hu , Xiaochen Li , Yitian Chen , Tailun Chen , Zhizhen Qin , Kui Ren , Zhan Qin

Large Language Models (LLMs) have made significant strides in natural language processing and are increasingly being integrated into recommendation systems. However, their potential in educational recommendation systems has yet to be fully…

Information Retrieval · Computer Science 2025-04-14 Boxuan Ma , Md Akib Zabed Khan , Tianyuan Yang , Agoritsa Polyzou , Shin'ichi Konomi

Recent advancements in Large Language Models (LLMs) have showcased their remarkable capabilities in text understanding and generation. However, even stronger LLMs are susceptible to acquiring erroneous or obsolete information from the…

Computation and Language · Computer Science 2024-02-19 Shiwen Ni , Dingwei Chen , Chengming Li , Xiping Hu , Ruifeng Xu , Min Yang

Recent recommender systems increasingly leverage embeddings from large pre-trained language models (PLMs). However, such embeddings exhibit two key limitations: (1) PLMs are not explicitly optimized to produce structured and discriminative…

Computation and Language · Computer Science 2026-01-19 Guy Hadad , Neomi Rabaev , Bracha Shapira
‹ Prev 1 4 5 6 7 8 10 Next ›