English
Related papers

Related papers: What Should LLMs Forget? Quantifying Personal Data…

200 papers

Personalized large language models (LLMs) rely on memory retrieval to incorporate user-specific histories, preferences, and contexts. Existing approaches either overload the LLM by feeding all the user's past memory into the prompt, which…

Information Retrieval · Computer Science 2026-03-11 Yingyi Zhang , Junyi Li , Wenlin Zhang , Penyue Jia , Xianneng Li , Yichao Wang , Derong Xu , Yi Wen , Huifeng Guo , Yong Liu , Xiangyu Zhao

Large language model (LLM) unlearning is critical in real-world applications where it is necessary to efficiently remove the influence of private, copyrighted, or harmful data from some users. Existing utility-centric unlearning metrics…

Large language models (LLMs) have shown remarkable performance on a variety of NLP tasks, and are being rapidly adopted in a wide range of use cases. It is therefore of vital importance to holistically evaluate the factuality of their…

Computation and Language · Computer Science 2024-04-26 Jiaqing Yuan , Lin Pan , Chung-Wei Hang , Jiang Guo , Jiarong Jiang , Bonan Min , Patrick Ng , Zhiguo Wang

Privacy policies help inform people about organisations' personal data processing practices, covering different aspects such as data collection, data storage, and sharing of personal data with third parties. Privacy policies are often…

Artificial Intelligence · Computer Science 2026-01-16 Haiyue Yuan , Nikolay Matyunin , Ali Raza , Shujun Li

Right to be Forgotten (RTBF) in one of the oldest and prominent of the legal data rights. While its legal intention is straight forward (for example, the GDPR describes it in just 417 words), the computing community has found it challenging…

Computers and Society · Computer Science 2026-05-27 Chen Sun , Nikolas Guggenberger , Supreeth Shastri

Rapid advances in Natural Language Processing (NLP) have revolutionized many fields, including healthcare. However, these advances raise significant privacy concerns, especially when pre-trained models fine-tuned and specialized on…

Computation and Language · Computer Science 2026-05-21 Antoine Boutet , Lucas Magnana , Juliette Sénéchal

Large Language Models (LLMs) have significantly advanced Natural Language Processing (NLP), particularly in Natural Language Understanding (NLU) tasks. As we progress toward an agentic world where LLM-based agents autonomously handle…

Computation and Language · Computer Science 2025-04-03 Naimul Haque

The right to be forgotten, also known as the right to erasure, is the right of individuals to have their data erased from an entity storing it. The status of this long held notion was legally solidified recently by the General Data…

Cryptography and Security · Computer Science 2020-12-02 David Marco Sommer , Liwei Song , Sameer Wagh , Prateek Mittal

Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and generation, serving as the foundation for advanced persona simulation and Role-Playing Language Agents (RPLAs). However, achieving authentic alignment…

Computation and Language · Computer Science 2026-04-20 Xintao Wang , Jian Yang , Weiyuan Li , Rui Xie , Jen-tse Huang , Jun Gao , Shuai Huang , Yueping Kang , Yuanli Gou , Hongwei Feng , Yanghua Xiao

In this work, we explore the use of Large Language Models (LLMs) for knowledge engineering tasks in the context of the ISWC 2023 LM-KBC Challenge. For this task, given subject and relation pairs sourced from Wikidata, we utilize pre-trained…

Computation and Language · Computer Science 2023-09-18 Bohui Zhang , Ioannis Reklos , Nitisha Jain , Albert Meroño Peñuela , Elena Simperl

Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their transition to real-world applications reveals a critical limitation: the inability to adapt to individual preferences while maintaining alignment with…

Computation and Language · Computer Science 2025-05-06 Jian Guan , Junfei Wu , Jia-Nan Li , Chuanqi Cheng , Wei Wu

Language models (LMs) are trained on vast amounts of text data, which may include private and copyrighted content. Data owners may request the removal of their data from a trained model due to privacy or copyright concerns. However, exactly…

Computation and Language · Computer Science 2024-07-16 Weijia Shi , Jaechan Lee , Yangsibo Huang , Sadhika Malladi , Jieyu Zhao , Ari Holtzman , Daogao Liu , Luke Zettlemoyer , Noah A. Smith , Chiyuan Zhang

Document understanding models have recently demonstrated remarkable performance by leveraging extensive collections of user documents. However, since documents often contain large amounts of personal data, their usage can pose a threat to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Lei Kang , Mohamed Ali Souibgui , Fei Yang , Lluis Gomez , Ernest Valveny , Dimosthenis Karatzas

Although large language models (LLMs) have been touted for their ability to generate natural-sounding text, there are growing concerns around possible negative effects of LLMs such as data memorization, bias, and inappropriate language.…

Machine Learning · Computer Science 2023-05-10 Michael Kuchnik , Virginia Smith , George Amvrosiadis

Large language models (LLMs) excel in many natural language processing (NLP) tasks. However, since LLMs can only incorporate new knowledge through training or supervised fine-tuning processes, they are unsuitable for applications that…

Databases · Computer Science 2024-07-23 Zongyue Qin , Chen Luo , Zhengyang Wang , Haoming Jiang , Yizhou Sun

Large language models (LLMs) are primarily accessed via commercial APIs, but this often requires users to expose their data to service providers. In this paper, we explore how users can stay in control of their data by using privacy…

Computation and Language · Computer Science 2025-10-21 Guillem Ramírez , Alexandra Birch , Ivan Titov

Machine unlearning has the potential to improve the safety of large language models (LLMs) by removing sensitive or harmful information post hoc. A key challenge in unlearning involves balancing between forget quality (effectively…

Machine Learning · Computer Science 2025-06-23 Shengyuan Hu , Neil Kale , Pratiksha Thaker , Yiwei Fu , Steven Wu , Virginia Smith

Large Language Models (LLMs) have achieved remarkable progress in natural language understanding, reasoning, and autonomous decision-making. However, these advancements have also come with significant privacy concerns. While significant…

Cryptography and Security · Computer Science 2026-01-27 Yuntao Du , Zitao Li , Ninghui Li , Bolin Ding

Large Language Models (LLMs) memorize, and thus, among huge amounts of uncontrolled data, may memorize Personally Identifiable Information (PII), which should not be stored and, consequently, not leaked. In this paper, we introduce Private…

Cryptography and Security · Computer Science 2025-08-22 Elena Sofia Ruzzetti , Giancarlo A. Xompero , Davide Venditti , Fabio Massimo Zanzotto

Language Models (LMs) are prone to ''memorizing'' training data, including substantial sensitive user information. To mitigate privacy risks and safeguard the right to be forgotten, machine unlearning has emerged as a promising approach for…

Cryptography and Security · Computer Science 2025-06-11 Jiacheng Du , Zhibo Wang , Jie Zhang , Xiaoyi Pang , Jiahui Hu , Kui Ren