English
Related papers

Related papers: Learnable Privacy Neurons Localization in Language…

200 papers

Large Language Models (LLMs) have shown to be a great success in a wide range of applications ranging from regular NLP-based use cases to AI agents. LLMs have been trained on a vast corpus of texts from various sources; despite the best…

Computation and Language · Computer Science 2024-11-26 Abhinav Joshi , Shaswati Saha , Divyaksh Shukla , Sriram Vema , Harsh Jhamtani , Manas Gaur , Ashutosh Modi

Large Language Models (LLMs) have empowered AI agents with advanced capabilities for understanding, reasoning, and interacting across diverse tasks. The addition of memory further enhances them by enabling continuity across interactions,…

Artificial Intelligence · Computer Science 2025-12-19 Himanshu Gharat , Himanshi Agrawal , Gourab K. Patro

Local differential privacy (LDP) has become a central topic in data privacy research, offering strong privacy guarantees by perturbing user data at the source and removing the need for a trusted curator. However, the noise introduced by LDP…

Machine Learning · Computer Science 2026-03-04 Caihong Qin , Yang Bai

Large language models (LLMs) have become increasingly proficient at simulating various personality traits, an important capability for supporting related applications (e.g., role-playing). To further improve this capacity, in this paper, we…

Computation and Language · Computer Science 2024-10-17 Jia Deng , Tianyi Tang , Yanbin Yin , Wenhao Yang , Wayne Xin Zhao , Ji-Rong Wen

Large Language Models (LLMs) are increasingly adopted across domains such as education, healthcare, and finance. In healthcare, LLMs support tasks including disease diagnosis, abnormality classification, and clinical decision-making. Among…

Cryptography and Security · Computer Science 2026-03-31 Payel Bhattacharjee , Fengwei Tian , Geoffrey D. Rubin , Joseph Y. Lo , Nirav Merchant , Heidi Hanson , John Gounley , Ravi Tandon

Fine-tuning large language models (LLMs) for specific tasks introduces privacy risks, as models may inadvertently memorise and leak sensitive training data. While Differential Privacy (DP) offers a solution to mitigate these risks, it…

Machine Learning · Computer Science 2024-11-26 Olivia Ma , Jonathan Passerat-Palmbach , Dmitrii Usynin

With the widespread application of large language models (LLMs), user privacy protection has become a significant research topic. Existing privacy preference modeling methods often rely on large-scale user data, making effective privacy…

Cryptography and Security · Computer Science 2025-05-13 Haowei Yang , Qingyi Lu , Yang Wang , Sibei Liu , Jiayun Zheng , Ao Xiang

Train machine learning models on sensitive user data has raised increasing privacy concerns in many areas. Federated learning is a popular approach for privacy protection that collects the local gradient information instead of real data.…

Cryptography and Security · Computer Science 2021-05-24 Lichao Sun , Jianwei Qian , Xun Chen

With the widespread adoption of large language models (LLMs), understanding their personality representation mechanisms has become critical. As a novel paradigm in Personality Editing, most existing methods employ neuron-editing to locate…

Computation and Language · Computer Science 2026-05-01 Lifan Zheng , Xue Yang , Jiawei Chen , Chenyan Wu , Jingyuan Zhang , Fanheng Kong , Xinyi Zeng , Xiang Chen , Yu Tian

We explore a knowledge sanitization approach to mitigate the privacy concerns associated with large language models (LLMs). LLMs trained on a large corpus of Web data can memorize and potentially reveal sensitive or confidential…

Computation and Language · Computer Science 2024-03-05 Yoichi Ishibashi , Hidetoshi Shimodaira

It has been demonstrated that hidden representation learned by a deep model can encode private information of the input, hence can be exploited to recover such information with reasonable accuracy. To address this issue, we propose a novel…

Machine Learning · Computer Science 2020-10-06 Lingjuan Lyu , Xuanli He , Yitong Li

As language models achieve increasingly human-like capabilities in conversational text generation, a critical question emerges: to what extent can these systems simulate the characteristics of specific individuals? To evaluate this, we…

Computation and Language · Computer Science 2025-06-04 Quan Shi , Carlos E. Jimenez , Stephen Dong , Brian Seo , Caden Yao , Adam Kelch , Karthik Narasimhan

Federated Learning (FL) is a technique to train models using data distributed across devices. Differential Privacy (DP) provides a formal privacy guarantee for sensitive data. Our goal is to train a large neural network language model…

Large Language Models (LLMs) have revolutionized how information are collected, aggregated, and reasoned. However, this enables a novel and accessible vector of privacy intrusion: the automated and in-depth personal profiling; this…

Cryptography and Security · Computer Science 2026-05-08 Jiahao Chen , Qi Zhang , Ruixiao Lin , Chunyi Zhou , Tianyu Du , Qingming Li , Tong Zhang , Junhao Li , Yuwen Pu , Shouling Ji

Large Language Models (LLMs) typically have billions of parameters and are thus often difficult to interpret in their operation. In this work, we demonstrate that it is possible to decode neuron weights directly into token probabilities…

Computation and Language · Computer Science 2025-03-03 Harry J Davies

Large Language Models (LLMs) have become integral to numerous domains, significantly advancing applications in data management, mining, and analysis. Their profound capabilities in processing and interpreting complex language data, however,…

Cryptography and Security · Computer Science 2024-09-09 Qinbin Li , Junyuan Hong , Chulin Xie , Jeffrey Tan , Rachel Xin , Junyi Hou , Xavier Yin , Zhun Wang , Dan Hendrycks , Zhangyang Wang , Bo Li , Bingsheng He , Dawn Song

Large Language Models (LLMs) are prevalent in modern applications but often memorize training data, leading to privacy breaches and copyright issues. Existing research has mainly focused on posthoc analyses, such as extracting memorized…

Machine Learning · Computer Science 2025-01-10 Tarun Ram Menta , Susmit Agrawal , Chirag Agarwal

We introduce the framework of "social learning" in the context of large language models (LLMs), whereby models share knowledge with each other in a privacy-aware manner using natural language. We present and evaluate two approaches for…

Machine Learning · Computer Science 2024-02-09 Amirkeivan Mohtashami , Florian Hartmann , Sian Gooding , Lukas Zilka , Matt Sharifi , Blaise Aguera y Arcas

Large Language Models (LLMs) have the promise to revolutionize computing broadly, but their complexity and extensive training data also expose significant privacy vulnerabilities. One of the simplest privacy risks associated with LLMs is…

Machine Learning · Computer Science 2024-09-25 Rongting Zhang , Martin Bertran , Aaron Roth

Large language models (LLMs) trained on web-scale corpora can memorize sensitive training data, posing significant privacy risks. Differential privacy (DP) has emerged as a principled framework that limits the influence of individual data…

Computation and Language · Computer Science 2026-05-13 Eduardo Tenorio , Karuna Bhaila , Xintao Wu