English
Related papers

Related papers: Privacy Auditing of Large Language Models

200 papers

Large Language Models (LLMs) hold promise for advancing legal practice by automating complex tasks and improving access to justice. However, their adoption is limited by concerns over client confidentiality, especially when lawyers include…

Computation and Language · Computer Science 2025-01-22 M. Mikail Demir , Hakan T. Otal , M. Abdullah Canbaz

Recently, large language models (LLMs) have emerged as a notable field, attracting significant attention for its ability to automatically generate intelligent contents for various application domains. However, LLMs still suffer from…

Cryptography and Security · Computer Science 2024-04-29 Kongyang Chen , Zixin Wang , Bing Mi , Waixi Liu , Shaowei Wang , Xiaojun Ren , Jiaxing Shen

Large Language Models (LLMs) pose significant privacy risks, potentially leaking training data due to implicit memorization. Existing privacy attacks primarily focus on membership inference attacks (MIAs) or data extraction attacks, but…

Computation and Language · Computer Science 2025-06-11 Wenlong Meng , Zhenyuan Guo , Lenan Wu , Chen Gong , Wenyan Liu , Weixian Li , Chengkun Wei , Wenzhi Chen

This is the first survey of the active area of AI research that focuses on privacy issues in Large Language Models (LLMs). Specifically, we focus on work that red-teams models to highlight privacy risks, attempts to build privacy into the…

Artificial Intelligence · Computer Science 2024-06-03 Seth Neel , Peter Chang

Large language models (LLMs), especially those based on the Transformer architecture, have had a profound impact on various aspects of daily life, such as natural language processing, content generation, research methodologies, and more.…

Machine Learning · Computer Science 2024-10-15 Yeqi Gao , Zhao Song , Xin Yang , Yufa Zhou

The growing use of large language models in sensitive domains has exposed a critical weakness: the inability to ensure that private information can be permanently forgotten. Yet these systems still lack reliable mechanisms to guarantee that…

Machine Learning · Computer Science 2025-11-14 James Jin Kang , Dang Bui , Thanh Pham , Huo-Chong Ling

Fine-tuning large language models (LLMs) has become an essential strategy for adapting them to specialized tasks; however, this process introduces significant privacy challenges, as sensitive training data may be inadvertently memorized and…

Cryptography and Security · Computer Science 2025-05-02 Hao Du , Shang Liu , Yang Cao

Large Language Models (LLMs) memorize, and thus, among huge amounts of uncontrolled data, may memorize Personally Identifiable Information (PII), which should not be stored and, consequently, not leaked. In this paper, we introduce Private…

Cryptography and Security · Computer Science 2025-08-22 Elena Sofia Ruzzetti , Giancarlo A. Xompero , Davide Venditti , Fabio Massimo Zanzotto

Auditing mechanisms for differential privacy use probabilistic means to empirically estimate the privacy level of an algorithm. For private machine learning, existing auditing mechanisms are tight: the empirical privacy estimate (nearly)…

Large Language Models (LLMs) are increasingly being used for automated evaluations and explaining them. However, concerns about explanation quality, consistency, and hallucinations remain open research challenges, particularly in…

Human-Computer Interaction · Computer Science 2025-04-18 Vincent Freiberger , Arthur Fleig , Erik Buchmann

As Large Language Models (LLMs) evolve into personal assistants with access to sensitive user data, they face a critical privacy challenge: while prior work has addressed output-level privacy, recent findings reveal that LLMs often leak…

Cryptography and Security · Computer Science 2025-11-24 Shourya Batra , Pierce Tillman , Samarth Gaggar , Shashank Kesineni , Kevin Zhu , Sunishchal Dev , Ashwinee Panda , Vasu Sharma , Maheep Chaudhary

We give simpler, sparser, and faster algorithms for differentially private fine-tuning of large-scale pre-trained language models, which achieve the state-of-the-art privacy versus utility tradeoffs on many standard NLP tasks. We propose a…

The widespread usage of online Large Language Models (LLMs) inference services has raised significant privacy concerns about the potential exposure of private information in user inputs to malicious eavesdroppers. Existing privacy…

Cryptography and Security · Computer Science 2025-05-29 Ziqian Zeng , Jianwei Wang , Junyao Yang , Zhengdong Lu , Haoran Li , Huiping Zhuang , Cen Chen

The adoption of Large Language Models (LLMs) has revolutionized AI applications but poses significant challenges in safeguarding user privacy. Ensuring compliance with privacy regulations such as GDPR and CCPA while addressing nuanced…

Cryptography and Security · Computer Science 2025-01-23 Shubhi Asthana , Bing Zhang , Ruchi Mahindru , Chad DeLuca , Anna Lisa Gentile , Sandeep Gopisetty

We explore a knowledge sanitization approach to mitigate the privacy concerns associated with large language models (LLMs). LLMs trained on a large corpus of Web data can memorize and potentially reveal sensitive or confidential…

Computation and Language · Computer Science 2024-03-05 Yoichi Ishibashi , Hidetoshi Shimodaira

Large language models (LLMs) exhibit remarkable capabilities in understanding and generating natural language. However, these models can inadvertently memorize private information, posing significant privacy risks. This study addresses the…

Computation and Language · Computer Science 2024-09-17 Zhenhua Liu , Tong Zhu , Chuanyuan Tan , Wenliang Chen

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language processing but also pose significant privacy risks by memorizing and leaking Personally Identifiable Information (PII). Existing mitigation…

Machine Learning · Computer Science 2025-03-17 Ahmed Frikha , Muhammad Reza Ar Razi , Krishna Kanth Nakka , Ricardo Mendes , Xue Jiang , Xuebing Zhou

Large Language Models (LLMs) are gaining increasing attention due to their exceptional performance across numerous tasks. As a result, the general public utilize them as an influential tool for boosting their productivity while natural…

Cryptography and Security · Computer Science 2023-06-16 Zhigang Kan , Linbo Qiao , Hao Yu , Liwen Peng , Yifu Gao , Dongsheng Li

As the capabilities of pre-trained large language models (LLMs) continue to advance, the "pre-train and fine-tune" paradigm has become increasingly mainstream, leading to the development of various fine-tuning methods. However, the privacy…

Computation and Language · Computer Science 2025-07-02 Jie Hou , Chuxiong Wu , Lannan Luo , Qiang Zeng

Retrieval-based language models (LMs) have demonstrated improved interpretability, factuality, and adaptability compared to their parametric counterparts, by incorporating retrieved text from external datastores. While it is well known that…

Computation and Language · Computer Science 2023-05-25 Yangsibo Huang , Samyak Gupta , Zexuan Zhong , Kai Li , Danqi Chen
‹ Prev 1 3 4 5 6 7 10 Next ›