中文
相关论文

相关论文: Privacy Implications of Retrieval-Based Language M…

200 篇论文

Recent large-scale natural language processing (NLP) systems use a pre-trained Large Language Model (LLM) on massive and diverse corpora as a headstart. In practice, the pre-trained model is adapted to a wide array of tasks via fine-tuning…

计算与语言 · 计算机科学 2022-09-12 Jimit Majmudar , Christophe Dupuy , Charith Peris , Sami Smaili , Rahul Gupta , Richard Zemel

Large Language Models (LLMs) have a privacy concern because they memorize training data (including personally identifiable information (PII) like emails and phone numbers) and leak it during inference. A company can train an LLM on its…

密码学与安全 · 计算机科学 2023-07-21 Jaydeep Borkar

The proliferation of Large Language Models (LLMs) has driven considerable interest in fine-tuning them with domain-specific data to create specialized language models. Nevertheless, such domain-specific fine-tuning data often contains…

Model adaptation is crucial to handle the discrepancy between proxy training data and actual users data received. To effectively perform adaptation, textual data of users is typically stored on servers or their local devices, where…

计算与语言 · 计算机科学 2023-12-15 Arpita Vats , Zhe Liu , Peng Su , Debjyoti Paul , Yingyi Ma , Yutong Pang , Zeeshan Ahmed , Ozlem Kalinli

The rapid advancements of large language models (LLMs) have raised public concerns about the privacy leakage of personally identifiable information (PII) within their extensive training datasets. Recent studies have demonstrated that an…

密码学与安全 · 计算机科学 2024-08-01 Xiaoyi Chen , Siyuan Tang , Rui Zhu , Shijun Yan , Lei Jin , Zihao Wang , Liya Su , Zhikun Zhang , XiaoFeng Wang , Haixu Tang

Deep Neural Network (DNN) models have been shown to have high empirical privacy leakages. Clinical language models (CLMs) trained on clinical data have been used to improve performance in biomedical natural language processing tasks. In…

计算与语言 · 计算机科学 2021-04-20 Abhyuday Jagannatha , Bhanu Pratap Singh Rawat , Hong Yu

Fine-tuning large language models (LLMs) for specific tasks introduces privacy risks, as models may inadvertently memorise and leak sensitive training data. While Differential Privacy (DP) offers a solution to mitigate these risks, it…

机器学习 · 计算机科学 2024-11-26 Olivia Ma , Jonathan Passerat-Palmbach , Dmitrii Usynin

Vision-Language Models (VLMs) combine visual and textual understanding, rendering them well-suited for diverse tasks like generating image captions and answering visual questions across various domains. However, these capabilities are built…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Simone Caldarella , Massimiliano Mancini , Elisa Ricci , Rahaf Aljundi

The recent advances in large language models (LLMs) have significantly expanded their applications across various fields such as language generation, summarization, and complex question answering. However, their application to privacy…

Rapid advances in Natural Language Processing (NLP) have revolutionized many fields, including healthcare. However, these advances raise significant privacy concerns, especially when pre-trained models fine-tuned and specialized on…

计算与语言 · 计算机科学 2026-05-21 Antoine Boutet , Lucas Magnana , Juliette Sénéchal

In sensitive domains such as medical and legal, protecting sensitive information is critical, with protective laws strictly prohibiting the disclosure of personal data. This poses challenges for sharing valuable data such as medical reports…

计算与语言 · 计算机科学 2025-05-28 Anthony Hughes , Ning Ma , Nikolaos Aletras

Large language models (LLMs) have significantly transformed natural language understanding and generation, but they raise privacy concerns due to potential exposure of sensitive information. Studies have highlighted the risk of information…

机器学习 · 计算机科学 2025-11-20 Bishnu Bhusal , Manoj Acharya , Ramneet Kaur , Colin Samplawski , Anirban Roy , Adam D. Cobb , Rohit Chadha , Susmit Jha

Pre-trained language models (PTLMs) have achieved great success and remarkable performance over a wide range of natural language processing (NLP) tasks. However, there are also growing concerns regarding the potential security issues in the…

密码学与安全 · 计算机科学 2022-02-15 Shangwei Guo , Chunlong Xie , Jiwei Li , Lingjuan Lyu , Tianwei Zhang

Users interacting with large language models (LLMs) under their real identifiers often unknowingly risk disclosing private information. Automatically notifying users whether their queries leak privacy and which phrases leak what private…

计算与语言 · 计算机科学 2025-08-11 Hang Zeng , Xiangyu Liu , Yong Hu , Chaoyue Niu , Fan Wu , Shaojie Tang , Guihai Chen

Recent advances in Retrieval-Augmented Generation (RAG) have enabled large language models (LLMs) to ground outputs in clinical evidence. However, connecting LLMs with external databases introduces the risk of contextual leakage: a subtle…

计算与语言 · 计算机科学 2026-03-17 Shaowei Guan , Yu Zhai , Hin Chi Kwok , Jiawei Du , Xinyu Feng , Jing Li , Harry Qin , Vivian Hui

Large language models (LLMs) have significantly transformed the landscape of Natural Language Processing (NLP). Their impact extends across a diverse spectrum of tasks, revolutionizing how we approach language understanding and generations.…

密码学与安全 · 计算机科学 2025-06-13 Sara Abdali , Richard Anarfi , CJ Barberan , Jia He , Erfan Shayegani

Current privacy research on large language models (LLMs) primarily focuses on the issue of extracting memorized training data. At the same time, models' inference capabilities have increased drastically. This raises the key question of…

人工智能 · 计算机科学 2024-05-07 Robin Staab , Mark Vero , Mislav Balunović , Martin Vechev

The interactive nature of Large Language Models (LLMs), which closely track user data and context, has prompted users to share personal and private information in unprecedented ways. Even when users opt out of allowing their data to be used…

密码学与安全 · 计算机科学 2025-08-26 GodsGift Uzor , Hasan Al-Qudah , Ynes Ineza , Abdul Serwadda

With the widespread application of large language models (LLMs), user privacy protection has become a significant research topic. Existing privacy preference modeling methods often rely on large-scale user data, making effective privacy…

密码学与安全 · 计算机科学 2025-05-13 Haowei Yang , Qingyi Lu , Yang Wang , Sibei Liu , Jiayun Zheng , Ao Xiang

Large Language Models (LLMs) are widely used in sensitive domains, including healthcare, finance, and legal services, raising concerns about potential private information leaks during inference. Privacy extraction attacks, such as…

密码学与安全 · 计算机科学 2025-06-25 Jinwen He , Yiyang Lu , Zijin Lin , Kai Chen , Yue Zhao