中文
相关论文

相关论文: SentinelLMs: Encrypted Input Adaptation and Fine-t…

200 篇论文

Pretrained Language Models (LMs) memorize a vast amount of knowledge during initial pretraining, including information that may violate the privacy of personal lives and identities. Previous work addressing privacy issues for language…

计算与语言 · 计算机科学 2022-12-20 Joel Jang , Dongkeun Yoon , Sohee Yang , Sungmin Cha , Moontae Lee , Lajanugen Logeswaran , Minjoon Seo

Pre-trained language models (PTLMs) have achieved great success and remarkable performance over a wide range of natural language processing (NLP) tasks. However, there are also growing concerns regarding the potential security issues in the…

密码学与安全 · 计算机科学 2022-02-15 Shangwei Guo , Chunlong Xie , Jiwei Li , Lingjuan Lyu , Tianwei Zhang

Although Large Language Models (LLMs) have become increasingly integral to diverse applications, their capabilities raise significant privacy concerns. This survey offers a comprehensive overview of privacy risks associated with LLMs and…

密码学与安全 · 计算机科学 2025-05-06 Kang Chen , Xiuze Zhou , Yuanguo Lin , Shibo Feng , Li Shen , Pengcheng Wu

Large language models (LLMs) are becoming a popular tool as they have significantly advanced in their capability to tackle a wide range of language-based tasks. However, LLMs applications are highly vulnerable to prompt injection attacks,…

计算与语言 · 计算机科学 2024-11-11 Md Abdur Rahman , Fan Wu , Alfredo Cuzzocrea , Sheikh Iqbal Ahamed

Large scale adoption of large language models has introduced a new era of convenient knowledge transfer for a slew of natural language processing tasks. However, these models also run the risk of undermining user trust by exposing unwanted…

计算与语言 · 计算机科学 2022-04-21 Richard Plant , Valerio Giuffrida , Dimitra Gkatzia

Recent advances in neural network based language models lead to successful deployments of such models, improving user experience in various applications. It has been demonstrated that strong performance of language models comes along with…

密码学与安全 · 计算机科学 2021-02-24 Huseyin A. Inan , Osman Ramadan , Lukas Wutschitz , Daniel Jones , Victor Rühle , James Withers , Robert Sim

The widespread adoption of large language models (LLMs) has raised concerns regarding data privacy. This study aims to investigate the potential for privacy invasion through input reconstruction attacks, in which a malicious model provider…

机器学习 · 计算机科学 2024-05-24 Zhipeng Wan , Anda Cheng , Yinggui Wang , Lei Wang

Machine Learning approaches to Natural Language Processing tasks benefit from a comprehensive collection of real-life user data. At the same time, there is a clear need for protecting the privacy of the users whose data is collected and…

计算与语言 · 计算机科学 2022-11-16 David Ifeoluwa Adelani , Ali Davody , Thomas Kleinbauer , Dietrich Klakow

We identify a novel phenomenon in language models: benign fine-tuning of frontier models can lead to privacy collapse. We find that diverse, subtle patterns in training data can degrade contextual privacy, including optimisation for…

计算与语言 · 计算机科学 2026-04-21 Anmol Goel , Cornelius Emde , Sangdoo Yun , Seong Joon Oh , Martin Gubri

Machine learning models are prone to memorizing sensitive data, making them vulnerable to membership inference attacks in which an adversary aims to guess if an input sample was used to train the model. In this paper, we show that prior…

密码学与安全 · 计算机科学 2020-12-10 Liwei Song , Prateek Mittal

With the rapid development of artificial intelligence, large language models (LLMs) have made remarkable advancements in natural language processing. These models are trained on vast datasets to exhibit powerful language understanding and…

密码学与安全 · 计算机科学 2025-09-22 Shang Wang , Tianqing Zhu , Bo Liu , Ming Ding , Dayong Ye , Wanlei Zhou , Philip S. Yu

Current LLM-based services typically require users to submit raw text regardless of its sensitivity. While intuitive, such practice introduces substantial privacy risks, as unauthorized access may expose personal, medical, or legal…

密码学与安全 · 计算机科学 2026-04-09 Jeongho Yoon , Chanhee Park , Yongchan Chun , Hyeonseok Moon , Heuiseok Lim

Large language models (LLMs) have significantly transformed the landscape of Natural Language Processing (NLP). Their impact extends across a diverse spectrum of tasks, revolutionizing how we approach language understanding and generations.…

密码学与安全 · 计算机科学 2025-06-13 Sara Abdali , Richard Anarfi , CJ Barberan , Jia He , Erfan Shayegani

The misuse of Large Language Models (LLMs) to infer emotions from text for malicious purposes, known as emotion inference attacks, poses a significant threat to user privacy. In this paper, we investigate the potential of Apple…

机器学习 · 计算机科学 2025-06-05 Mohd. Farhan Israk Soumik , Syed Mhamudul Hasan , Abdur R. Shahid

We demonstrate that it is possible to train large recurrent language models with user-level differential privacy guarantees with only a negligible cost in predictive accuracy. Our work builds on recent advances in the training of deep…

机器学习 · 计算机科学 2018-02-27 H. Brendan McMahan , Daniel Ramage , Kunal Talwar , Li Zhang

The recent progression of Large Language Models (LLMs) has witnessed great success in the fields of data-centric applications. LLMs trained on massive textual datasets showed ability to encode not only context but also ability to provide…

密码学与安全 · 计算机科学 2024-05-24 Mohammed Hassanin , Nour Moustafa

The large transformer-based language models demonstrate excellent performance in natural language processing. By considering the transferability of the knowledge gained by these models in one domain to other related domains, and the…

密码学与安全 · 计算机科学 2022-09-07 Chandra Thapa , Seung Ick Jang , Muhammad Ejaz Ahmed , Seyit Camtepe , Josef Pieprzyk , Surya Nepal

Backdoor data poisoning, inserted within instruction examples used to fine-tune a foundation Large Language Model (LLM) for downstream tasks (\textit{e.g.,} sentiment prediction), is a serious security concern due to the evasive nature of…

密码学与安全 · 计算机科学 2024-08-23 Jayaram Raghuram , George Kesidis , David J. Miller

Large Language Models (LLMs), which bridge the gap between human language understanding and complex problem-solving, achieve state-of-the-art performance on several NLP tasks, particularly in few-shot and zero-shot settings. Despite the…

密码学与安全 · 计算机科学 2025-01-07 Shuai Zhao , Meihuizi Jia , Zhongliang Guo , Leilei Gan , Xiaoyu Xu , Xiaobao Wu , Jie Fu , Yichao Feng , Fengjun Pan , Luu Anh Tuan

Recent developments in Large Language Models (LLMs) have manifested significant advancements. To facilitate safeguards against malicious exploitation, a body of research has concentrated on aligning LLMs with human preferences and…

密码学与安全 · 计算机科学 2024-06-11 Yuanpu Cao , Bochuan Cao , Jinghui Chen