English
Related papers

Related papers: On Active Privacy Auditing in Supervised Fine-tuni…

200 papers

Large Language Models (LLMs) have become integral to numerous domains, significantly advancing applications in data management, mining, and analysis. Their profound capabilities in processing and interpreting complex language data, however,…

Cryptography and Security · Computer Science 2024-09-09 Qinbin Li , Junyuan Hong , Chulin Xie , Jeffrey Tan , Rachel Xin , Junyi Hou , Xavier Yin , Zhun Wang , Dan Hendrycks , Zhangyang Wang , Bo Li , Bingsheng He , Dawn Song

Large language models (LLMs) have emerged as powerful tools for tackling complex tasks across diverse domains, but they also raise privacy concerns when fine-tuned on sensitive data due to potential memorization. While differential privacy…

Computation and Language · Computer Science 2024-08-19 Lynn Chua , Badih Ghazi , Yangsibo Huang , Pritish Kamath , Ravi Kumar , Daogao Liu , Pasin Manurangsi , Amer Sinha , Chiyuan Zhang

Large language models (LLMs) require a significant redesign in solutions to preserve privacy in data-intensive applications due to their text-generation capabilities. Indeed, LLMs tend to memorize and emit private information when…

The increasing demand for domain-specific and human-aligned Large Language Models (LLMs) has led to the widespread adoption of Supervised Fine-Tuning (SFT) techniques. SFT datasets often comprise valuable instruction-response pairs, making…

Cryptography and Security · Computer Science 2025-06-24 Zongjie Li , Daoyuan Wu , Shuai Wang , Zhendong Su

Numerous companies have started offering services based on large language models (LLM), such as ChatGPT, which inevitably raises privacy concerns as users' prompts are exposed to the model provider. Previous research on secure reasoning…

Cryptography and Security · Computer Science 2023-09-07 Yu Chen , Tingxin Li , Huiming Liu , Yang Yu

Privacy policies are widely used by digital services and often required for legal purposes. Many machine learning based classifiers have been developed to automate detection of different concepts in a given privacy policy, which can help…

Computation and Language · Computer Science 2025-03-24 Yuxin Chen , Peng Tang , Weidong Qiu , Shujun Li

Large language models (LLMs) are complex artificial intelligence systems capable of understanding, generating and translating human language. They learn language patterns by analyzing large amounts of text data, allowing them to perform…

Cryptography and Security · Computer Science 2024-03-15 Biwei Yan , Kun Li , Minghui Xu , Yueyan Dong , Yue Zhang , Zhaochun Ren , Xiuzhen Cheng

The increasing parameters and expansive dataset of large language models (LLMs) highlight the urgent demand for a technical solution to audit the underlying privacy risks and copyright issues associated with LLMs. Existing studies have…

Computation and Language · Computer Science 2024-12-30 Wenjie Fu , Huandong Wang , Chen Gao , Guanghua Liu , Yong Li , Tao Jiang

Large Language Models (LLMs) are widely used in sensitive domains, including healthcare, finance, and legal services, raising concerns about potential private information leaks during inference. Privacy extraction attacks, such as…

Cryptography and Security · Computer Science 2025-06-25 Jinwen He , Yiyang Lu , Zijin Lin , Kai Chen , Yue Zhao

Algorithmic audits are essential tools for examining systems for properties required by regulators or desired by operators. Current audits of large language models (LLMs) primarily rely on black-box evaluations that assess model behavior…

Computers and Society · Computer Science 2026-05-19 Hannah Cyberey , Yangfeng Ji , David Evans

With LLMs increasingly deployed in corporate data management, it is crucial to ensure that these models do not leak sensitive information. In the context of corporate data management, the concept of sensitivity awareness has been…

Cryptography and Security · Computer Science 2026-01-30 Dren Fazlija , Iyiola E. Olatunji , Daniel Kudenko , Sandipan Sikdar

Despite the general capabilities of Large Language Models (LLM), these models still request fine-tuning or adaptation with customized data when meeting specific business demands. However, this process inevitably introduces new threats,…

Cryptography and Security · Computer Science 2024-06-21 Jiongxiao Wang , Jiazhao Li , Yiquan Li , Xiangyu Qi , Junjie Hu , Yixuan Li , Patrick McDaniel , Muhao Chen , Bo Li , Chaowei Xiao

Large Language Models (LLMs) have demonstrated extraordinary capabilities and contributed to multiple fields, such as generating and summarizing text, language translation, and question-answering. Nowadays, LLM is becoming a very popular…

Computation and Language · Computer Science 2024-11-18 Badhan Chandra Das , M. Hadi Amini , Yanzhao Wu

The de-identification of private information in medical data is a crucial process to mitigate the risk of confidentiality breaches, particularly when patient personal details are not adequately removed before the release of medical records.…

Cryptography and Security · Computer Science 2025-04-29 Guanchen Wu , Linzhi Zheng , Han Xie , Zhen Xiang , Jiaying Lu , Darren Liu , Delgersuren Bold , Bo Li , Xiao Hu , Carl Yang

The current literature on memorization in Natural Language Models, especially Large Language Models (LLMs), poses severe security and privacy risks, as models tend to memorize personally identifying information (PIIs) from training data. We…

Computation and Language · Computer Science 2026-02-19 Kunj Joshi , David A. Smith

We propose Fast-MIA (https://github.com/Nikkei/fast-mia), a Python library for efficiently evaluating membership inference attacks (MIA) against large language models (LLMs). MIA has emerged as a crucial technique for auditing privacy risks…

Cryptography and Security · Computer Science 2026-05-12 Hiromu Takahashi , Shotaro Ishihara

The advancement of large language models (LLMs) has significantly enhanced the ability to effectively tackle various downstream NLP tasks and unify these tasks into generative pipelines. On the one hand, powerful language models, trained on…

Computation and Language · Computer Science 2024-10-01 Haoran Li , Yulin Chen , Jinglong Luo , Jiecong Wang , Hao Peng , Yan Kang , Xiaojin Zhang , Qi Hu , Chunkit Chan , Zenglin Xu , Bryan Hooi , Yangqiu Song

Federated Parameter-Efficient Fine-Tuning (FedPEFT) has emerged as a promising paradigm for privacy-preserving and efficient adaptation of Pre-trained Language Models (PLMs) in Federated Learning (FL) settings. It preserves data privacy by…

Cryptography and Security · Computer Science 2024-12-20 Shenghui Li , Edith C. -H. Ngai , Fanghua Ye , Thiemo Voigt

Large Language Models (LLMs), which bridge the gap between human language understanding and complex problem-solving, achieve state-of-the-art performance on several NLP tasks, particularly in few-shot and zero-shot settings. Despite the…

Cryptography and Security · Computer Science 2025-01-07 Shuai Zhao , Meihuizi Jia , Zhongliang Guo , Leilei Gan , Xiaoyu Xu , Xiaobao Wu , Jie Fu , Yichao Feng , Fengjun Pan , Luu Anh Tuan

With the rapid advancement of large language models (LLMs), ensuring their safe use becomes increasingly critical. Fine-tuning is a widely used method for adapting models to downstream tasks, yet it is vulnerable to jailbreak attacks.…

Cryptography and Security · Computer Science 2025-10-10 Xiangfang Li , Yu Wang , Bo Li