English
Related papers

Related papers: Data-Free Privacy-Preserving for LLMs via Model In…

200 papers

Language Models (LMs) are prone to ''memorizing'' training data, including substantial sensitive user information. To mitigate privacy risks and safeguard the right to be forgotten, machine unlearning has emerged as a promising approach for…

Cryptography and Security · Computer Science 2025-06-11 Jiacheng Du , Zhibo Wang , Jie Zhang , Xiaoyi Pang , Jiahui Hu , Kui Ren

Machine Unlearning (MU) has recently gained considerable attention due to its potential to achieve Safe AI by removing the influence of specific data from trained Machine Learning (ML) models. This process, known as knowledge removal,…

Cryptography and Security · Computer Science 2025-02-18 Ziyao Liu , Huanyi Ye , Chen Chen , Yongsen Zheng , Kwok-Yan Lam

Large language models (LLMs) are complex artificial intelligence systems capable of understanding, generating and translating human language. They learn language patterns by analyzing large amounts of text data, allowing them to perform…

Cryptography and Security · Computer Science 2024-03-15 Biwei Yan , Kun Li , Minghui Xu , Yueyan Dong , Yue Zhang , Zhaochun Ren , Xiuzhen Cheng

Machine unlearning aims to remove specific data influences from trained models, a capability essential for adhering to copyright laws and ensuring AI safety. Current unlearning metrics typically measure success by monitoring the model's…

Cryptography and Security · Computer Science 2025-12-24 Hengrui Jia , Taoran Li , Jonas Guan , Varun Chandrasekaran

Noise-based certified machine unlearning currently faces a hard ceiling: the noise magnitude required to certify unlearning typically destroys model utility, particularly for large-scale deletion requests. While leveraging public data is a…

Machine Learning · Computer Science 2026-05-13 Ahmed Mehdi Inane , Vincent Quirion , Gintare Karolina Dzugaite , Ioannis Mitliagkas

With the continued advancement and widespread adoption of machine learning (ML) models across various domains, ensuring user privacy and data security has become a paramount concern. In compliance with data privacy regulations, such as…

Machine Learning · Computer Science 2024-07-09 Nexhi Sula , Abhinav Kumar , Jie Hou , Han Wang , Reza Tourani

Federated Learning (FL) has become a key method for preserving data privacy in Internet of Things (IoT) environments, as it trains Machine Learning (ML) models locally while transmitting only model updates. Despite this design, FL remains…

Machine Learning · Computer Science 2025-03-25 Fardin Jalil Piran , Zhiling Chen , Mohsen Imani , Farhad Imani

Machine unlearning is an emerging technique that aims to remove the influence of specific data from trained models, thereby enhancing privacy protection. However, recent research has uncovered critical privacy vulnerabilities, showing that…

Cryptography and Security · Computer Science 2026-01-29 Lulu Xue , Shengshan Hu , Wei Lu , Ziqi Zhou , Yufei Song , Jianhong Cheng , Minghui Li , Yanjun Zhang , Leo Yu Zhang

While Code Language Models (CLMs) have demonstrated superior performance in software engineering tasks such as code generation and summarization, recent empirical studies reveal a critical privacy vulnerability: these models exhibit…

Software Engineering · Computer Science 2025-09-18 Zhaoyang Chu , Yao Wan , Zhikun Zhang , Di Wang , Zhou Yang , Hongyu Zhang , Pan Zhou , Xuanhua Shi , Hai Jin , David Lo

To promote secure and private artificial intelligence (SPAI), we review studies on the model security and data privacy of DNNs. Model security allows system to behave as intended without being affected by malicious external influences that…

Cryptography and Security · Computer Science 2021-03-11 Ho Bae , Jaehee Jang , Dahuin Jung , Hyemi Jang , Heonseok Ha , Hyungyu Lee , Sungroh Yoon

Large language models (LLMs) are commonly adapted to downstream tasks through fine-tuning, but fine-tuning data often contains sensitive information that may be leaked by the resulting model. Differential privacy (DP) offers formal…

Machine Learning · Computer Science 2026-05-19 Haichao Sha , Zihao Wang , Yuncheng Wu , Hong Chen , Wei Dong

Current LLM-based services typically require users to submit raw text regardless of its sensitivity. While intuitive, such practice introduces substantial privacy risks, as unauthorized access may expose personal, medical, or legal…

Cryptography and Security · Computer Science 2026-04-09 Jeongho Yoon , Chanhee Park , Yongchan Chun , Hyeonseok Moon , Heuiseok Lim

Pretrained language models memorize vast amounts of information, including private and copyrighted data, raising significant safety concerns. Retraining these models after excluding sensitive data is prohibitively expensive, making machine…

Computation and Language · Computer Science 2024-10-04 Minseok Choi , Kyunghyun Min , Jaegul Choo

Large language models (LLMs) exhibit exceptional performance but pose substantial privacy risks due to training data memorization, particularly within healthcare contexts involving imperfect or privacy-sensitive patient information. We…

Machine Learning · Computer Science 2026-03-12 Yi Zhang , Chao Zhang , Zijian Li , Tianxiang Xu , Kunyu Zhang , Zhan Gao , Meinuo Li , Xiaohan Zhang , Qichao Qi , Bing Chen

With the widespread application of large language models (LLMs), user privacy protection has become a significant research topic. Existing privacy preference modeling methods often rely on large-scale user data, making effective privacy…

Cryptography and Security · Computer Science 2025-05-13 Haowei Yang , Qingyi Lu , Yang Wang , Sibei Liu , Jiayun Zheng , Ao Xiang

The privacy concerns associated with the use of Large Language Models (LLMs) have grown recently with the development of LLMs such as ChatGPT. Differential Privacy (DP) techniques are explored in existing work to mitigate their privacy…

Artificial Intelligence · Computer Science 2024-03-08 Tiejin Chen , Longchao Da , Huixue Zhou , Pingzhi Li , Kaixiong Zhou , Tianlong Chen , Hua Wei

The widespread popularity of Large Language Models (LLMs), partly due to their unique ability to perform in-context learning, has also brought to light the importance of ethical and safety considerations when deploying these pre-trained…

Computation and Language · Computer Science 2024-08-07 Karuna Bhaila , Minh-Hao Van , Xintao Wu

With the introduction of data protection and privacy regulations, it has become crucial to remove the lineage of data on demand from a machine learning (ML) model. In the last few years, there have been notable developments in machine…

Machine Learning · Computer Science 2023-06-01 Ayush K Tarun , Vikram S Chundawat , Murari Mandal , Mohan Kankanhalli

The rapid advancements of large language models (LLMs) have raised public concerns about the privacy leakage of personally identifiable information (PII) within their extensive training datasets. Recent studies have demonstrated that an…

Cryptography and Security · Computer Science 2024-08-01 Xiaoyi Chen , Siyuan Tang , Rui Zhu , Shijun Yan , Lei Jin , Zihao Wang , Liya Su , Zhikun Zhang , XiaoFeng Wang , Haixu Tang

Large Language Models (LLMs) generate responses based on user prompts. Often, these prompts may contain highly sensitive information, including personally identifiable information (PII), which could be exposed to third parties hosting these…

Cryptography and Security · Computer Science 2026-03-30 Shashie Dilhara Batan Arachchige , Hassan Jameel Asghar , Benjamin Zi Hao Zhao , Dinusha Vatsalan , Dali Kaafar