English
Related papers

Related papers: Metric-Normalized Posterior Leakage (mPL): Attacke…

200 papers

Multi-abel Learning (MLL) often involves the assignment of multiple relevant labels to each instance, which can lead to the leakage of sensitive information (such as smoking, diseases, etc.) about the instances. However, existing MLL suffer…

Machine Learning · Computer Science 2023-12-22 Zhongnian Li , Haotian Ren , Tongfeng Sun , Zhichen Li

Federated learning (FL), a novel branch of distributed machine learning (ML), develops global models through a private procedure without direct access to local datasets. However, it is still possible to access the model updates (gradient…

Machine Learning · Computer Science 2024-06-27 Mahtab Talaei , Iman Izadi

In-context learning (ICL) in Large Language Models (LLMs) has shown remarkable performance across various tasks without requiring fine-tuning. However, recent studies have highlighted the risk of private data leakage through the prompt in…

Artificial Intelligence · Computer Science 2025-09-16 Seongho Joo , Hyukhun Koh , Kyomin Jung

Motivated by the wide adoption of reinforcement learning (RL) in real-world personalized services, where users' sensitive and private information needs to be protected, we study regret minimization in finite-horizon Markov decision…

Machine Learning · Computer Science 2022-03-22 Xingyu Zhou

Federated learning (FL) aims to collaboratively train the global model in a distributed manner by sharing the model parameters from local clients to a central server, thereby potentially protecting users' private information. Nevertheless,…

Machine Learning · Computer Science 2023-02-17 Zhe Li , Honglong Chen , Zhichen Ni , Huajie Shao

Metric Differential Privacy (mDP) extends the local differential privacy (LDP) framework to metric spaces, enabling more nuanced privacy protection for data such as geo-locations. However, existing mDP optimization methods, particularly…

Cryptography and Security · Computer Science 2025-09-11 Ruiyao Liu , Chenxi Qiu

As Large Language Models (LLMs) proliferate, developing privacy safeguards for these models is crucial. One popular safeguard involves training LLMs in a differentially private manner. However, such solutions are shown to be computationally…

Machine Learning · Computer Science 2024-10-04 James Flemings , Meisam Razaviyayn , Murali Annavaram

Differential privacy (DP) is a formal privacy framework that enables training machine learning (ML) models while protecting individuals' data. As pointed out by prior work, ML models are part of larger systems, which can lead to so-called…

Machine Learning · Computer Science 2026-04-27 Marlon Tobaben , Talal Alrawajfeh , Marcus Klasson , Mikko Heikkilä , Arno Solin , Antti Honkela

Privacy preservation has served as a key metric in designing Nash equilibrium (NE) computation algorithms. Although differential privacy (DP) has been widely employed for privacy guarantees, it does not exploit prior distributional…

Computer Science and Game Theory · Computer Science 2025-10-27 Zhaoyang Cheng , Guanpu Chen , Tobias J. Oechtering , Mikael Skoglund

Differential privacy (DP) is widely employed to provide privacy protection for individuals by limiting information leakage from the aggregated data. Two well-known models of DP are the central model and the local model. The former requires…

Cryptography and Security · Computer Science 2024-11-05 Yucheng Fu , Tianhao Wang

Differentially private (DP) mechanisms face the challenge of providing accurate results while protecting their inputs: the privacy-utility trade-off. A simple but powerful technique for DP adds noise to sensitivity-bounded query outputs to…

Cryptography and Security · Computer Science 2021-07-28 David M. Sommer , Lukas Abfalterer , Sheila Zingg , Esfandiar Mohammadi

Local Differential Privacy (LDP) protocols allow an aggregator to obtain population statistics about sensitive data of a userbase, while protecting the privacy of the individual users. To understand the tradeoff between aggregator utility…

Cryptography and Security · Computer Science 2019-10-18 Milan Lopuhaä-Zwakenberg , Boris Škorić , Ninghui Li

Local differential privacy (LDP) has become a central topic in data privacy research, offering strong privacy guarantees by perturbing user data at the source and removing the need for a trusted curator. However, the noise introduced by LDP…

Machine Learning · Computer Science 2026-03-04 Caihong Qin , Yang Bai

In recent years, local differential privacy (LDP) has emerged as a technique of choice for privacy-preserving data collection in several scenarios when the aggregator is not trustworthy. LDP provides client-side privacy by adding noise at…

Machine Learning · Statistics 2021-10-28 Tejas Kulkarni , Joonas Jälkö , Samuel Kaski , Antti Honkela

Machine Learning (ML) models integrated with in-situ sensing offer transformative solutions for defect detection in Additive Manufacturing (AM), but this integration brings critical challenges in safeguarding sensitive data, such as part…

Machine Learning · Computer Science 2025-03-19 Fardin Jalil Piran , Prathyush P. Poduval , Hamza Errahmouni Barkam , Mohsen Imani , Farhad Imani

Differential privacy (DP) techniques can be applied to the federated learning model to protect data privacy against inference attacks to communication among the learning agents. The DP techniques, however, hinder achieving a greater…

Machine Learning · Computer Science 2021-10-08 Minseok Ryu , Kibaek Kim

Differential Privacy (DP) has received increasing attention as a rigorous privacy framework. Many existing studies employ traditional DP mechanisms (e.g., the Laplace mechanism) as primitives to continuously release private data for…

Databases · Computer Science 2019-08-01 Yang Cao , Masatoshi Yoshikawa , Yonghui Xiao , Li Xiong

Federated Learning (FL) has become increasingly popular to perform data-driven analysis in cyber-physical critical infrastructures. Since the FL process may involve the client's confidential information, Differential Privacy (DP) has been…

Cryptography and Security · Computer Science 2024-10-28 Md Tamjid Hossain , Shahriar Badsha , Hung La , Haoting Shen , Shafkat Islam , Ibrahim Khalil , Xun Yi

Privacy leakage in LLM agents is often studied through individual storage or execution components, such as memory modules, retrieval pipelines, or tool-mediated artifacts. However, these settings are typically analyzed in isolation, making…

Cryptography and Security · Computer Science 2026-03-31 Tao Huang , Chen Hou , Guosen Wu , Jiayang Meng

Ensuring the privacy of Large Language Models (LLMs) is becoming increasingly important. The most widely adopted technique to accomplish this is DP-SGD, which trains a model to guarantee Differential Privacy (DP). However, DP-SGD…

Cryptography and Security · Computer Science 2024-04-30 James Flemings , Meisam Razaviyayn , Murali Annavaram