English
Related papers

Related papers: The Limits of Differential Privacy in Online Learn…

200 papers

Previous work on user-level differential privacy (DP) [Ghazi et al. NeurIPS 2021, Bun et al. STOC 2023] obtained generic algorithms that work for various learning tasks. However, their focus was on the example-rich regime, where the users…

Data Structures and Algorithms · Computer Science 2023-09-25 Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Raghu Meka , Chiyuan Zhang

The offline reinforcement learning (RL) problem is often motivated by the need to learn data-driven decision policies in financial, legal and healthcare applications. However, the learned policy could retain sensitive information of…

Machine Learning · Computer Science 2023-01-04 Dan Qiao , Yu-Xiang Wang

In this work we consider the problem of online submodular maximization under a cardinality constraint with differential privacy (DP). A stream of $T$ submodular functions over a common finite ground set $U$ arrives online, and at each…

Machine Learning · Computer Science 2020-10-27 Sebastian Perez-Salazar , Rachel Cummings

Imbalanced learning occurs in classification settings where the distribution of class-labels is highly skewed in the training data, such as when predicting rare diseases or in fraud detection. This class imbalance presents a significant…

Machine Learning · Computer Science 2024-11-11 Lucas Rosenblatt , Yuliia Lut , Eitan Turok , Marco Avella-Medina , Rachel Cummings

Language modeling is a keystone task in natural language processing. When training a language model on sensitive information, differential privacy (DP) allows us to quantify the degree to which our private data is protected. However,…

Machine Learning · Computer Science 2020-10-27 Gavin Kerrigan , Dylan Slack , Jens Tuyls

Many applications of machine learning, for example in health care, would benefit from methods that can guarantee privacy of data subjects. Differential privacy (DP) has become established as a standard for protecting learning results. The…

Machine Learning · Statistics 2017-05-30 Mikko Heikkilä , Eemil Lagerspetz , Samuel Kaski , Kana Shimizu , Sasu Tarkoma , Antti Honkela

Most works in learning with differential privacy (DP) have focused on the setting where each user has a single sample. In this work, we consider the setting where each user holds $m$ samples and the privacy protection is enforced at the…

Machine Learning · Computer Science 2021-12-28 Badih Ghazi , Ravi Kumar , Pasin Manurangsi

Designing privacy-preserving machine learning algorithms has received great attention in recent years, especially in the setting when the data contains sensitive information. Differential privacy (DP) is a widely used mechanism for data…

Machine Learning · Computer Science 2025-09-11 Chunyang Liao , Deanna Needell , Hayden Schaeffer , Alexander Xue

Learning with relational and network-structured data is increasingly vital in sensitive domains where protecting the privacy of individual entities is paramount. Differential Privacy (DP) offers a principled approach for quantifying privacy…

Machine Learning · Computer Science 2026-02-04 Yinan Huang , Haoteng Yin , Eli Chien , Rongzhe Wei , Pan Li

Differential privacy is a formal, mathematical definition of data privacy that has gained traction in academia, industry, and government. The task of correctly constructing differentially private algorithms is non-trivial, and mistakes have…

Cryptography and Security · Computer Science 2021-01-05 Subhajit Roy , Justin Hsu , Aws Albarghouthi

Distributed online learning is gaining increased traction due to its unique ability to process large-scale datasets and streaming data. To address the growing public awareness and concern on privacy protection, plenty of algorithms have…

Machine Learning · Computer Science 2024-08-27 Ziqin Chen , Yongqiang Wang

Differential Privacy (DP) is the de facto standard for reasoning about the privacy guarantees of a training algorithm. Despite the empirical observation that DP reduces the vulnerability of models to existing membership inference (MI)…

Machine Learning · Computer Science 2022-12-20 Anvith Thudi , Ilia Shumailov , Franziska Boenisch , Nicolas Papernot

A privacy-utility tradeoff is developed for an arbitrary set of finite-alphabet source distributions. Privacy is quantified using differential privacy (DP), and utility is quantified using expected Hamming distortion maximized over the set…

Information Theory · Computer Science 2018-08-02 Kousha Kalantari , Lalitha Sankar , Anand Sarwate

Reinforcement learning algorithms are widely used in domains where it is desirable to provide a personalized service. In these domains it is common that user data contains sensitive information that needs to be protected from third parties.…

Machine Learning · Computer Science 2021-10-28 Evrard Garcelon , Vianney Perchet , Ciara Pike-Burke , Matteo Pirotta

Local differential privacy (LDP) has become a central topic in data privacy research, offering strong privacy guarantees by perturbing user data at the source and removing the need for a trusted curator. However, the noise introduced by LDP…

Machine Learning · Computer Science 2026-03-04 Caihong Qin , Yang Bai

In machine learning, privacy requirements at inference or deployment time often evolve due to changing policies, regulations, or user preferences. In this work, we aim to construct a magnitude of models to satisfy any target differential…

Machine Learning · Computer Science 2026-05-21 Qichuan Yin , Manzil Zaheer , Tian Li

Differential privacy (DP) is a class of mathematical standards for assessing the privacy provided by a data-release mechanism. This work concerns two important flavors of DP that are related yet conceptually distinct: pure…

Statistics Theory · Mathematics 2024-08-22 James Bailie , Ruobin Gong

Online learning, in the mistake bound model, is one of the most fundamental concepts in learning theory. Differential privacy, instead, is the most widely used statistical concept of privacy in the machine learning community. It is thus…

Machine Learning · Computer Science 2022-10-11 Amartya Sanyal , Giorgia Ramponi

Machine learning models are increasingly made available to the masses through public query interfaces. Recent academic work has demonstrated that malicious users who can query such models are able to infer sensitive information about…

Cryptography and Security · Computer Science 2017-12-27 Yunhui Long , Vincent Bindschaedler , Carl A. Gunter

Models need to be trained with privacy-preserving learning algorithms to prevent leakage of possibly sensitive information contained in their training data. However, canonical algorithms like differentially private stochastic gradient…

Machine Learning · Computer Science 2022-10-06 Yannis Cattan , Christopher A. Choquette-Choo , Nicolas Papernot , Abhradeep Thakurta