English
Related papers

Related papers: Online Distribution Learning with Local Private Co…

200 papers

We study person-level differentially private (DP) mean estimation in the case where each person holds multiple samples. DP here requires the usual notion of distributional stability when $\textit{all}$ of a person's datapoints can be…

Data Structures and Algorithms · Computer Science 2024-07-22 Sushant Agarwal , Gautam Kamath , Mahbod Majid , Argyris Mouzakis , Rose Silver , Jonathan Ullman

We study the fundamental task of estimating the median of an underlying distribution from a finite number of samples, under pure differential privacy constraints. We focus on distributions satisfying the minimal assumption that they have a…

Statistics Theory · Mathematics 2020-11-13 Christos Tzamos , Emmanouil-Vasileios Vlatakis-Gkaragkounis , Ilias Zadik

We study contextual online pricing with biased offline data. For the scalar price elasticity case, we identify the instance-dependent quantity $\delta^2$ that measures how far the offline data lies from the (unknown) online optimum. We show…

Machine Learning · Computer Science 2025-07-04 Yixuan Zhang , Ruihao Zhu , Qiaomin Xie

Differential privacy (DP) is a formal notion that restricts the privacy leakage of an algorithm when running on sensitive data, in which privacy-utility trade-off is one of the central problems in private data analysis. In this work, we…

Machine Learning · Computer Science 2025-03-18 Bo Li , Wei Wang , Peng Ye

In times of epidemics, swift reaction is necessary to mitigate epidemic spreading. For this reaction, localized approaches have several advantages, limiting necessary resources and reducing the impact of interventions on a larger scale.…

Machine Learning · Computer Science 2026-01-15 Raouf Kerkouche , Henrik Zunker , Mario Fritz , Martin J. Kühn

Local differential privacy is a promising privacy-preserving model for statistical aggregation of user data that prevents user privacy leakage from the data aggregator. This paper focuses on the problem of estimating the distribution of…

Cryptography and Security · Computer Science 2021-02-26 Ba Dung Le , Tanveer Zia

We present new mechanisms for \emph{label differential privacy}, a relaxation of differentially private machine learning that only protects the privacy of the labels in the training set. Our mechanisms cluster the examples in the training…

Machine Learning · Computer Science 2021-10-06 Hossein Esfandiari , Vahab Mirrokni , Umar Syed , Sergei Vassilvitskii

We consider the minimax estimation problem of a discrete distribution with support size $k$ under privacy constraints. A privatization scheme is applied to each raw sample independently, and we need to estimate the distribution of the raw…

Machine Learning · Computer Science 2017-02-03 Min Ye , Alexander Barg

We design differentially private algorithms for the problem of online linear optimization in the full information and bandit settings with optimal $\tilde{O}(\sqrt{T})$ regret bounds. In the full-information setting, our results demonstrate…

Machine Learning · Computer Science 2017-06-15 Naman Agarwal , Karan Singh

We consider the problem of contextual kernel bandits with stochastic contexts, where the underlying reward function belongs to a known Reproducing Kernel Hilbert Space. We study this problem under an additional constraint of Differential…

Machine Learning · Statistics 2025-07-21 Nikola Pavlovic , Sudeep Salgia , Qing Zhao

The problem of estimating a parameter in the drift coefficient is addressed for $N$ discretely observed independent and identically distributed stochastic differential equations (SDEs). This is done considering additional constraints,…

Statistics Theory · Mathematics 2024-10-17 Chiara Amorino , Arnaud Gloter , Hélène Halconruy

We initiate the study of locally differentially private (LDP) learning with public features. We define semi-feature LDP, where some features are publicly available while the remaining ones, along with the label, require protection under…

Machine Learning · Statistics 2025-02-12 Yuheng Ma , Ke Jia , Hanfang Yang

Federated Learning enables collaborative training of a global model across multiple geographically dispersed clients without the need for data sharing. However, it is susceptible to inference attacks, particularly label inference attacks.…

Machine Learning · Computer Science 2025-05-01 Zhixuan Ma , Haichang Gao , Junxiang Huang , Ping Wang

We develop data processing inequalities that describe how Fisher information from statistical samples can scale with the privacy parameter $\varepsilon$ under local differential privacy constraints. These bounds are valid under general…

Information Theory · Computer Science 2020-05-22 Leighton Pate Barnes , Wei-Ning Chen , Ayfer Ozgur

Learning from preference-based feedback has recently gained considerable traction as a promising approach to align generative models with human interests. Instead of relying on numerical rewards, the generative models are trained using…

Machine Learning · Computer Science 2023-10-31 Sayak Ray Chowdhury , Xingyu Zhou , Nagarajan Natarajan

Offline reinforcement learning seeks to utilize offline (observational) data to guide the learning of (causal) sequential decision making strategies. The hope is that offline reinforcement learning coupled with function approximation…

Machine Learning · Computer Science 2020-10-23 Ruosong Wang , Dean P. Foster , Sham M. Kakade

This paper addresses the prevalent issue of label shift in an online setting with missing labels, where data distributions change over time and obtaining timely labels is challenging. While existing methods primarily focus on adjusting or…

Machine Learning · Computer Science 2024-11-01 Ruihan Wu , Siddhartha Datta , Yi Su , Dheeraj Baby , Yu-Xiang Wang , Kilian Q. Weinberger

Local differential privacy~(LDP) is an information-theoretic privacy definition suitable for statistical surveys that involve an untrusted data curator. An LDP version of quasi-maximum likelihood estimator~(QMLE) has been developed, but the…

Machine Learning · Statistics 2022-02-16 Hajime Ono , Kazuhiro Minami , Hideitsu Hino

Large pretrained language models (LLMs) have shown surprising In-Context Learning (ICL) ability. An important application in deploying large language models is to augment LLMs with a private database for some specific task. The main problem…

Cryptography and Security · Computer Science 2024-05-09 Chunyan Zheng , Keke Sun , Wenhao Zhao , Haibo Zhou , Lixin Jiang , Shaoyang Song , Chunlai Zhou

Federated Learning (FL) is a machine learning paradigm where many local nodes collaboratively train a central model while keeping the training data decentralized. This is particularly relevant for clinical applications since patient data…