English
Related papers

Related papers: Online Distribution Learning with Local Private Co…

200 papers

Since federated learning (FL) has been introduced as a decentralized learning technique with privacy preservation, statistical heterogeneity of distributed data stays the main obstacle to achieve robust performance and stable convergence in…

Machine Learning · Computer Science 2022-12-08 Yanhang Shi , Siguang Chen , Haijun Zhang

Recent years, local differential privacy (LDP) has been adopted by many web service providers like Google \cite{erlingsson2014rappor}, Apple \cite{apple2017privacy} and Microsoft \cite{bolin2017telemetry} to collect and analyse users' data…

Information Theory · Computer Science 2022-03-15 Zhongzheng Xiong , Jialin Sun , Xiaojun Mao , Jian Wang , Shan Ying , Zengfeng Huang

We develop differentially private methods for estimating various distributional properties. Given a sample from a discrete distribution $p$, some functional $f$, and accuracy and privacy parameters $\alpha$ and $\varepsilon$, the goal is to…

Data Structures and Algorithms · Computer Science 2018-03-02 Jayadev Acharya , Gautam Kamath , Ziteng Sun , Huanyu Zhang

We study distributed estimation and learning problems in a networked environment where agents exchange information to estimate unknown statistical properties of random variables from their privately observed samples. The agents can…

Machine Learning · Computer Science 2024-04-02 Marios Papachristou , M. Amin Rahimian

We propose an algorithm with improved query-complexity for the problem of hypothesis selection under local differential privacy constraints. Given a set of $k$ probability distributions $Q$, we describe an algorithm that satisfies local…

Data Structures and Algorithms · Computer Science 2026-01-16 Gautam Kamath , Alireza F. Pour , Matthew Regehr , David P. Woodruff

We study statistical estimation under local differential privacy (LDP) when users may hold heterogeneous privacy levels and accuracy must be guaranteed with high probability. Departing from the common in-expectation analyses, and for…

Machine Learning · Statistics 2025-10-15 Maryam Aliakbarpour , Alireza Fallah , Swaha Roy , Ria Stevens

We consider the estimation of the cumulative hazard function, and equivalently the distribution function, with censored data under a setup that preserves the privacy of the survival database. This is done through a $\alpha$-locally…

Statistics Theory · Mathematics 2024-02-07 Egea Maxime , Escobar-Bach Mikael

This work provides tight upper- and lower-bounds for the problem of mean estimation under $\epsilon$-differential privacy in the local model, when the input is composed of $n$ i.i.d. drawn samples from a normal distribution with variance…

Data Structures and Algorithms · Computer Science 2019-04-12 Marco Gaboardi , Ryan Rogers , Or Sheffet

Distribution estimation under local differential privacy (LDP) is a fundamental and challenging task. Significant progresses have been made on categorical data. However, due to different evaluation metrics, these methods do not work well…

Machine Learning · Computer Science 2025-09-25 Puning Zhao , Zhikun Zhang , Bo Sun , Li Shen , Liang Zhang , Shaowei Wang , Zhe Liu

We study a basic private estimation problem: each of $n$ users draws a single i.i.d. sample from an unknown Gaussian distribution, and the goal is to estimate the mean of this Gaussian distribution while satisfying local differential…

Machine Learning · Computer Science 2019-10-29 Matthew Joseph , Janardhan Kulkarni , Jieming Mao , Zhiwei Steven Wu

We consider the problem of mean estimation under user-level local differential privacy, where $n$ users are contributing through their local pool of data samples. Previous work assume that the number of data samples is the same across…

Methodology · Statistics 2024-10-15 Corentin Pla , Hugo Richard , Maxime Vono

We consider the problem of estimating a regression function from anonymized data in the framework of local differential privacy. We propose a novel partitioning estimate of the regression function, derive a rate of convergence for the…

Statistics Theory · Mathematics 2023-04-12 László Györfi , Martin Kroll

We study the problem of estimating non-linear functionals of discrete distributions in the context of local differential privacy. The initial data $x_1,\ldots,x_n \in [K]$ are supposed i.i.d. and distributed according to an unknown discrete…

Statistics Theory · Mathematics 2023-08-15 Cristina Butucea , Yann Issartel

The collection and analysis of user data drives improvements in the app and web ecosystems, but comes with risks to privacy. This paper examines discrete distribution estimation under local privacy, a setting wherein service providers can…

Machine Learning · Statistics 2016-06-16 Peter Kairouz , Keith Bonawitz , Daniel Ramage

Offline reinforcement learning (RL) learns policies from a fixed dataset, but often requires large amounts of data. The challenge arises when labeled datasets are expensive, especially when rewards have to be provided by human labelers for…

Machine Learning · Computer Science 2025-05-30 Yen-Ru Lai , Fu-Chieh Chang , Pei-Yuan Wu

We introduce a novel differentially private algorithm for online federated learning that employs temporally correlated noise to enhance utility while ensuring privacy of continuously released models. To address challenges posed by DP noise…

Machine Learning · Computer Science 2025-01-10 Jiaojiao Zhang , Linglingzhi Zhu , Mikael Johansson

Joint distribution estimation of a dataset under differential privacy is a fundamental problem for many privacy-focused applications, such as query answering, machine learning tasks and synthetic data generation. In this work, we examine…

Data Structures and Algorithms · Computer Science 2021-06-10 Yuchao Tao , Johes Bater , Ashwin Machanavajjhala

Online learning has been in the spotlight from the machine learning society for a long time. To handle massive data in Big Data era, one single learner could never efficiently finish this heavy task. Hence, in this paper, we propose a novel…

Machine Learning · Computer Science 2015-06-24 Chencheng Li , Pan Zhou

Many offline reinforcement learning algorithms are underpinned by $f$-divergence regularization, but their sample complexity *defined with respect to regularized objectives* still lacks tight analyses, especially in terms of concrete data…

Machine Learning · Computer Science 2026-02-27 Qingyue Zhao , Kaixuan Ji , Heyang Zhao , Tong Zhang , Quanquan Gu

We study discrete distribution estimation under user-level local differential privacy (LDP). In user-level $\varepsilon$-LDP, each user has $m\ge1$ samples and the privacy of all $m$ samples must be preserved simultaneously. We resolve the…

Machine Learning · Computer Science 2022-11-08 Jayadev Acharya , Yuhan Liu , Ziteng Sun