English
Related papers

Related papers: Optimal Schemes for Discrete Distribution Estimati…

200 papers

This paper studies how to apply differential privacy to constrained optimization problems whose inputs are sensitive. This task raises significant challenges since random perturbations of the input data often render the constrained…

Optimization and Control · Mathematics 2021-01-07 Terrence W. K. Mak , Ferdinando Fioretto , Pascal Van Hentenryck

We consider a platform's problem of collecting data from privacy sensitive users to estimate an underlying parameter of interest. We formulate this question as a Bayesian-optimal mechanism design problem, in which an individual can share…

Computer Science and Game Theory · Computer Science 2023-09-07 Alireza Fallah , Ali Makhdoumi , Azarakhsh Malekian , Asuman Ozdaglar

We consider the problem of nonparametric density estimation under privacy constraints in an adversarial framework. To this end, we study minimax rates over Sobolev spaces under local differential privacy. We first obtain a lower bound which…

Statistics Theory · Mathematics 2025-07-18 Mélisande Albert , Juliette Chevallier , Béatrice Laurent , Ousmane Sacko

In this paper, we investigate the differentially private estimation of data depth functions and their associated medians. We introduce several methods for privatizing depth values at a fixed point, and show that for some depth functions,…

Statistics Theory · Mathematics 2021-04-09 Kelly Ramsay , Shoja'eddin Chenouri

We initiate a systematic study of worst-group risk minimization under $(\epsilon, \delta)$-differential privacy (DP). The goal is to privately find a model that approximately minimizes the maximal risk across $p$ sub-populations (groups)…

Machine Learning · Computer Science 2024-03-01 Xinyu Zhou , Raef Bassily

Consider the following problem: given a metric space, some of whose points are "clients", open a set of at most $k$ facilities to minimize the average distance from the clients to these facilities. This is just the well-studied $k$-median…

Data Structures and Algorithms · Computer Science 2009-11-11 Anupam Gupta , Katrina Ligett , Frank McSherry , Aaron Roth , Kunal Talwar

We propose and analyze algorithms to solve a range of learning tasks under user-level differential privacy constraints. Rather than guaranteeing only the privacy of individual samples, user-level DP protects a user's entire contribution ($m…

Machine Learning · Computer Science 2021-12-06 Daniel Levy , Ziteng Sun , Kareem Amin , Satyen Kale , Alex Kulesza , Mehryar Mohri , Ananda Theertha Suresh

We study differentially private (DP) algorithms for smooth stochastic minimax optimization, with stochastic minimization as a byproduct. The holy grail of these settings is to guarantee the optimal trade-off between the privacy and the…

Machine Learning · Computer Science 2022-10-20 Liang Zhang , Kiran Koshy Thekumparampil , Sewoong Oh , Niao He

In this paper, we address the challenge of differential privacy in the context of graph cuts, specifically focusing on the multiway cut and the minimum $k$-cut. We introduce edge-differentially private algorithms that achieve nearly optimal…

Cryptography and Security · Computer Science 2024-12-04 Rishi Chandra , Michael Dinitz , Chenglin Fan , Zongrui Zou

We study distributed estimation and learning problems in a networked environment where agents exchange information to estimate unknown statistical properties of random variables from their privately observed samples. The agents can…

Machine Learning · Computer Science 2024-04-02 Marios Papachristou , M. Amin Rahimian

We study the fundamental problem of frequency estimation under both privacy and communication constraints, where the data is distributed among $k$ parties. We consider two application scenarios: (1) one-shot, where the data is static and…

Cryptography and Security · Computer Science 2021-06-01 Ziyue Huang , Yuan Qiu , Ke Yi , Graham Cormode

We initiate the study of hypothesis selection under local differential privacy. Given samples from an unknown probability distribution $p$ and a set of $k$ probability distributions $\mathcal{Q}$, we aim to output, under the constraints of…

Data Structures and Algorithms · Computer Science 2020-06-23 Sivakanth Gopi , Gautam Kamath , Janardhan Kulkarni , Aleksandar Nikolov , Zhiwei Steven Wu , Huanyu Zhang

Joint distribution estimation of a dataset under differential privacy is a fundamental problem for many privacy-focused applications, such as query answering, machine learning tasks and synthetic data generation. In this work, we examine…

Data Structures and Algorithms · Computer Science 2021-06-10 Yuchao Tao , Johes Bater , Ashwin Machanavajjhala

In this paper, we study the problem of (finite sum) minimax optimization in the Differential Privacy (DP) model. Unlike most of the previous studies on the (strongly) convex-concave settings or loss functions satisfying the…

Machine Learning · Computer Science 2025-03-25 Ruijia Zhang , Mingxi Lei , Meng Ding , Zihang Xiang , Jinhui Xu , Di Wang

In this brief, we present an enhanced privacy-preserving distributed estimation algorithm, referred to as the ``Double-Private Algorithm," which combines the principles of both differential privacy (DP) and cryptography. The proposed…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Mehdi Korki , Fatemehsadat Hosseiniamin , Hadi Zayyani , Mehdi Bekrani

We consider the binary classification problem in a setup that preserves the privacy of the original sample. We provide a privacy mechanism that is locally differentially private and then construct a classifier based on the private sample…

Statistics Theory · Mathematics 2019-12-11 Thomas Berrett , Cristina Butucea

In this paper, we investigate the problem of differentially private distributed optimization. Recognizing that lower sensitivity leads to higher accuracy, we analyze the key factors influencing the sensitivity of differentially private…

Optimization and Control · Mathematics 2026-01-05 Furan Xie , Bing Liu , Li Chai

In this paper, we study the problem of sampling from a distribution under the constraint of differential privacy (DP). Prior works measure the utility of DP sampling with density ratio-based measures such as KL divergence. However, such…

Machine Learning · Statistics 2026-05-12 Shokichi Takakura , Seng Pei Liew , Satoshi Hasegawa

Convex programming with linear constraints plays an important role in the operation of a number of everyday systems. However, absent any additional protections, revealing or acting on the solutions to such problems may reveal information…

Optimization and Control · Mathematics 2024-09-16 Alexander Benvenuti , Brendan Bialy , Miriam Dennis , Matthew Hale

We consider the privacy amplification properties of a sampling scheme in which a user's data is used in k steps chosen randomly and uniformly from a sequence (or set) of t steps. This sampling scheme has been recently applied in the context…

Machine Learning · Computer Science 2026-01-16 Vitaly Feldman , Moshe Shenfeld