English
Related papers

Related papers: Hadamard Response: Estimating Distributions Privat…

200 papers

In this work, we study trade-offs between accuracy and privacy in the context of linear queries over histograms. This is a rich class of queries that includes contingency tables and range queries, and has been a focus of a long line of…

Data Structures and Algorithms · Computer Science 2013-08-05 Aleksandar Nikolov , Kunal Talwar , Li Zhang

In a multi-agent network, we consider the problem of minimizing an objective function that is expressed as the sum of private convex and smooth functions, and a (possibly) non-differentiable convex regularizer. We propose a novel…

Optimization and Control · Mathematics 2021-09-30 Yichuan Li , Nikolaos M. Freris , Petros Voulgaris , Dusan Stipanovic

Differential privacy(DP) has now become a standard in case of sensitive statistical data analysis. The two main approaches in DP is local and central. Both the approaches have a clear gap in terms of data storing,amount of data to be…

Cryptography and Security · Computer Science 2020-01-07 Sudipta Paul , Subhankar Mishra

This paper proposes a new distributed nonconvex stochastic optimization algorithm that can achieve privacy protection, communication efficiency and convergence simultaneously. Specifically, each node adds general privacy noises to its local…

Systems and Control · Electrical Eng. & Systems 2025-08-06 Jialong Chen , Jimin Wang , Ji-Feng Zhang

We consider the problem of estimating a regression function from anonymized data in the framework of local differential privacy. We propose a novel partitioning estimate of the regression function, derive a rate of convergence for the…

Statistics Theory · Mathematics 2023-04-12 László Györfi , Martin Kroll

We establish the O($\frac{1}{k}$) convergence rate for distributed stochastic gradient methods that operate over strongly convex costs and random networks. The considered class of methods is standard each node performs a weighted average of…

Optimization and Control · Mathematics 2018-03-22 Dusan Jakovetic , Dragana Bajovic , Anit Kumar Sahu , Soummya Kar

We characterize the communication complexity of the following distributed estimation problem. Alice and Bob observe infinitely many iid copies of $\rho$-correlated unit-variance (Gaussian or $\pm1$ binary) random variables, with unknown…

Information Theory · Computer Science 2019-04-19 Uri Hadar , Jingbo Liu , Yury Polyanskiy , Ofer Shayevitz

In shuffle privacy, each user sends a collection of randomized messages to a trusted shuffler, the shuffler randomly permutes these messages, and the resulting shuffled collection of messages must satisfy differential privacy. Prior work in…

Machine Learning · Computer Science 2022-03-15 Albert Cheu , Matthew Joseph , Jieming Mao , Binghui Peng

We study the fundamental problem of approximate nearest neighbor search in $d$-dimensional Hamming space $\{0,1\}^d$. We study the complexity of the problem in the famous cell-probe model, a classic model for data structures. We consider…

Data Structures and Algorithms · Computer Science 2016-02-16 Mingmou Liu , Xiaoyin Pan , Yitong Yin

We provide improved differentially private algorithms for identity testing of high-dimensional distributions. Specifically, for $d$-dimensional Gaussian distributions with known covariance $\Sigma$, we can test whether the distribution…

Data Structures and Algorithms · Computer Science 2022-07-26 Shyam Narayanan

Estimating spatial distributions is important in data analysis, such as traffic flow forecasting and epidemic prevention. To achieve accurate spatial distribution estimation, the analysis needs to collect sufficient user data. However,…

Databases · Computer Science 2024-12-12 Leilei Du , Peng Cheng , Libin Zheng , Xiang Lian , Lei Chen , Wei Xi , Wangze Ni

In distributed differential privacy, the parties perform analysis over their joint data while preserving the privacy for both datasets. Interestingly, for a few fundamental two-party functions such as inner product and Hamming distance, the…

Cryptography and Security · Computer Science 2022-06-20 Iftach Haitner , Noam Mazor , Jad Silbak , Eliad Tsfadia

Federated analytics seeks to compute accurate statistics from data distributed across users' devices while providing a suitable privacy guarantee and being practically feasible to implement and scale. In this paper, we show how a strong…

Cryptography and Security · Computer Science 2022-03-10 Akash Bharadwaj , Graham Cormode

Distributed stochastic optimization enables multi-agent collaboration in applications such as distributed learning and sensor networks, but also raises critical privacy concerns due to the involvement of sensitive data. While existing…

Systems and Control · Electrical Eng. & Systems 2026-04-24 Haoqiang Zhou , Chi Chen , Yongfeng Zhi , Huan Gao

We consider a D2D wireless network where $n$ users are densely deployed in a squared planar region and communicate with each other without the help of a wired infrastructure. For this network, we examine the 3-phase hierarchical cooperation…

Information Theory · Computer Science 2015-06-22 Song-Nam Hong , Giuseppe Caire

Joint distribution estimation of a dataset under differential privacy is a fundamental problem for many privacy-focused applications, such as query answering, machine learning tasks and synthetic data generation. In this work, we examine…

Data Structures and Algorithms · Computer Science 2021-06-10 Yuchao Tao , Johes Bater , Ashwin Machanavajjhala

The explosion of large-scale data in fields such as finance, e-commerce, and social media has outstripped the processing capabilities of single-machine systems, driving the need for distributed statistical inference methods. Traditional…

Machine Learning · Statistics 2024-09-02 Jingguo Lan , Hongmei Lin , Xueqin Wang

We propose a communication- and computation-efficient distributed optimization algorithm using second-order information for solving empirical risk minimization (ERM) problems with a nonsmooth regularization term. Our algorithm is applicable…

Machine Learning · Computer Science 2019-12-16 Ching-pei Lee , Cong Han Lim , Stephen J. Wright

We consider non-parametric density estimation in the framework of local approximate differential privacy. In contrast to centralized privacy scenarios with a trusted curator, in the local setup anonymization must be guaranteed already on…

Statistics Theory · Mathematics 2019-07-16 Martin Kroll

In this paper, we study the Empirical Risk Minimization problem in the non-interactive local model of differential privacy. In the case of constant or low dimensionality ($p\ll n$), we first show that if the ERM loss function is $(\infty,…

Machine Learning · Computer Science 2018-05-18 Di Wang , Marco Gaboardi , Jinhui Xu