English
Related papers

Related papers: Optimal Pure Differentially Private Sparse Histogr…

200 papers

We propose a framework to convert $(\varepsilon, \delta)$-approximate Differential Privacy (DP) mechanisms into $(\varepsilon', 0)$-pure DP mechanisms under certain conditions, a process we call ``purification.'' This algorithmic technique…

Cryptography and Security · Computer Science 2025-11-19 Yingyu Lin , Erchi Wang , Yi-An Ma , Yu-Xiang Wang

In this paper we revisit random linear under-determined systems with sparse solutions. We consider $\ell_1$ optimization heuristic known to work very well when used to solve these systems. A collection of fundamental results that relate to…

Optimization and Control · Mathematics 2016-12-20 Mihailo Stojnic

We present a framework for designing differentially private (DP) mechanisms for binary functions via a graph representation of datasets. Datasets are nodes in the graph and any two neighboring datasets are connected by an edge. The true…

Information Theory · Computer Science 2021-02-11 Rafael G. L. D'Oliveira , Muriel Medard , Parastoo Sadeghi

The significant progress in constructing graph spanners that are sparse (small number of edges) or light (low total weight) has skipped spanners that are everywhere-sparse (small maximum degree). This disparity is in line with other network…

Data Structures and Algorithms · Computer Science 2012-05-02 Eden Chlamtac , Michael Dinitz , Robert Krauthgamer

It is common practice to use data containing personal information to build predictive models in the framework of empirical risk minimization (ERM). While these models can be highly accurate in prediction, sharing the results from these…

Machine Learning · Statistics 2024-09-30 Spencer Giddens , Yiwang Zhou , Kevin R. Krull , Tara M. Brinkman , Peter X. K. Song , Fang Liu

We consider the problem of designing fundamental graph algorithms on the model of Massive Parallel Computation (MPC). The input to the problem is an undirected graph $G$ with $n$ vertices and $m$ edges, and with $D$ being the maximum…

Data Structures and Algorithms · Computer Science 2021-08-10 Sam Coy , Artur Czumaj

Metric Differential Privacy (mDP) extends the concept of Differential Privacy (DP) to serve as a new paradigm of data perturbation. It is designed to protect secret data represented in general metric space, such as text data encoded as word…

Artificial Intelligence · Computer Science 2024-05-10 Chenxi Qiu

A pervasive task in the differential privacy literature is to select the $k$ items of "highest quality" out of a set of $d$ items, where the quality of each item depends on a sensitive dataset that must be protected. Variants of this task…

Data Structures and Algorithms · Computer Science 2017-04-12 Thomas Steinke , Jonathan Ullman

We develop a technique to design efficiently computable estimators for sparse linear regression in the simultaneous presence of two adversaries: oblivious and adaptive. We design several robust algorithms that outperform the state of the…

Machine Learning · Computer Science 2024-11-01 Chih-Hung Liu , Gleb Novikov

Data privacy and decentralised data collection has become more and more popular in recent years. In order to solve issues with privacy, communication bandwidth and learning from spatio-temporal data, we will propose two efficient models…

Machine Learning · Computer Science 2023-01-19 Timon Sachweh , Daniel Boiar , Thomas Liebig

Previous work on user-level differential privacy (DP) [Ghazi et al. NeurIPS 2021, Bun et al. STOC 2023] obtained generic algorithms that work for various learning tasks. However, their focus was on the example-rich regime, where the users…

Data Structures and Algorithms · Computer Science 2023-09-25 Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Raghu Meka , Chiyuan Zhang

In this work, we study the task of estimating the numbers of distinct and $k$-occurring items in a time window under the constraint of differential privacy (DP). We consider several variants depending on whether the queries are on general…

Data Structures and Algorithms · Computer Science 2022-11-22 Badih Ghazi , Ravi Kumar , Pasin Manurangsi , Jelani Nelson

In this work, we propose an algorithm for solving exact sparse linear regression problems over a network in a distributed manner. Particularly, we consider the problem where data is stored among different computers or agents that seek to…

Optimization and Control · Mathematics 2022-04-04 Tu Anh-Nguyen , César A. Uribe

We present a differentially private algorithm for releasing the sequence of $k$ elements with the highest counts from a data domain of $d$ elements. The algorithm is a "joint" instance of the exponential mechanism, and its output space…

Cryptography and Security · Computer Science 2022-09-01 Jennifer Gillenwater , Matthew Joseph , Andrés Muñoz Medina , Mónica Ribero

Recent years, local differential privacy (LDP) has been adopted by many web service providers like Google \cite{erlingsson2014rappor}, Apple \cite{apple2017privacy} and Microsoft \cite{bolin2017telemetry} to collect and analyse users' data…

Information Theory · Computer Science 2022-03-15 Zhongzheng Xiong , Jialin Sun , Xiaojun Mao , Jian Wang , Shan Ying , Zengfeng Huang

We study private empirical risk minimization (ERM) problem for losses satisfying the $(\gamma,\kappa)$-Kurdyka-{\L}ojasiewicz (KL) condition. The Polyak-{\L}ojasiewicz (PL) condition is a special case of this condition when $\kappa=2$.…

Machine Learning · Computer Science 2024-04-04 Michael Menart , Enayat Ullah , Raman Arora , Raef Bassily , Cristóbal Guzmán

Differential Privacy (DP) is a mathematical framework for releasing information with formal privacy guarantees. While numerous DP procedures have been developed for statistical analysis and machine learning, valid statistical inference…

Methodology · Statistics 2025-06-27 Ruyu Zhou , Fang Liu

We consider the problem of estimating a $d$-dimensional discrete distribution from its samples observed under a $b$-bit communication constraint. In contrast to most previous results that largely focus on the global minimax error, we study…

Information Theory · Computer Science 2021-11-02 Wei-Ning Chen , Peter Kairouz , Ayfer Özgür

We consider the problem of designing deterministic graph algorithms for the model of Massively Parallel Computation (MPC) that improve with the sparsity of the input graph, as measured by the notion of arboricity. For the problems of…

Data Structures and Algorithms · Computer Science 2023-07-03 Manuela Fischer , Jeff Giliberti , Christoph Grunau

Privacy preservation has become a critical concern in high-dimensional data analysis due to the growing prevalence of data-driven applications. Since its proposal, sliced inverse regression has emerged as a widely utilized statistical…

Machine Learning · Statistics 2025-04-08 Xintao Xia , Linjun Zhang , Zhanrui Cai