English
Related papers

Related papers: Concurrent Shuffle Differential Privacy Under Cont…

200 papers

We develop a privatised stochastic variational inference method for Latent Dirichlet Allocation (LDA). The iterative nature of stochastic variational inference presents challenges: multiple iterations are required to obtain accurate…

Machine Learning · Statistics 2018-12-05 Mijung Park , James Foulds , Kamalika Chaudhuri , Max Welling

Although robust learning and local differential privacy are both widely studied fields of research, combining the two settings is just starting to be explored. We consider the problem of estimating a discrete distribution in total variation…

Statistics Theory · Mathematics 2022-04-21 Julien Chhor , Flore Sentenac

Consider the following problem: given a metric space, some of whose points are "clients", open a set of at most $k$ facilities to minimize the average distance from the clients to these facilities. This is just the well-studied $k$-median…

Data Structures and Algorithms · Computer Science 2009-11-11 Anupam Gupta , Katrina Ligett , Frank McSherry , Aaron Roth , Kunal Talwar

Differential privacy is a formal mathematical {stand-ard} for quantifying the degree of that individual privacy in a statistical database is preserved. To guarantee differential privacy, a typical method is adding random noise to the…

Information Theory · Computer Science 2017-03-08 Jianping He , Lin Cai

To meet the standard of differential privacy, noise is usually added into the original data, which inevitably deteriorates the predicting performance of subsequent learning algorithms. In this paper, motivated by the success of improving…

Machine Learning · Computer Science 2019-06-04 Quanming Yao , Xiawei Guo , James T. Kwok , WeiWei Tu , Yuqiang Chen , Wenyuan Dai , Qiang Yang

Consider a database of $n$ people, each represented by a bit-string of length $d$ corresponding to the setting of $d$ binary attributes. A $k$-way marginal query is specified by a subset $S$ of $k$ attributes, and a $|S|$-dimensional binary…

Data Structures and Algorithms · Computer Science 2013-08-07 Cynthia Dwork , Aleksandar Nikolov , Kunal Talwar

We give a fast algorithm to optimally compose privacy guarantees of differentially private (DP) algorithms to arbitrary accuracy. Our method is based on the notion of privacy loss random variables to quantify the privacy loss of DP…

Data Structures and Algorithms · Computer Science 2021-10-27 Sivakanth Gopi , Yin Tat Lee , Lukas Wutschitz

In this paper, we study differentially private online learning problems in a stochastic environment under both bandit and full information feedback. For differentially private stochastic bandits, we propose both UCB and Thompson…

Machine Learning · Computer Science 2024-05-31 Bingshan Hu , Zhiming Huang , Nishant A. Mehta , Nidhi Hegde

In this work, we study the task of estimating the numbers of distinct and $k$-occurring items in a time window under the constraint of differential privacy (DP). We consider several variants depending on whether the queries are on general…

Data Structures and Algorithms · Computer Science 2022-11-22 Badih Ghazi , Ravi Kumar , Pasin Manurangsi , Jelani Nelson

Hierarchical clustering is a fundamental unsupervised machine learning task with the aim of organizing data into a hierarchy of clusters. Many applications of hierarchical clustering involve sensitive user information, therefore motivating…

Data Structures and Algorithms · Computer Science 2025-04-23 Chengyuan Deng , Jie Gao , Jalaj Upadhyay , Chen Wang , Samson Zhou

Data privacy is an important concern in learning, when datasets contain sensitive information about individuals. This paper considers consensus-based distributed optimization under data privacy constraints. Consensus-based optimization…

Machine Learning · Computer Science 2019-03-20 Mehrdad Showkatbakhsh , Can Karakus , Suhas Diggavi

Stochastic linear bandits are a fundamental model for sequential decision making, where an agent selects a vector-valued action and receives a noisy reward with expected value given by an unknown linear function. Although well studied in…

Machine Learning · Computer Science 2025-06-23 Bruce Huang , Ruida Zhou , Lin F. Yang , Suhas Diggavi

Estimating causal effects from randomized experiments is only possible if participants are willing to disclose their potentially sensitive responses. Differential privacy, a widely used framework for ensuring an algorithms privacy…

Machine Learning · Statistics 2025-05-29 Adel Javanmard , Vahab Mirrokni , Jean Pouget-Abadie

The shuffled linear regression problem aims to recover linear relationships in datasets where the correspondence between input and output is unknown. This problem arises in a wide range of applications including survey data, in which one…

Computation · Statistics 2022-10-03 Efe Onaran , Soledad Villar

We investigate the distributed online nonconvex optimization problem with differential privacy over time-varying networks. Each node minimizes the sum of several nonconvex functions while preserving the node's differential privacy. We…

Systems and Control · Electrical Eng. & Systems 2025-01-09 Yingjie Zhou , Tao Li

This paper considers the problem of multi-server Private Linear Computation, under the joint and individual privacy guarantees. In this problem, identical copies of a dataset comprised of $K$ messages are stored on $N$ non-colluding…

Information Theory · Computer Science 2021-08-24 Nahid Esmati , Anoosheh Heidarzadeh

We introduce a novel differentially private algorithm for online federated learning that employs temporally correlated noise to enhance utility while ensuring privacy of continuously released models. To address challenges posed by DP noise…

Machine Learning · Computer Science 2025-01-10 Jiaojiao Zhang , Linglingzhi Zhu , Mikael Johansson

This paper considers the problem of distributed bandit online convex optimization with time-varying coupled inequality constraints. This problem can be defined as a repeated game between a group of learners and an adversary. The learners…

Optimization and Control · Mathematics 2019-12-10 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Karl H. Johansson , Tianyou Chai

In this paper, we improve the previously best known regret bound to achieve $\epsilon$-differential privacy in oblivious adversarial bandits from $\mathcal{O}{(T^{2/3}/\epsilon)}$ to $\mathcal{O}{(\sqrt{T} \ln T /\epsilon)}$. This is…

Machine Learning · Computer Science 2017-01-17 Aristide C. Y. Tossou , Christos Dimitrakakis

Differential Privacy (DP) is the current gold-standard for ensuring privacy for statistical queries. Estimation problems under DP constraints appearing in the literature have largely focused on providing equal privacy to all users. We…

Machine Learning · Computer Science 2025-04-22 Syomantak Chaudhuri , Thomas A. Courtade