English
Related papers

Related papers: Guaranteed Feasibility in Differentially Private L…

200 papers

Distributed optimization and learning has recently garnered great attention due to its wide applications in sensor networks, smart grids, machine learning, and so forth. Despite rapid development, existing distributed optimization and…

Machine Learning · Computer Science 2024-03-04 Ziqin Chen , Yongqiang Wang

A Private Repetition algorithm takes as input a differentially private algorithm with constant success probability and boosts it to one that succeeds with high probability. These algorithms are closely related to private metaselection…

Cryptography and Security · Computer Science 2024-10-28 Kunal Talwar

This paper presents a differentially private algorithm for linear regression learning in a decentralized fashion. Under this algorithm, privacy budget is theoretically derived, in addition to that the solution error is shown to be bounded…

Cryptography and Security · Computer Science 2020-04-17 Yang Liu , Xiong Zhang , Shuqi Qin , Xiaoping Lei

Local differential privacy has recently surfaced as a strong measure of privacy in contexts where personal information remains private even from data analysts. Working in a setting where both the data providers and data analysts want to…

Information Theory · Computer Science 2015-11-20 Peter Kairouz , Sewoong Oh , Pramod Viswanath

We study a class of private learning problems in which the data is a join of private and public features. This is often the case in private personalization tasks such as recommendation or ad prediction, in which features related to…

Machine Learning · Computer Science 2023-10-25 Walid Krichene , Nicolas Mayoraz , Steffen Rendle , Shuang Song , Abhradeep Thakurta , Li Zhang

The protection of private information is of vital importance in data-driven research, business, and government. The conflict between privacy and utility has triggered intensive research in the computer science and statistics communities,…

Cryptography and Security · Computer Science 2022-08-11 March Boedihardjo , Thomas Strohmer , Roman Vershynin

In distributed optimization and iterative consensus literature, a standard problem is for $N$ agents to minimize a function $f$ over a subset of Euclidean space, where the cost function is expressed as a sum $\sum f_i$. In this paper, we…

Cryptography and Security · Computer Science 2014-01-14 Zhenqi Huang , Sayan Mitra , Nitin Vaidya

We study differentially private (DP) algorithms for smooth stochastic minimax optimization, with stochastic minimization as a byproduct. The holy grail of these settings is to guarantee the optimal trade-off between the privacy and the…

Machine Learning · Computer Science 2022-10-20 Liang Zhang , Kiran Koshy Thekumparampil , Sewoong Oh , Niao He

We consider the geo-indistinguishability approach to location privacy, and the trade-off with respect to utility. We show that, given a desired degree of geo-indistinguishability, it is possible to construct a mechanism that minimizes the…

Cryptography and Security · Computer Science 2014-08-26 Nicolás E. Bordenabe , Konstantinos Chatzikokolakis , Catuscia Palamidessi

This work considers computationally efficient privacy-preserving data release. We study the task of analyzing a database containing sensitive information about individual participants. Given a set of statistical queries on the data, we want…

Computational Complexity · Computer Science 2011-07-14 Moritz Hardt , Guy N. Rothblum , Rocco A. Servedio

We establish a simple connection between robust and differentially-private algorithms: private mechanisms which perform well with very high probability are automatically robust in the sense that they retain accuracy even if a constant…

Machine Learning · Statistics 2022-12-02 Kristian Georgiev , Samuel B. Hopkins

We study the problem of estimating a functional $\theta(\mathbb P)$ of an unknown probability distribution $\mathbb P \in\mathcal P$ in which the original iid sample $X_1,\dots, X_n$ is kept private even from the statistician via an…

Statistics Theory · Mathematics 2019-05-29 Angelika Rohde , Lukas Steinberger

Differential privacy is becoming a gold standard for privacy research; it offers a guaranteed bound on loss of privacy due to release of query results, even under worst-case assumptions. The theory of differential privacy is an active…

We investigate the distributed online nonconvex optimization problem with differential privacy over time-varying networks. Each node minimizes the sum of several nonconvex functions while preserving the node's differential privacy. We…

Systems and Control · Electrical Eng. & Systems 2025-01-09 Yingjie Zhou , Tao Li

We consider the problem of learning Markov Random Fields (including the prototypical example, the Ising model) under the constraint of differential privacy. Our learning goals include both structure learning, where we try to estimate the…

Data Structures and Algorithms · Computer Science 2020-08-17 Huanyu Zhang , Gautam Kamath , Janardhan Kulkarni , Zhiwei Steven Wu

While power systems research relies on the availability of real-world network datasets, data owners (e.g., system operators) are hesitant to share data due to security and privacy risks. To control these risks, we develop privacy-preserving…

Cryptography and Security · Computer Science 2023-03-21 Vladimir Dvorkin , Audun Botterud

Pairwise learning focuses on learning tasks with pairwise loss functions, depends on pairs of training instances, and naturally fits for modeling relationships between pairs of samples. In this paper, we focus on the privacy of pairwise…

Machine Learning · Computer Science 2021-06-02 Yilin Kang , Yong Liu , Jian Li , Weiping Wang

We consider a resource allocation problem involving a large number of agents with individual constraints subject to privacy, and a central operator whose objective is to optimize a global, possibly nonconvex, cost while satisfying the…

Optimization and Control · Mathematics 2020-06-24 Olivier Beaude , Pascal Benchimol , Stéphane Gaubert , Paulin Jacquot , Nadia Oudjane

Privacy concerns with sensitive data are receiving increasing attention. In this paper, we study local differential privacy (LDP) in interactive decentralized optimization. By constructing random local aggregators, we propose a framework to…

Optimization and Control · Mathematics 2019-06-04 Hanshen Xiao , Yu Ye , Srinivas Devadas

In structured prediction problems where we have indirect supervision of the output, maximum marginal likelihood faces two computational obstacles: non-convexity of the objective and intractability of even a single gradient computation. In…

Machine Learning · Statistics 2016-08-11 Aditi Raghunathan , Roy Frostig , John Duchi , Percy Liang