English
Related papers

Related papers: Improved Lower Bound for Differentially Private Fa…

200 papers

Consider the problem of finding a point in a unit $n$-dimensional $\ell_p$-ball ($p\ge 2$) such that the minimum of the weighted Euclidean distance from given $m$ points is maximized. We show in this paper that the recent…

Optimization and Control · Mathematics 2016-06-22 Zuping Wu , Yong Xia , Shu Wang

We study differentially private (DP) algorithms for stochastic non-convex optimization. In this problem, the goal is to minimize the population loss over a $p$-dimensional space given $n$ i.i.d. samples drawn from a distribution. We improve…

Machine Learning · Computer Science 2020-08-12 Yingxue Zhou , Xiangyi Chen , Mingyi Hong , Zhiwei Steven Wu , Arindam Banerjee

It was observed in \citet{gupta2009differentially} that the Set Cover problem has strong impossibility results under differential privacy. In our work, we observe that these hardness results dissolve when we turn to the Partial Set Cover…

Data Structures and Algorithms · Computer Science 2023-08-22 George Z. Li , Dung Nguyen , Anil Vullikanti

Hierarchical Clustering is a popular unsupervised machine learning method with decades of history and numerous applications. We initiate the study of differentially private approximation algorithms for hierarchical clustering under the…

Machine Learning · Computer Science 2023-05-25 Jacob Imola , Alessandro Epasto , Mohammad Mahdian , Vincent Cohen-Addad , Vahab Mirrokni

Stochastic convex optimization over an $\ell_1$-bounded domain is ubiquitous in machine learning applications such as LASSO but remains poorly understood when learning with differential privacy. We show that, up to logarithmic factors the…

Machine Learning · Computer Science 2021-03-03 Hilal Asi , Vitaly Feldman , Tomer Koren , Kunal Talwar

We study approximation algorithms for Maximum Constraint Satisfaction Problems (Max-CSPs) under differential privacy (DP) where the constraints are considered sensitive data. Information-theoretically, we aim to classify the best…

Data Structures and Algorithms · Computer Science 2026-02-11 Prathamesh Dharangutte , Jingcheng Liu , Pasin Manurangsi , Akbar Rafiey , Phanu Vajanopath , Zongrui Zou

In this paper, we revisit the problem of sparse linear regression in the local differential privacy (LDP) model. Existing research in the non-interactive and sequentially local models has focused on obtaining the lower bounds for the case…

Machine Learning · Computer Science 2023-10-12 Liyang Zhu , Meng Ding , Vaneet Aggarwal , Jinhui Xu , Di Wang

Differential private optimization for nonconvex smooth objective is considered. In the previous work, the best known utility bound is $\widetilde O(\sqrt{d}/(n\varepsilon_\mathrm{DP}))$ in terms of the squared full gradient norm, which is…

Machine Learning · Computer Science 2023-06-06 Tomoya Murata , Taiji Suzuki

We consider Online Facility Location in the framework of learning-augmented online algorithms. In Online Facility Location (OFL), demands arrive one-by-one in a metric space and must be (irrevocably) assigned to an open facility upon…

Data Structures and Algorithms · Computer Science 2024-08-20 Dimitris Fotakis , Evangelia Gergatsouli , Themis Gouleakis , Nikolas Patris , Thanos Tolias

In this paper, we provide lower bounds for Differentially Private (DP) Online Learning algorithms. Our result shows that, for a broad class of $(\varepsilon,\delta)$-DP online algorithms, for number of rounds $T$ such that $\log T\leq O(1 /…

Machine Learning · Computer Science 2024-10-22 Daniil Dmitriev , Kristóf Szabó , Amartya Sanyal

We present differentially private (DP) algorithms for bilevel optimization, a problem class that received significant attention lately in various machine learning applications. These are the first algorithms for such problems under standard…

Machine Learning · Computer Science 2026-01-15 Guy Kornowski

In this paper, we consider the problem of differentially private (DP) algorithms for isotonic regression. For the most general problem of isotonic regression over a partially ordered set (poset) $\mathcal{X}$ and for any Lipschitz loss…

Machine Learning · Computer Science 2022-10-28 Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi

A systematic technique to bound factor-revealing linear programs is presented. We show how to derive a family of upper bound factor-revealing programs (UPFRP), and show that each such program can be solved by a computer to bound the…

Data Structures and Algorithms · Computer Science 2015-03-19 Cristina G. Fernandes , Luís A. A. Meira , Flávio K. Miyazawa , Lehilton L. C. Pedrosa

Differentially private stochastic gradient descent (DP-SGD) is the workhorse algorithm for recent advances in private deep learning. It provides a single privacy guarantee to all datapoints in the dataset. We propose output-specific…

Machine Learning · Computer Science 2024-07-26 Da Yu , Gautam Kamath , Janardhan Kulkarni , Tie-Yan Liu , Jian Yin , Huishuai Zhang

There are numerous methods of achieving $\epsilon$-differential privacy (DP). The question is what is the appropriate value of $\epsilon$, since there is no common agreement on a "sufficiently small" $\epsilon$, and its goodness depends on…

Cryptography and Security · Computer Science 2019-12-02 Peeter Laud , Alisa Pankova

We study the running time, in terms of first order oracle queries, of differentially private empirical/population risk minimization of Lipschitz convex losses. We first consider the setting where the loss is non-smooth and the optimizer…

Machine Learning · Computer Science 2025-11-19 Michael Menart , Aleksandar Nikolov

The \emph{Single-Source Personalized PageRank} (SSPPR) query is central to graph OLAP, measuring the probability $\pi(s,t)$ that an $\alpha$-decay random walk from node $s$ terminates at $t$. Despite decades of research, a significant gap…

Data Structures and Algorithms · Computer Science 2026-04-14 Xinpeng Jiang , Haoyu Liu , Siqiang Luo , Xiaokui Xiao

We revisit the problem of privately releasing the all-pairs shortest path distances of a weighted undirected graph up to low additive error, which was first studied by Sealfon [Sea16]. In this paper, we improve significantly on Sealfon's…

Data Structures and Algorithms · Computer Science 2022-04-06 Justin Y. Chen , Shyam Narayanan , Yinzhan Xu

Oblivious dimension reduction, \`{a} la the Johnson-Lindenstrauss (JL) Lemma, is a fundamental approach for processing high-dimensional data. We study this approach for Uniform Facility Location (UFL) on a Euclidean input…

Data Structures and Algorithms · Computer Science 2024-11-11 Lingxiao Huang , Shaofeng H. -C. Jiang , Robert Krauthgamer , Di Yue

Asadpour, Feige, and Saberi proved that the integrality gap of the configuration LP for the restricted max-min allocation problem is at most $4$. However, their proof does not give a polynomial-time approximation algorithm. A lot of efforts…

Data Structures and Algorithms · Computer Science 2019-05-16 Siu-Wing Cheng , Yuchen Mao