English
Related papers

Related papers: Scalable Private Partition Selection via Adaptive …

200 papers

Modern data workflows are inherently adaptive, repeatedly querying the same dataset to refine and validate sequential decisions, but such adaptivity can lead to overfitting and invalid statistical inference. Adaptive Data Analysis (ADA)…

Machine Learning · Computer Science 2026-02-10 Joon Suk Huh

Differential privacy (DP) is a rigorous notion of data privacy, used for private statistics. The canonical algorithm for differentially private mean estimation is to first clip the samples to a bounded range and then add noise to their…

Statistics Theory · Mathematics 2024-10-10 Gautam Kamath , Argyris Mouzakis , Matthew Regehr , Vikrant Singhal , Thomas Steinke , Jonathan Ullman

We formulate a new variant of the private information retrieval (PIR) problem where the user is pliable, i.e., interested in any message from a desired subset of the available dataset, denoted as pliable private information retrieval…

Information Theory · Computer Science 2022-06-14 Sarah A. Obead , Jörg Kliewer

Motivated by settings in which predictive models may be required to be non-discriminatory with respect to certain attributes (such as race), but even collecting the sensitive attribute may be forbidden or restricted, we initiate the study…

Machine Learning · Computer Science 2019-06-04 Matthew Jagielski , Michael Kearns , Jieming Mao , Alina Oprea , Aaron Roth , Saeed Sharifi-Malvajerdi , Jonathan Ullman

Bayesian optimization is a powerful tool for fine-tuning the hyper-parameters of a wide variety of machine learning models. The success of machine learning has led practitioners in diverse real-world settings to learn classifiers for…

Machine Learning · Statistics 2015-02-24 Matt J. Kusner , Jacob R. Gardner , Roman Garnett , Kilian Q. Weinberger

Real-time data-driven optimization and control problems over networks may require sensitive information of participating users to calculate solutions and decision variables, such as in traffic or energy systems. Adversaries with access to…

Optimization and Control · Mathematics 2020-05-25 Roel Dobbe , Ye Pu , Jingge Zhu , Kannan Ramchandran , Claire Tomlin

Given a graph, the densest subgraph problem asks for a set of vertices such that the average degree among these vertices is maximized. Densest subgraph has numerous applications in learning, e.g., community detection in social networks,…

Cryptography and Security · Computer Science 2022-11-15 Alireza Farhadi , MohammadTaghi Hajiaghayi , Elaine Shi

Motivated by applications of large embedding models, we study differentially private (DP) optimization problems under sparsity of individual gradients. We start with new near-optimal bounds for the classic mean estimation problem but with…

Machine Learning · Computer Science 2024-11-01 Badih Ghazi , Cristóbal Guzmán , Pritish Kamath , Ravi Kumar , Pasin Manurangsi

We consider a platform's problem of collecting data from privacy sensitive users to estimate an underlying parameter of interest. We formulate this question as a Bayesian-optimal mechanism design problem, in which an individual can share…

Computer Science and Game Theory · Computer Science 2023-09-07 Alireza Fallah , Ali Makhdoumi , Azarakhsh Malekian , Asuman Ozdaglar

We consider the privacy amplification properties of a sampling scheme in which a user's data is used in $k$ steps chosen randomly and uniformly from a sequence (or set) of $t$ steps. This sampling scheme has been recently applied in the…

Machine Learning · Computer Science 2026-02-20 Vitaly Feldman , Moshe Shenfeld

Differentially private algorithms for answering sets of predicate counting queries on a sensitive database have many applications. Organizations that collect individual-level data, such as statistical agencies and medical institutions, use…

Databases · Computer Science 2018-08-13 Ryan McKenna , Gerome Miklau , Michael Hay , Ashwin Machanavajjhala

Models need to be trained with privacy-preserving learning algorithms to prevent leakage of possibly sensitive information contained in their training data. However, canonical algorithms like differentially private stochastic gradient…

Machine Learning · Computer Science 2022-10-06 Yannis Cattan , Christopher A. Choquette-Choo , Nicolas Papernot , Abhradeep Thakurta

In this paper, we study the problem of precision matrix estimation when the dataset contains sensitive information. In the differential privacy framework, we develop a differentially private ridge estimator by perturbing the sample…

Machine Learning · Statistics 2019-09-09 Wenqing Su , Xiao Guo , Hai Zhang

For scalable machine learning on large data sets, subsampling a representative subset is a common approach for efficient model training. This is often achieved through importance sampling, whereby informative data points are sampled more…

Cryptography and Security · Computer Science 2025-03-31 Dominik Fay , Sebastian Mair , Jens Sjölund

Differential privacy is often studied under two different models of neighboring datasets: the add-remove model and the swap model. While the swap model is frequently used in the academic literature to simplify analysis, many practical…

Data Structures and Algorithms · Computer Science 2024-02-21 Alex Kulesza , Ananda Theertha Suresh , Yuyan Wang

This paper investigates the differentially private bipartite consensus algorithm over signed networks. The proposed algorithm protects each agent's sensitive information by adding noise with time-varying variances to the…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Jimin Wang , Jieming Ke , Ji-Feng Zhang

Maximum diversity aims at selecting a diverse set of high-quality objects from a collection, which is a fundamental problem and has a wide range of applications, e.g., in Web search. Diversity under a uniform or partition matroid constraint…

Data Structures and Algorithms · Computer Science 2021-04-13 Guangyi Zhang , Aristides Gionis

We present an optimization framework for solving multi-agent nonlinear programs subject to inequality constraints while keeping the agents' state trajectories private. Each agent has an objective function depending only upon its own state…

Optimization and Control · Mathematics 2016-08-03 Matthew Hale , Magnus Egerstedt

We design a class of additive noise mechanisms that satisfy \((\varepsilon, \delta)\)-differential privacy (DP) for scalar, real-valued query functions with known sensitivities, with a particular focus on moderate and low-privacy regimes.…

Cryptography and Security · Computer Science 2026-05-28 Huikang Liu , Aras Selvi , Wolfram Wiesemann

Privacy issues and communication cost are both major concerns in distributed optimization. There is often a trade-off between them because the encryption methods required for privacy-preservation often incur expensive communication…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-01 Qiongxiu Li , Richard Heusdens , Mads Græsbøll Christensen