English
Related papers

Related papers: How to Make Your Approximation Algorithm Private: …

200 papers

A common approach for minimizing a smooth nonlinear function is to employ finite-difference approximations to the gradient. While this can be easily performed when no error is present within the function evaluations, when the function is…

Optimization and Control · Mathematics 2022-03-24 Hao-Jun Michael Shi , Yuchen Xie , Melody Qiming Xuan , Jorge Nocedal

We study differentially-private statistics in the fully dynamic continual observation model, where many updates can arrive at each time step and updates to a stream can involve both insertions and deletions of an item. Earlier work (e.g.,…

Cryptography and Security · Computer Science 2026-01-06 Joel Daniel Andersson , Palak Jain , Satchit Sivakumar

The simplest and most widely applied method for guaranteeing differential privacy is to add instance-independent noise to a statistic of interest that is scaled to its global sensitivity. However, global sensitivity is a worst-case notion…

Statistics Theory · Mathematics 2019-06-10 Mark Bun , Thomas Steinke

Differentially private selection mechanisms offer strong privacy guarantees for queries aiming to identify the top-scoring element r from a finite set R, based on a dataset-dependent utility function. While selection queries are fundamental…

Machine Learning · Computer Science 2025-04-16 Iago Chaves , Victor Farias , Amanda Perez , Diego Mesquita , Javam Machado

Hyperparameter optimization, also known as hyperparameter tuning, is a widely recognized technique for improving model performance. Regrettably, when training private ML models, many practitioners often overlook the privacy risks associated…

Machine Learning · Computer Science 2023-11-28 Hua Wang , Sheng Gao , Huanyu Zhang , Weijie J. Su , Milan Shen

Differentially private algorithms allow large-scale data analytics while preserving user privacy. Designing such algorithms for graph data is gaining importance with the growth of large networks that model various (sensitive) relationships…

Data Structures and Algorithms · Computer Science 2022-11-22 Laxman Dhulipala , Quanquan C. Liu , Sofya Raskhodnikova , Jessica Shi , Julian Shun , Shangdi Yu

We study algorithms for the sliding-window model, an important variant of the data-stream model, in which the goal is to compute some function of a fixed-length suffix of the stream. We extend the smooth-histogram framework of Braverman and…

Data Structures and Algorithms · Computer Science 2022-05-26 Robert Krauthgamer , David Reitblat

Given an approximation algorithm $A$, we want to find the input with the worst approximation ratio, i.e., the input for which $A$'s output's objective value is the worst possible compared to the optimal solution's objective value. Such hard…

Data Structures and Algorithms · Computer Science 2025-04-29 Eklavya Sharma

We initiate a systematic study of algorithms that are both differentially private and run in sublinear time for several problems in which the goal is to estimate natural graph parameters. Our main result is a differentially-private…

Data Structures and Algorithms · Computer Science 2022-03-15 Jeremiah Blocki , Elena Grigorescu , Tamalika Mukherjee

Privacy in AI remains a topic that draws attention from researchers and the general public in recent years. As one way to implement privacy-preserving AI, differentially private learning is a framework that enables AI models to use…

Machine Learning · Computer Science 2023-05-03 Tianyu Xia , Shuheng Shen , Su Yao , Xinyi Fu , Ke Xu , Xiaolong Xu , Xing Fu

Text-to-image diffusion models have been shown to suffer from sample-level memorization, possibly reproducing near-perfect replica of images that they are trained on, which may be undesirable. To remedy this issue, we develop the first…

Machine learning models are increasingly used in high-stakes decision-making systems. In such applications, a major concern is that these models sometimes discriminate against certain demographic groups such as individuals with certain…

Machine Learning · Computer Science 2023-06-06 Andrew Lowy , Devansh Gupta , Meisam Razaviyayn

Differential privacy (DP) has become the standard for private data analysis. Certain machine learning applications only require privacy protection for specific protected attributes. Using naive variants of differential privacy in such use…

Cryptography and Security · Computer Science 2025-06-25 Saeed Mahloujifar , Chuan Guo , G. Edward Suh , Kamalika Chaudhuri

Differentially Private-SGD (DP-SGD) of Abadi et al. (2016) and its variations are the only known algorithms for private training of large scale neural networks. This algorithm requires computation of per-sample gradients norms which is…

Machine Learning · Computer Science 2021-02-08 Zhiqi Bu , Sivakanth Gopi , Janardhan Kulkarni , Yin Tat Lee , Judy Hanwen Shen , Uthaipon Tantipongpipat

The last few years have seen a surge of work on high dimensional statistics under privacy constraints, mostly following two main lines of work: the ``worst case'' line, which does not make any distributional assumptions on the input data;…

Statistics Theory · Mathematics 2022-08-17 Omri Ben-Eliezer , Dan Mikulincer , Ilias Zadik

We study streaming algorithms in the white-box adversarial stream model, where the internal state of the streaming algorithm is revealed to an adversary who adaptively generates the stream updates, but the algorithm obtains fresh randomness…

Data Structures and Algorithms · Computer Science 2023-07-10 Ying Feng , David P. Woodruff

This paper argues that randomized linear sketching is a natural tool for on-the-fly compression of data matrices that arise from large-scale scientific simulations and data collection. The technical contribution consists in a new algorithm…

Numerical Analysis · Computer Science 2019-02-26 Joel A. Tropp , Alp Yurtsever , Madeleine Udell , Volkan Cevher

A key problem in a variety of applications is that of domain adaptation from a public source domain, for which a relatively large amount of labeled data with no privacy constraints is at one's disposal, to a private target domain, for which…

Machine Learning · Computer Science 2022-08-15 Raef Bassily , Mehryar Mohri , Ananda Theertha Suresh

Given a group size m and a sensitive dataset D, group privacy (GP) releases information about D with the guarantee that the adversary cannot infer with high confidence whether the underlying data is D or a neighboring dataset D' that…

Cryptography and Security · Computer Science 2024-08-27 Yangfan Jiang , Xinjian Luo , Yin Yang , Xiaokui Xiao

We propose, implement, and evaluate a new algorithm for releasing answers to very large numbers of statistical queries like $k$-way marginals, subject to differential privacy. Our algorithm makes adaptive use of a continuous relaxation of…

Machine Learning · Computer Science 2021-06-24 Sergul Aydore , William Brown , Michael Kearns , Krishnaram Kenthapadi , Luca Melis , Aaron Roth , Ankit Siva