English
Related papers

Related papers: Differentially Private $L_2$-Heavy Hitters in the …

200 papers

Differential privacy (DP) is a widely-accepted and widely-applied notion of privacy based on worst-case analysis. Often, DP classifies most mechanisms without additive noise as non-private (Dwork et al., 2014). Thus, additive noises are…

Cryptography and Security · Computer Science 2023-12-14 Ao Liu , Yu-Xiang Wang , Lirong Xia

Differential privacy is a cryptographically-motivated approach to privacy that has become a very active field of research over the last decade in theoretical computer science and machine learning. In this paradigm one assumes there is a…

Machine Learning · Computer Science 2023-08-02 Marco Avella-Medina

We study the design of differentially private algorithms for adaptive analysis of dynamically growing databases, where a database accumulates new data entries while the analysis is ongoing. We provide a collection of tools for machine…

Data Structures and Algorithms · Computer Science 2018-03-20 Rachel Cummings , Sara Krehbiel , Kevin A. Lai , Uthaipon Tantipongpipat

Differential privacy and sublinear algorithms are both rapidly emerging algorithmic themes in times of big data analysis. Although recent works have shown the existence of differentially private sublinear algorithms for many problems…

Data Structures and Algorithms · Computer Science 2025-01-15 Jeremiah Blocki , Hendrik Fichtenberger , Elena Grigorescu , Tamalika Mukherjee

We propose a new differentially-private decision forest algorithm that minimizes both the number of queries required, and the sensitivity of those queries. To do so, we build an ensemble of random decision trees that avoids querying the…

Cryptography and Security · Computer Science 2021-08-25 Sam Fletcher , Md Zahidul Islam

Shuffle model of differential privacy is a novel distributed privacy model based on a combination of local privacy mechanisms and a secure shuffler. It has been shown that the additional randomisation provided by the shuffler improves…

Cryptography and Security · Computer Science 2022-02-02 Antti Koskela , Mikko A. Heikkilä , Antti Honkela

We provide a differentially private algorithm for producing synthetic data simultaneously useful for multiple tasks: marginal queries and multitask machine learning (ML). A key innovation in our algorithm is the ability to directly handle…

In this paper, we show that the process of continually learning new tasks and memorizing previous tasks introduces unknown privacy risks and challenges to bound the privacy loss. Based upon this, we introduce a formal definition of Lifelong…

Machine Learning · Computer Science 2022-07-27 Phung Lai , Han Hu , NhatHai Phan , Ruoming Jin , My T. Thai , An M. Chen

We present an approach for generating differentially private synthetic text using large language models (LLMs), via private prediction. In the private prediction framework, we only require the output synthetic data to satisfy differential…

Machine Learning · Computer Science 2024-10-10 Kareem Amin , Alex Bie , Weiwei Kong , Alexey Kurakin , Natalia Ponomareva , Umar Syed , Andreas Terzis , Sergei Vassilvitskii

Ratio statistics--such as relative risk and odds ratios--play a central role in hypothesis testing, model evaluation, and decision-making across many areas of machine learning, including causal inference and fairness analysis. However,…

Machine Learning · Statistics 2025-05-28 Tomer Shoham , Katrina Ligettt

Linear $L_1$-regularized models have remained one of the simplest and most effective tools in data analysis, especially in information retrieval problems where n-grams over text with TF-IDF or Okapi feature values are a strong and easy…

Machine Learning · Computer Science 2023-03-21 Amol Khanna , Fred Lu , Edward Raff

This work addresses the problem of revenue maximization in a repeated, unlimited supply item-pricing auction while preserving buyer privacy. We present a novel algorithm that provides differential privacy with respect to the buyer's input…

Computer Science and Game Theory · Computer Science 2023-10-31 Joon Suk Huh

Privacy preservation has become a critical concern in high-dimensional data analysis due to the growing prevalence of data-driven applications. Since its proposal, sliced inverse regression has emerged as a widely utilized statistical…

Machine Learning · Statistics 2025-04-08 Xintao Xia , Linjun Zhang , Zhanrui Cai

Distributed stochastic optimization enables multi-agent collaboration in applications such as distributed learning and sensor networks, but also raises critical privacy concerns due to the involvement of sensitive data. While existing…

Systems and Control · Electrical Eng. & Systems 2026-04-24 Haoqiang Zhou , Chi Chen , Yongfeng Zhi , Huan Gao

This article establishes a method to answer a finite set of linear queries on a given dataset while ensuring differential privacy. To achieve this, we formulate the corresponding task as a saddle-point problem, i.e. an optimization problem…

Methodology · Statistics 2024-11-05 Giorgio Micali , Clement Lezane , Annika Betken

In monitoring applications, recent data is more important than distant data. How does this affect privacy of data analysis? We study a general class of data analyses - computing predicate sums - with privacy. Formally, we study the problem…

Data Structures and Algorithms · Computer Science 2013-08-05 Jean Bolot , Nadia Fawaz , S. Muthukrishnan , Aleksandar Nikolov , Nina Taft

Latent Dirichlet Allocation (LDA) is a popular topic modeling technique for hidden semantic discovery of text data and serves as a fundamental tool for text analysis in various applications. However, the LDA model as well as the training…

Machine Learning · Computer Science 2020-10-12 Fangyuan Zhao , Xuebin Ren , Shusen Yang , Qing Han , Peng Zhao , Xinyu Yang

We present new theoretical results on differentially private data release useful with respect to any target class of counting queries, coupled with experimental results on a variety of real world data sets. Specifically, we study a simple…

Data Structures and Algorithms · Computer Science 2012-03-16 Moritz Hardt , Katrina Ligett , Frank McSherry

Differentially private analysis of graphs is widely used for releasing statistics from sensitive graphs while still preserving user privacy. Most existing algorithms however are in a centralized privacy model, where a trusted data curator…

Cryptography and Security · Computer Science 2021-02-12 Jacob Imola , Takao Murakami , Kamalika Chaudhuri

Models need to be trained with privacy-preserving learning algorithms to prevent leakage of possibly sensitive information contained in their training data. However, canonical algorithms like differentially private stochastic gradient…

Machine Learning · Computer Science 2022-10-06 Yannis Cattan , Christopher A. Choquette-Choo , Nicolas Papernot , Abhradeep Thakurta