English
Related papers

Related papers: Differentially Private Simple Linear Regression

200 papers

Linear sketches have been widely adopted to process fast data streams, and they can be used to accurately answer frequency estimation, approximate top K items, and summarize data distributions. When data are sensitive, it is desirable to…

Data Structures and Algorithms · Computer Science 2022-10-18 Fuheng Zhao , Dan Qiao , Rachel Redberg , Divyakant Agrawal , Amr El Abbadi , Yu-Xiang Wang

A key task in managing distributed, sensitive data is to measure the extent to which a distribution changes. Understanding this drift can effectively support a variety of federated learning and analytics tasks. However, in many practical…

Machine Learning · Computer Science 2024-12-02 Mary Scott , Sayan Biswas , Graham Cormode , Carsten Maple

We develop formal privacy mechanisms for releasing statistics from data with many outlying values, such as income data. These mechanisms ensure that a per-record differential privacy guarantee degrades slowly in the protected records'…

Cryptography and Security · Computer Science 2025-05-05 Brian Finley , Anthony M Caruso , Justin C Doty , Ashwin Machanavajjhala , Mikaela R Meyer , David Pujol , William Sexton , Zachary Terner

We consider a sequential setting in which a single dataset of individuals is used to perform adaptively-chosen analyses, while ensuring that the differential privacy loss of each participant does not exceed a pre-specified privacy budget.…

Cryptography and Security · Computer Science 2022-01-11 Vitaly Feldman , Tijana Zrnic

Differential privacy (DP) allows the quantification of privacy loss when the data of individuals is subjected to algorithmic processing such as machine learning, as well as the provision of objective privacy guarantees. However, while…

Cryptography and Security · Computer Science 2021-11-30 Tamara T. Mueller , Alexander Ziller , Dmitrii Usynin , Moritz Knolle , Friederike Jungmann , Daniel Rueckert , Georgios Kaissis

Motivated by the increasing deployment of reinforcement learning in the real world, involving a large consumption of personal data, we introduce a differentially private (DP) policy gradient algorithm. We show that, in this setting, the…

Machine Learning · Computer Science 2025-02-03 Alexandre Rio , Merwan Barlier , Igor Colin

Nowadays, machine learning models and applications have become increasingly pervasive. With this rapid increase in the development and employment of machine learning models, a concern regarding privacy has risen. Thus, there is a legitimate…

Machine Learning · Computer Science 2022-11-22 Samah Baraheem , Zhongmei Yao

Data is continuously generated by modern data sources, and a recent challenge in machine learning has been to develop techniques that perform well in an incremental (streaming) setting. In this paper, we investigate the problem of private…

Data Structures and Algorithms · Computer Science 2017-01-05 Shiva Prasad Kasiviswanathan , Kobbi Nissim , Hongxia Jin

Local differential privacy is a differential privacy paradigm in which individuals first apply a privacy mechanism to their data (often by adding noise) before transmitting the result to a curator. The noise for privacy results in…

Methodology · Statistics 2023-10-17 Yuki Ohnishi , Jordan Awan

Differential Privacy (DP) provides strong guarantees on the risk of compromising a user's data in statistical learning applications, though these strong protections make learning challenging and may be too stringent for some use cases. To…

Machine Learning · Computer Science 2019-12-10 Hilal Asi , John Duchi , Omid Javidbakht

Recently differential privacy has been used for a number of streaming, data structure, and dynamic graph problems as a means of hiding the internal randomness of the data structure, so that multiple possibly adaptive queries can be made…

Data Structures and Algorithms · Computer Science 2025-06-09 Shiyuan Feng , Ying Feng , George Z. Li , Zhao Song , David P. Woodruff , Lichen Zhang

Data mining information about people is becoming increasingly important in the data-driven society of the 21st century. Unfortunately, sometimes there are real-world considerations that conflict with the goals of data mining; sometimes the…

Databases · Computer Science 2019-05-27 Sam Fletcher , Md Zahidul Islam

Data privacy is a central concern in many applications involving ranking from incomplete and noisy pairwise comparisons, such as recommendation systems, educational assessments, and opinion surveys on sensitive topics. In this work, we…

Statistics Theory · Mathematics 2025-07-15 T. Tony Cai , Abhinav Chakraborty , Yichen Wang

The change-point detection problem seeks to identify distributional changes at an unknown change-point k* in a stream of data. This problem appears in many important practical settings involving personal data, including biosurveillance,…

Statistics Theory · Mathematics 2019-09-10 Rachel Cummings , Sara Krehbiel , Yajun Mei , Rui Tuo , Wanrong Zhang

Differential privacy (DP) is a compelling privacy definition that explains the privacy-utility tradeoff via formal, provable guarantees. Inspired by recent progress toward general-purpose data release algorithms, we propose a private…

Data Structures and Algorithms · Computer Science 2020-06-17 Benjamin Coleman , Anshumali Shrivastava

The challenge of producing accurate statistics while respecting the privacy of the individuals in a sample is an important area of research. We study minimax lower bounds for classes of differentially private estimators. In particular, we…

Machine Learning · Computer Science 2024-09-19 Clément Lalanne , Aurélien Garivier , Rémi Gribonval

We introduce the linear-transformation model, a distributed model of differentially private data analysis. Clients have access to a trusted platform capable of applying a public matrix to their inputs. Such computations can be securely…

Cryptography and Security · Computer Science 2025-03-06 Jakob Burkhardt , Hannah Keller , Claudio Orlandi , Chris Schwiegelshohn

We study the statistical complexity of private linear regression under an unknown, potentially ill-conditioned covariate distribution. Somewhat surprisingly, under privacy constraints the intrinsic complexity is \emph{not} captured by the…

Machine Learning · Computer Science 2025-11-06 Fan Chen , Jiachun Li , Alexander Rakhlin , David Simchi-Levi

This work studies formal utility and privacy guarantees for a simple multiplicative database transformation, where the data are compressed by a random linear or affine transformation, reducing the number of data records substantially, while…

Machine Learning · Statistics 2009-01-13 Shuheng Zhou , Katrina Ligett , Larry Wasserman

The increased application of machine learning (ML) in sensitive domains requires protecting the training data through privacy frameworks, such as differential privacy (DP). DP requires to specify a uniform privacy level $\varepsilon$ that…

Machine Learning · Computer Science 2024-01-31 Krishna Acharya , Franziska Boenisch , Rakshit Naidu , Juba Ziani