English
Related papers

Related papers: Manipulation Attacks in Local Differential Privacy

200 papers

Training reliable deep learning models which avoid making overconfident but incorrect predictions is a longstanding challenge. This challenge is further exacerbated when learning has to be differentially private: protection provided to…

Machine Learning · Computer Science 2023-05-31 Stephan Rabanser , Anvith Thudi , Abhradeep Thakurta , Krishnamurthy Dvijotham , Nicolas Papernot

Motivated by the increasing deployment of reinforcement learning in the real world, involving a large consumption of personal data, we introduce a differentially private (DP) policy gradient algorithm. We show that, in this setting, the…

Machine Learning · Computer Science 2025-02-03 Alexandre Rio , Merwan Barlier , Igor Colin

Many analysis and machine learning tasks require the availability of marginal statistics on multidimensional datasets while providing strong privacy guarantees for the data subjects. Applications for these statistics range from finding…

Databases · Computer Science 2017-11-09 Tejas Kulkarni , Graham Cormode , Divesh Srivastava

Differential privacy (DP) allows the quantification of privacy loss when the data of individuals is subjected to algorithmic processing such as machine learning, as well as the provision of objective privacy guarantees. However, while…

Cryptography and Security · Computer Science 2021-11-30 Tamara T. Mueller , Alexander Ziller , Dmitrii Usynin , Moritz Knolle , Friederike Jungmann , Daniel Rueckert , Georgios Kaissis

The collection of individuals' data has become commonplace in many industries. Local differential privacy (LDP) offers a rigorous approach to preserving privacy whereby the individual privatises their data locally, allowing only their…

Machine Learning · Computer Science 2022-05-17 Alex Mansbridge , Gregory Barbour , Davide Piras , Michael Murray , Christopher Frye , Ilya Feige , David Barber

In this paper, we describe our approach to achieve distributed differential privacy by sampling alone. Our mechanism works in the semi-honest setting (honest-but-curious whereby aggregators attempt to peek at the data though follow the…

Cryptography and Security · Computer Science 2017-06-16 Joshua Joy

Local differential privacy (LPD) is a distributed variant of differential privacy (DP) in which the obfuscation of the sensitive information is done at the level of the individual records, and in general it is used to sanitize data that are…

Cryptography and Security · Computer Science 2018-05-04 Mário S. Alvim , Konstantinos Chatzikokolakis , Catuscia Palamidessi , Anna Pazii

Economics and social science research often require analyzing datasets of sensitive personal information at fine granularity, with models fit to small subsets of the data. Unfortunately, such fine-grained analysis can easily reveal…

Machine Learning · Computer Science 2020-07-13 Daniel Alabi , Audra McMillan , Jayshree Sarathy , Adam Smith , Salil Vadhan

Differential privacy is a privacy measure based on the difficulty of discriminating between similar input data. In differential privacy analysis, similar data usually implies that their distance does not exceed a predetermined threshold.…

Optimization and Control · Mathematics 2021-06-25 Genki Sugiura , Kaito Ito , Kenji Kashima

When collecting information, local differential privacy (LDP) alleviates privacy concerns of users because their private information is randomized before being sent it to the central aggregator. LDP imposes large amount of noise as each…

Cryptography and Security · Computer Science 2020-08-04 Tianhao Wang , Bolin Ding , Min Xu , Zhicong Huang , Cheng Hong , Jingren Zhou , Ninghui Li , Somesh Jha

Designing privacy-preserving machine learning algorithms has received great attention in recent years, especially in the setting when the data contains sensitive information. Differential privacy (DP) is a widely used mechanism for data…

Machine Learning · Computer Science 2025-09-11 Chunyang Liao , Deanna Needell , Hayden Schaeffer , Alexander Xue

Sensitive statistics are often collected across sets of users, with repeated collection of reports done over time. For example, trends in users' private preferences or software usage may be monitored via such reports. We study the…

Machine Learning · Computer Science 2020-07-28 Úlfar Erlingsson , Vitaly Feldman , Ilya Mironov , Ananth Raghunathan , Kunal Talwar , Abhradeep Thakurta

For systems whose states implicate sensitive information, their privacy is of great concern. While notions like differential privacy have been successfully introduced to dynamical systems, it is still unclear how a system's privacy can be…

Systems and Control · Electrical Eng. & Systems 2025-11-17 Le Liu , Yu Kawano , Ming Cao

Recent work in differential privacy has highlighted the shuffled model as a promising avenue to compute accurate statistics while keeping raw data in users' hands. We present a protocol in this model that estimates histograms with error…

Cryptography and Security · Computer Science 2020-04-15 Victor Balcer , Albert Cheu

In order to both learn and protect sensitive training data, there has been a growing interest in privacy preserving machine learning methods. Differential privacy has emerged as an important measure of privacy. We are interested in the…

Cryptography and Security · Computer Science 2025-02-11 Antoine Barczewski , Amal Mawass , Jan Ramon

Differential privacy is often applied with a privacy parameter that is larger than the theory suggests is ideal; various informal justifications for tolerating large privacy parameters have been proposed. In this work, we consider partial…

Cryptography and Security · Computer Science 2022-09-12 Badih Ghazi , Ravi Kumar , Pasin Manurangsi , Thomas Steinke

Concern about how to aggregate sensitive user data without compromising individual privacy is a major barrier to greater availability of data. The model of differential privacy has emerged as an accepted model to release sensitive…

Databases · Computer Science 2017-10-03 Graham Cormode , Tejas Kulkarni , Divesh Srivastava

We study differentially private mean estimation in a high-dimensional setting. Existing differential privacy techniques applied to large dimensions lead to computationally intractable problems or estimators with excessive privacy loss.…

Machine Learning · Computer Science 2020-07-23 Aditya Dhar , Jason Huang

Privacy-preserving distributed machine learning becomes increasingly important due to the recent rapid growth of data. This paper focuses on a class of regularized empirical risk minimization (ERM) machine learning problems, and develops…

Machine Learning · Computer Science 2016-03-11 Tao Zhang , Quanyan Zhu

Differential privacy is a widely used notion of security that enables the processing of sensitive information. In short, differentially private algorithms map "neighbouring" inputs to close output distributions. Prior work proposed several…

Quantum Physics · Physics 2023-07-11 Armando Angrisani , Mina Doosti , Elham Kashefi