English
Related papers

Related papers: Detecting Violations of Differential Privacy

200 papers

Differential privacy is a definition of "privacy'" for algorithms that analyze and publish information about statistical databases. It is often claimed that differential privacy provides guarantees against adversaries with arbitrary side…

Cryptography and Security · Computer Science 2023-01-24 Shiva Prasad Kasiviswanathan , Adam Smith

Concern about how to aggregate sensitive user data without compromising individual privacy is a major barrier to greater availability of data. The model of differential privacy has emerged as an accepted model to release sensitive…

Databases · Computer Science 2017-10-03 Graham Cormode , Tejas Kulkarni , Divesh Srivastava

Differential privacy is a rigorous privacy condition achieved by randomizing query answers. This paper develops efficient algorithms for answering multiple queries under differential privacy with low error. We pursue this goal by advancing…

Databases · Computer Science 2011-03-08 Chao Li , Gerome Miklau

The need to analyze sensitive data, such as medical records or financial data, has created a critical research challenge in recent years. In this paper, we adopt the framework of differential privacy, and explore mechanisms for generating…

Cryptography and Security · Computer Science 2024-05-09 Nikolija Bojkovic , Po-Ling Loh

We propose CheckDP, the first automated and integrated approach for proving or disproving claims that a mechanism is differentially private. CheckDP can find counterexamples for mechanisms with subtle bugs for which prior counterexample…

Programming Languages · Computer Science 2020-09-14 Yuxin Wang , Zeyu Ding , Daniel Kifer , Danfeng Zhang

Artificial Intelligence (AI) has attracted a great deal of attention in recent years. However, alongside all its advancements, problems have also emerged, such as privacy violations, security issues and model fairness. Differential privacy,…

Cryptography and Security · Computer Science 2020-09-01 Tianqing Zhu , Dayong Ye , Wei Wang , Wanlei Zhou , Philip S. Yu

The technical literature about data privacy largely consists of two complementary approaches: formal definitions of conditions sufficient for privacy preservation and attacks that demonstrate privacy breaches. Differential privacy is an…

Cryptography and Security · Computer Science 2025-02-06 Mark Bun , Marco Carmosino , Palak Jain , Gabriel Kaptchuk , Satchit Sivakumar

Designing privacy-preserving machine learning algorithms has received great attention in recent years, especially in the setting when the data contains sensitive information. Differential privacy (DP) is a widely used mechanism for data…

Machine Learning · Computer Science 2025-09-11 Chunyang Liao , Deanna Needell , Hayden Schaeffer , Alexander Xue

In recent years, differential privacy has emerged as the de facto standard for sharing statistics of datasets while limiting the disclosure of private information about the involved individuals. This is achieved by randomly perturbing the…

Cryptography and Security · Computer Science 2024-12-18 Aras Selvi , Huikang Liu , Wolfram Wiesemann

The leakage of data might have been an extreme effect on the personal level if it contains sensitive information. Common prevention methods like encryption-decryption, endpoint protection, intrusion detection system are prone to leakage.…

Cryptography and Security · Computer Science 2020-06-12 Poushali Sengupta , Sudipta Paul , Subhankar Mishra

Differential privacy is a restriction on data processing algorithms that provides strong confidentiality guarantees for individual records in the data. However, research on proper statistical inference, that is, research on properly…

Cryptography and Security · Computer Science 2021-07-06 Joerg Drechsler , Ira Globus-Harris , Audra McMillan , Jayshree Sarathy , Adam Smith

Differential privacy is a strong notion for privacy that can be used to prove formal guarantees, in terms of a privacy budget, $\epsilon$, about how much information is leaked by a mechanism. However, implementations of privacy-preserving…

Machine Learning · Computer Science 2019-08-14 Bargav Jayaraman , David Evans

Many machine learning applications are based on data collected from people, such as their tastes and behaviour as well as biological traits and genetic data. Regardless of how important the application might be, one has to make sure…

Machine Learning · Statistics 2017-04-11 Joonas Jälkö , Onur Dikmen , Antti Honkela

Differential privacy is a popular privacy model within the research community because of the strong privacy guarantee it offers, namely that the presence or absence of any individual in a data set does not significantly influence the…

Cryptography and Security · Computer Science 2017-02-09 Jordi Soria-Comas , Josep Domingo-Ferrer , David Sánchez , David Megías

While the introduction of differential privacy has been a major breakthrough in the study of privacy preserving data publication, some recent work has pointed out a number of cases where it is not possible to limit inference about…

Databases · Computer Science 2012-02-16 Ada Wai-Chee Fu , Jia Wang , Ke Wang , Raymond Chi-Wing Wong

This paper aims at answering the following two questions in privacy-preserving data analysis and publishing: What formal privacy guarantee (if any) does $k$-anonymization provide? How to benefit from the adversary's uncertainty about the…

Cryptography and Security · Computer Science 2015-03-17 Ninghui Li , Wahbeh Qardaji , Dong Su

We consider the problem of property testing for differential privacy: with black-box access to a purportedly private algorithm, can we verify its privacy guarantees? In particular, we show that any privacy guarantee that can be efficiently…

Cryptography and Security · Computer Science 2019-02-14 Anna Gilbert , Audra McMillan

Differential privacy is often applied with a privacy parameter that is larger than the theory suggests is ideal; various informal justifications for tolerating large privacy parameters have been proposed. In this work, we consider partial…

Cryptography and Security · Computer Science 2022-09-12 Badih Ghazi , Ravi Kumar , Pasin Manurangsi , Thomas Steinke

As the use of differential privacy (DP) becomes widespread, the development of effective tools for reasoning about the privacy guarantee becomes increasingly critical. In pursuit of this goal, we demonstrate novel relationships between DP…

Cryptography and Security · Computer Science 2025-07-15 Zeki Kazan , Sagar Sharma , Wanrong Zhang , Bo Jiang , Qiang Yan

There are now several large scale deployments of differential privacy used to collect statistical information about users. However, these deployments periodically recollect the data and recompute the statistics using algorithms designed for…

Machine Learning · Computer Science 2018-11-21 Matthew Joseph , Aaron Roth , Jonathan Ullman , Bo Waggoner