English
Related papers

Related papers: Detecting Violations of Differential Privacy for Q…

200 papers

Training data privacy is a fundamental problem in modern Artificial Intelligence (AI) applications, such as face recognition, recommendation systems, language generation, and many others, as it may contain sensitive user information related…

Machine Learning · Computer Science 2024-11-05 Jiuxiang Gu , Yingyu Liang , Zhizhou Sha , Zhenmei Shi , Zhao Song

An important use of private data is to build machine learning classifiers. While there is a burgeoning literature on differentially private classification algorithms, we find that they are not practical in real applications due to two…

Machine Learning · Computer Science 2014-11-24 Ben Stoddard , Yan Chen , Ashwin Machanavajjhala

Differential privacy is a widely adopted framework designed to safeguard the sensitive information of data providers within a data set. It is based on the application of controlled noise at the interface between the server that stores and…

Cryptography and Security · Computer Science 2024-05-06 Rūta Binkytė , Carlos Pinzón , Szilvia Lestyán , Kangsoo Jung , Héber H. Arcolezi , Catuscia Palamidessi

The standard definition of differential privacy (DP) ensures that a mechanism's output distribution on adjacent datasets is indistinguishable. However, real-world implementations of DP can, and often do, reveal information through their…

Cryptography and Security · Computer Science 2024-11-26 Zachary Ratliff , Salil Vadhan

In modern settings of data analysis, we may be running our algorithms on datasets that are sensitive in nature. However, classical machine learning and statistical algorithms were not designed with these risks in mind, and it has been…

Data Structures and Algorithms · Computer Science 2021-08-21 Huanyu Zhang

Traditional approaches to differential privacy assume a fixed privacy requirement $\epsilon$ for a computation, and attempt to maximize the accuracy of the computation subject to the privacy constraint. As differential privacy is…

Machine Learning · Computer Science 2017-06-01 Katrina Ligett , Seth Neel , Aaron Roth , Bo Waggoner , Z. Steven Wu

Nowadays, machine learning models and applications have become increasingly pervasive. With this rapid increase in the development and employment of machine learning models, a concern regarding privacy has risen. Thus, there is a legitimate…

Machine Learning · Computer Science 2022-11-22 Samah Baraheem , Zhongmei Yao

Statistical model checking is a class of sequential algorithms that can verify specifications of interest on an ensemble of cyber-physical systems (e.g., whether 99% of cars from a batch meet a requirement on their energy efficiency). These…

Machine Learning · Computer Science 2022-06-29 Yu Wang , Hussein Sibai , Mark Yen , Sayan Mitra , Geir E. Dullerud

This work proposes an algorithmic method to verify differential privacy for estimation mechanisms with performance guarantees. Differential privacy makes it hard to distinguish outputs of a mechanism produced by adjacent inputs. While…

Systems and Control · Electrical Eng. & Systems 2021-12-03 Yunhai Han , Sonia Martínez

Recent advancements in quantum computing software are gradually increasing the scope and size of quantum programs being developed. At the same time, however, these larger programs provide more possibilities for functional errors that are…

Quantum Physics · Physics 2024-12-18 Damian Rovara , Lukas Burgholzer , Robert Wille

Many machine learning applications are based on data collected from people, such as their tastes and behaviour as well as biological traits and genetic data. Regardless of how important the application might be, one has to make sure…

Machine Learning · Statistics 2017-04-11 Joonas Jälkö , Onur Dikmen , Antti Honkela

Differential privacy is a formal, mathematical definition of data privacy that has gained traction in academia, industry, and government. The task of correctly constructing differentially private algorithms is non-trivial, and mistakes have…

Cryptography and Security · Computer Science 2021-01-05 Subhajit Roy , Justin Hsu , Aws Albarghouthi

Differential privacy is the state-of-the-art definition for privacy, guaranteeing that any analysis performed on a sensitive dataset leaks no information about the individuals whose data are contained therein. In this thesis, we develop…

Machine Learning · Computer Science 2023-11-29 Vassilis Digalakis

The adoption of differential privacy is growing but the complexity of designing private, efficient and accurate algorithms is still high. We propose a novel programming framework and system, Ektelo, for implementing both existing and new…

Distributed quantum computing is a promising computational paradigm for performing computations that are beyond the reach of individual quantum devices. Privacy in distributed quantum computing is critical for maintaining confidentiality…

Quantum technologies hold the promise of not only faster algorithmic processing of data, via quantum computation, but also of more secure communications, in the form of quantum cryptography. In recent years, a number of protocols have…

Quantum Physics · Physics 2016-12-01 Joseph F. Fitzsimons

Artificial Intelligence (AI) has attracted a great deal of attention in recent years. However, alongside all its advancements, problems have also emerged, such as privacy violations, security issues and model fairness. Differential privacy,…

Cryptography and Security · Computer Science 2020-09-01 Tianqing Zhu , Dayong Ye , Wei Wang , Wanlei Zhou , Philip S. Yu

Differentially private training algorithms provide protection against one of the most popular attacks in machine learning: the membership inference attack. However, these privacy algorithms incur a loss of the model's classification…

Cryptography and Security · Computer Science 2021-10-13 Jiaxiang Liu , Simon Oya , Florian Kerschbaum

We investigate whether Differentially Private SGD offers better privacy in practice than what is guaranteed by its state-of-the-art analysis. We do so via novel data poisoning attacks, which we show correspond to realistic privacy attacks.…

Cryptography and Security · Computer Science 2020-06-16 Matthew Jagielski , Jonathan Ullman , Alina Oprea

Quantum machine learning (QML) promises significant computational advantages, yet models trained on sensitive data risk memorizing individual records, creating serious privacy vulnerabilities. While Quantum Differential Privacy (QDP)…

Machine Learning · Computer Science 2025-12-17 Baobao Song , Shiva Raj Pokhrel , Athanasios V. Vasilakos , Tianqing Zhu , Gang Li