English
Related papers

Related papers: A unified view on differential privacy and robustn…

200 papers

Malicious adversaries can attack machine learning models to infer sensitive information or damage the system by launching a series of evasion attacks. Although various work addresses privacy and security concerns, they focus on individual…

Machine Learning · Computer Science 2024-01-22 Janvi Thakkar , Giulio Zizzo , Sergio Maffeis

The widespread adoption of machine learning necessitates robust privacy protection alongside algorithmic resilience. While Local Differential Privacy (LDP) provides foundational guarantees, sophisticated adversaries with prior knowledge…

Machine Learning · Computer Science 2025-07-31 Xiaojin Zhang , Wei Chen

Despite extraordinary progress, current machine learning systems have been shown to be brittle against adversarial examples: seemingly innocuous but carefully crafted perturbations of test examples that cause machine learning predictors to…

Machine Learning · Computer Science 2023-06-14 Omar Montasser

Using a recently proposed privacy definition of R\'enyi Differential Privacy (RDP), we re-examine the inherent privacy of releasing a single sample from a posterior distribution. We exploit the impact of the prior distribution in mitigating…

Machine Learning · Computer Science 2017-10-04 Joseph Geumlek , Shuang Song , Kamalika Chaudhuri

Recent progress in empirical and certified robustness promises to deliver reliable and deployable Deep Neural Networks (DNNs). Despite that success, most existing evaluations of DNN robustness have been done on images sampled from the same…

Machine Learning · Computer Science 2023-11-08 Kumail Alhamoud , Hasan Abed Al Kader Hammoud , Motasem Alfarra , Bernard Ghanem

Robust machine learning formulations have emerged to address the prevalent vulnerability of deep neural networks to adversarial examples. Our work draws the connection between optimal robust learning and the privacy-utility tradeoff…

Machine Learning · Computer Science 2021-05-20 Ye Wang , Shuchin Aeron , Adnan Siraj Rakin , Toshiaki Koike-Akino , Pierre Moulin

Adversarial examples are inevitable on the road of pervasive applications of deep neural networks (DNN). Imperceptible perturbations applied on natural samples can lead DNN-based classifiers to output wrong prediction with fair confidence…

Machine Learning · Computer Science 2020-11-04 Tao Bai , Jinqi Luo , Jun Zhao

Differential privacy is a cryptographically-motivated approach to privacy that has become a very active field of research over the last decade in theoretical computer science and machine learning. In this paradigm one assumes there is a…

Machine Learning · Computer Science 2023-08-02 Marco Avella-Medina

The arms race between attacks and defenses for machine learning models has come to a forefront in recent years, in both the security community and the privacy community. However, one big limitation of previous research is that the security…

Machine Learning · Statistics 2019-08-27 Liwei Song , Reza Shokri , Prateek Mittal

A streaming algorithm is said to be adversarially robust if its accuracy guarantees are maintained even when the data stream is chosen maliciously, by an adaptive adversary. We establish a connection between adversarial robustness of…

Data Structures and Algorithms · Computer Science 2020-04-14 Avinatan Hassidim , Haim Kaplan , Yishay Mansour , Yossi Matias , Uri Stemmer

Adversarial examples that fool machine learning models, particularly deep neural networks, have been a topic of intense research interest, with attacks and defenses being developed in a tight back-and-forth. Most past defenses are best…

Machine Learning · Statistics 2019-05-30 Mathias Lecuyer , Vaggelis Atlidakis , Roxana Geambasu , Daniel Hsu , Suman Jana

Obtaining deep networks that are robust against adversarial examples and generalize well is an open problem. A recent hypothesis even states that both robust and accurate models are impossible, i.e., adversarial robustness and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 David Stutz , Matthias Hein , Bernt Schiele

In statistical learning and analysis from shared data, which is increasingly widely adopted in platforms such as federated learning and meta-learning, there are two major concerns: privacy and robustness. Each participating individual…

Machine Learning · Computer Science 2021-11-25 Xiyang Liu , Weihao Kong , Sham Kakade , Sewoong Oh

Differential Privacy (DP) is a family of definitions that bound the worst-case privacy leakage of a mechanism. One important feature of the worst-case DP guarantee is it naturally implies protections against adversaries with less prior…

Cryptography and Security · Computer Science 2025-07-14 Marika Swanberg , Meenatchi Sundaram Muthu Selva Annamalai , Jamie Hayes , Borja Balle , Adam Smith

Emerging Distributed AI systems are revolutionizing big data computing and data processing capabilities with growing economic and societal impact. However, recent studies have identified new attack surfaces and risks caused by security,…

Machine Learning · Computer Science 2024-02-05 Wenqi Wei , Ling Liu

In machine learning, privacy requirements at inference or deployment time often evolve due to changing policies, regulations, or user preferences. In this work, we aim to construct a magnitude of models to satisfy any target differential…

Machine Learning · Computer Science 2026-05-21 Qichuan Yin , Manzil Zaheer , Tian Li

Differential privacy is a mathematical framework for developing statistical computations with provable guarantees of privacy and accuracy. In contrast to the privacy component of differential privacy, which has a clear mathematical and…

Cryptography and Security · Computer Science 2020-11-13 Gilles Barthe , Rohit Chadha , Paul Krogmeier , A. Prasad Sistla , Mahesh Viswanathan

In this work, we study the trade-off between differential privacy and adversarial robustness under L2-perturbations in the context of learning halfspaces. We prove nearly tight bounds on the sample complexity of robust private learning of…

Machine Learning · Computer Science 2021-03-29 Badih Ghazi , Ravi Kumar , Pasin Manurangsi , Thao Nguyen

We consider three different variants of differential privacy (DP), namely approximate DP, R\'enyi DP (RDP), and hypothesis test DP. In the first part, we develop a machinery for optimally relating approximate DP to RDP based on the joint…

Information Theory · Computer Science 2021-01-26 Shahab Asoodeh , Jiachun Liao , Flavio P. Calmon , Oliver Kosut , Lalitha Sankar

In the last a few decades, deep neural networks have achieved remarkable success in machine learning, computer vision, and pattern recognition. Recent studies however show that neural networks (both shallow and deep) may be easily fooled by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhuang Qian , Kaizhu Huang , Qiu-Feng Wang , Xu-Yao Zhang