中文
相关论文

相关论文: A unified view on differential privacy and robustn…

200 篇论文

Malicious adversaries can attack machine learning models to infer sensitive information or damage the system by launching a series of evasion attacks. Although various work addresses privacy and security concerns, they focus on individual…

机器学习 · 计算机科学 2024-01-22 Janvi Thakkar , Giulio Zizzo , Sergio Maffeis

The widespread adoption of machine learning necessitates robust privacy protection alongside algorithmic resilience. While Local Differential Privacy (LDP) provides foundational guarantees, sophisticated adversaries with prior knowledge…

机器学习 · 计算机科学 2025-07-31 Xiaojin Zhang , Wei Chen

Despite extraordinary progress, current machine learning systems have been shown to be brittle against adversarial examples: seemingly innocuous but carefully crafted perturbations of test examples that cause machine learning predictors to…

机器学习 · 计算机科学 2023-06-14 Omar Montasser

Using a recently proposed privacy definition of R\'enyi Differential Privacy (RDP), we re-examine the inherent privacy of releasing a single sample from a posterior distribution. We exploit the impact of the prior distribution in mitigating…

机器学习 · 计算机科学 2017-10-04 Joseph Geumlek , Shuang Song , Kamalika Chaudhuri

Recent progress in empirical and certified robustness promises to deliver reliable and deployable Deep Neural Networks (DNNs). Despite that success, most existing evaluations of DNN robustness have been done on images sampled from the same…

机器学习 · 计算机科学 2023-11-08 Kumail Alhamoud , Hasan Abed Al Kader Hammoud , Motasem Alfarra , Bernard Ghanem

Robust machine learning formulations have emerged to address the prevalent vulnerability of deep neural networks to adversarial examples. Our work draws the connection between optimal robust learning and the privacy-utility tradeoff…

机器学习 · 计算机科学 2021-05-20 Ye Wang , Shuchin Aeron , Adnan Siraj Rakin , Toshiaki Koike-Akino , Pierre Moulin

Adversarial examples are inevitable on the road of pervasive applications of deep neural networks (DNN). Imperceptible perturbations applied on natural samples can lead DNN-based classifiers to output wrong prediction with fair confidence…

机器学习 · 计算机科学 2020-11-04 Tao Bai , Jinqi Luo , Jun Zhao

Differential privacy is a cryptographically-motivated approach to privacy that has become a very active field of research over the last decade in theoretical computer science and machine learning. In this paradigm one assumes there is a…

机器学习 · 计算机科学 2023-08-02 Marco Avella-Medina

The arms race between attacks and defenses for machine learning models has come to a forefront in recent years, in both the security community and the privacy community. However, one big limitation of previous research is that the security…

机器学习 · 统计学 2019-08-27 Liwei Song , Reza Shokri , Prateek Mittal

A streaming algorithm is said to be adversarially robust if its accuracy guarantees are maintained even when the data stream is chosen maliciously, by an adaptive adversary. We establish a connection between adversarial robustness of…

数据结构与算法 · 计算机科学 2020-04-14 Avinatan Hassidim , Haim Kaplan , Yishay Mansour , Yossi Matias , Uri Stemmer

Adversarial examples that fool machine learning models, particularly deep neural networks, have been a topic of intense research interest, with attacks and defenses being developed in a tight back-and-forth. Most past defenses are best…

机器学习 · 统计学 2019-05-30 Mathias Lecuyer , Vaggelis Atlidakis , Roxana Geambasu , Daniel Hsu , Suman Jana

Obtaining deep networks that are robust against adversarial examples and generalize well is an open problem. A recent hypothesis even states that both robust and accurate models are impossible, i.e., adversarial robustness and…

计算机视觉与模式识别 · 计算机科学 2019-04-11 David Stutz , Matthias Hein , Bernt Schiele

In statistical learning and analysis from shared data, which is increasingly widely adopted in platforms such as federated learning and meta-learning, there are two major concerns: privacy and robustness. Each participating individual…

机器学习 · 计算机科学 2021-11-25 Xiyang Liu , Weihao Kong , Sham Kakade , Sewoong Oh

Differential Privacy (DP) is a family of definitions that bound the worst-case privacy leakage of a mechanism. One important feature of the worst-case DP guarantee is it naturally implies protections against adversaries with less prior…

密码学与安全 · 计算机科学 2025-07-14 Marika Swanberg , Meenatchi Sundaram Muthu Selva Annamalai , Jamie Hayes , Borja Balle , Adam Smith

Emerging Distributed AI systems are revolutionizing big data computing and data processing capabilities with growing economic and societal impact. However, recent studies have identified new attack surfaces and risks caused by security,…

机器学习 · 计算机科学 2024-02-05 Wenqi Wei , Ling Liu

In machine learning, privacy requirements at inference or deployment time often evolve due to changing policies, regulations, or user preferences. In this work, we aim to construct a magnitude of models to satisfy any target differential…

机器学习 · 计算机科学 2026-05-21 Qichuan Yin , Manzil Zaheer , Tian Li

Differential privacy is a mathematical framework for developing statistical computations with provable guarantees of privacy and accuracy. In contrast to the privacy component of differential privacy, which has a clear mathematical and…

密码学与安全 · 计算机科学 2020-11-13 Gilles Barthe , Rohit Chadha , Paul Krogmeier , A. Prasad Sistla , Mahesh Viswanathan

In this work, we study the trade-off between differential privacy and adversarial robustness under L2-perturbations in the context of learning halfspaces. We prove nearly tight bounds on the sample complexity of robust private learning of…

机器学习 · 计算机科学 2021-03-29 Badih Ghazi , Ravi Kumar , Pasin Manurangsi , Thao Nguyen

We consider three different variants of differential privacy (DP), namely approximate DP, R\'enyi DP (RDP), and hypothesis test DP. In the first part, we develop a machinery for optimally relating approximate DP to RDP based on the joint…

信息论 · 计算机科学 2021-01-26 Shahab Asoodeh , Jiachun Liao , Flavio P. Calmon , Oliver Kosut , Lalitha Sankar

In the last a few decades, deep neural networks have achieved remarkable success in machine learning, computer vision, and pattern recognition. Recent studies however show that neural networks (both shallow and deep) may be easily fooled by…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Zhuang Qian , Kaizhu Huang , Qiu-Feng Wang , Xu-Yao Zhang