中文
相关论文

相关论文: Defending Membership Inference Attacks via Privacy…

200 篇论文

As predictive models are increasingly being employed to make consequential decisions, there is a growing emphasis on developing techniques that can provide algorithmic recourse to affected individuals. While such recourses can be immensely…

机器学习 · 计算机科学 2023-04-20 Martin Pawelczyk , Himabindu Lakkaraju , Seth Neel

In federated learning (FL), a machine learning (ML) model is collectively trained by a large number of users, using their private data in their local devices. With top $r$ sparsification in FL, the users only upload the most significant $r$…

信息论 · 计算机科学 2023-03-08 Sajani Vithana , Sennur Ulukus

The usage of deep learning is being escalated in many applications. Due to its outstanding performance, it is being used in a variety of security and privacy-sensitive areas in addition to conventional applications. One of the key aspects…

密码学与安全 · 计算机科学 2022-05-17 Zhaoxi Zhang , Leo Yu Zhang , Xufei Zheng , Bilal Hussain Abbasi , Shengshan Hu

A membership inference attack allows an adversary to query a trained machine learning model to predict whether or not a particular example was contained in the model's training dataset. These attacks are currently evaluated using…

密码学与安全 · 计算机科学 2022-04-13 Nicholas Carlini , Steve Chien , Milad Nasr , Shuang Song , Andreas Terzis , Florian Tramer

This paper studies defense mechanisms against model inversion (MI) attacks -- a type of privacy attacks aimed at inferring information about the training data distribution given the access to a target machine learning model. Existing…

密码学与安全 · 计算机科学 2020-09-23 Tianhao Wang , Yuheng Zhang , Ruoxi Jia

Deep learning models often raise privacy concerns as they leak information about their training data. This enables an adversary to determine whether a data point was in a model's training set by conducting a membership inference attack…

机器学习 · 计算机科学 2020-06-11 Yigitcan Kaya , Sanghyun Hong , Tudor Dumitras

Membership inference (MI) attacks exploit the fact that machine learning algorithms sometimes leak information about their training data through the learned model. In this work, we study membership inference in the white-box setting in…

机器学习 · 计算机科学 2020-06-26 Klas Leino , Matt Fredrikson

Model sparsification in deep learning promotes simpler, more interpretable models with fewer parameters. This not only reduces the model's memory footprint and computational needs but also shortens inference time. This work focuses on…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

Local differential privacy (LDP) has become a central topic in data privacy research, offering strong privacy guarantees by perturbing user data at the source and removing the need for a trusted curator. However, the noise introduced by LDP…

机器学习 · 计算机科学 2026-03-04 Caihong Qin , Yang Bai

Current adversarial robustness methods for large language models require extensive datasets of harmful prompts (thousands to hundreds of thousands of examples), yet remain vulnerable to novel attack vectors and distributional shifts. We…

人工智能 · 计算机科学 2026-05-12 Linh Le , David Williams-King , Mohamed Amine Merzouk , Aton Kamanda , Adam Oberman

The discontinuous operations inherent in quantization and sparsification introduce a long-standing obstacle to backpropagation, particularly in ultra-low precision and sparse regimes. While the community has long viewed quantization as…

机器学习 · 计算机科学 2026-03-11 Chengxi Ye , Grace Chu , Yanfeng Liu , Yichi Zhang , Lukasz Lew , Li Zhang , Mark Sandler , Andrew Howard

Deep ensemble learning has been shown to improve accuracy by training multiple neural networks and averaging their outputs. Ensemble learning has also been suggested to defend against membership inference attacks that undermine privacy. In…

机器学习 · 计算机科学 2023-05-26 Shahbaz Rezaei , Zubair Shafiq , Xin Liu

Ensuring the privacy of research participants is vital, even more so in healthcare environments. Deep learning approaches to neuroimaging require large datasets, and this often necessitates sharing data between multiple sites, which is…

定量方法 · 定量生物学 2021-06-04 Umang Gupta , Dimitris Stripelis , Pradeep K. Lam , Paul M. Thompson , José Luis Ambite , Greg Ver Steeg

Differential privacy is known to protect against threats to validity incurred due to adaptive, or exploratory, data analysis -- even when the analyst adversarially searches for a statistical estimate that diverges from the true value of the…

密码学与安全 · 计算机科学 2022-07-25 Elbert Du , Cynthia Dwork

Deep models trained on large amounts of data often incorporate implicit biases present during training time. If later such a bias is discovered during inference or deployment, it is often necessary to acquire new data and retrain the model.…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Niklas Penzel , Gideon Stein , Joachim Denzler

We study statistical risk minimization problems under a privacy model in which the data is kept confidential even from the learner. In this local privacy framework, we establish sharp upper and lower bounds on the convergence rates of…

机器学习 · 统计学 2013-10-11 John C. Duchi , Michael I. Jordan , Martin J. Wainwright

Fine-tuning large language models (LLMs) for specific tasks introduces privacy risks, as models may inadvertently memorise and leak sensitive training data. While Differential Privacy (DP) offers a solution to mitigate these risks, it…

机器学习 · 计算机科学 2024-11-26 Olivia Ma , Jonathan Passerat-Palmbach , Dmitrii Usynin

Membership inference attacks are used as a key tool for disclosure auditing. They aim to infer whether an individual record was used to train a model. While such evaluations are useful to demonstrate risk, they are computationally expensive…

机器学习 · 计算机科学 2024-12-20 Anshuman Suri , Xiao Zhang , David Evans

Recent studies have shown that skeletonization (pruning parameters) of networks \textit{at initialization} provides all the practical benefits of sparsity both at inference and training time, while only marginally degrading their…

计算机视觉与模式识别 · 计算机科学 2021-03-22 Pau de Jorge , Amartya Sanyal , Harkirat S. Behl , Philip H. S. Torr , Gregory Rogez , Puneet K. Dokania

Recently, recommender systems have achieved promising performances and become one of the most widely used web applications. However, recommender systems are often trained on highly sensitive user data, thus potential data leakage from…

密码学与安全 · 计算机科学 2021-09-17 Minxing Zhang , Zhaochun Ren , Zihan Wang , Pengjie Ren , Zhumin Chen , Pengfei Hu , Yang Zhang