中文
相关论文

相关论文: Disentangling private classes through regularizati…

200 篇论文

Federated Learning (FL) allows users to share knowledge instead of raw data to train a model with high accuracy. Unfortunately, during the training, users lose control over the knowledge shared, which causes serious data privacy issues. We…

机器学习 · 计算机科学 2024-11-05 ShiMao Xu , Xiaopeng Ke , Xing Su , Shucheng Li , Hao Wu , Sheng Zhong , Fengyuan Xu

Personalized privacy becomes critical in deep learning for Trustworthy AI. While Differentially Private Stochastic Gradient Descent (DP-SGD) is widely used in deep learning methods supporting privacy, it provides the same level of privacy…

机器学习 · 计算机科学 2023-05-25 Geon Heo , Junseok Seo , Steven Euijong Whang

Training of deep models for classification tasks is hindered by local minima problems and vanishing gradients, while unsupervised layer-wise pretraining does not exploit information from class labels. Here, we propose a new regularization…

机器学习 · 计算机科学 2019-11-07 Pavel Sulimov , Elena Sukmanova , Roman Chereshnev , Attila Kertesz-Farkas

Differentially Private Stochastic Gradients Descent (DP-SGD) is a prominent paradigm for preserving privacy in deep learning. It ensures privacy by perturbing gradients with random noise calibrated to their entire norm at each training…

密码学与安全 · 计算机科学 2024-06-06 Yixuan Liu , Li Xiong , Yuhan Liu , Yujie Gu , Ruixuan Liu , Hong Chen

Deep learning models can achieve high inference accuracy by extracting rich knowledge from massive well-annotated data, but may pose the risk of data privacy leakage in practical deployment. In this paper, we present an effective…

机器学习 · 计算机科学 2024-09-20 Bochao Liu , Jianghu Lu , Pengju Wang , Junjie Zhang , Dan Zeng , Zhenxing Qian , Shiming Ge

The privacy leakage of the model about the training data can be bounded in the differential privacy mechanism. However, for meaningful privacy parameters, a differentially private model degrades the utility drastically when the model…

机器学习 · 计算机科学 2021-10-13 Da Yu , Huishuai Zhang , Wei Chen , Tie-Yan Liu

Machine learning models are known to memorize private data to reduce their training loss, which can be inadvertently exploited by privacy attacks such as model inversion and membership inference. To protect against these attacks,…

机器学习 · 计算机科学 2023-11-30 Jie Fu , Qingqing Ye , Haibo Hu , Zhili Chen , Lulu Wang , Kuncan Wang , Xun Ran

Many individuals are concerned about the governance of machine learning systems and the prevention of algorithmic harms. The EU's recent General Data Protection Regulation (GDPR) has been seen as a core tool for achieving better governance…

机器学习 · 计算机科学 2018-10-17 Michael Veale , Reuben Binns , Lilian Edwards

Commercial companies that collect user data on a large scale have been the main beneficiaries of this trend since the success of deep learning techniques is directly proportional to the amount of data available for training. Massive data…

密码学与安全 · 计算机科学 2020-06-30 Saichethan Miriyala Reddy , Saisree Miriyala

Modern deep learning techniques focus on extracting intricate information from data to achieve accurate predictions. However, the training datasets may be crowdsourced and include sensitive information, such as personal contact details,…

机器学习 · 统计学 2026-02-10 Zhongjie Shi , Puyu Wang , Chenyang Zhang , Yuan Cao

Machine learning (ML) models have been shown to leak private information from their training datasets. Differential Privacy (DP), typically implemented through the differential private stochastic gradient descent algorithm (DP-SGD), has…

机器学习 · 计算机科学 2025-02-17 Dariush Wahdany , Matthew Jagielski , Adam Dziedzic , Franziska Boenisch

Models need to be trained with privacy-preserving learning algorithms to prevent leakage of possibly sensitive information contained in their training data. However, canonical algorithms like differentially private stochastic gradient…

机器学习 · 计算机科学 2022-10-06 Yannis Cattan , Christopher A. Choquette-Choo , Nicolas Papernot , Abhradeep Thakurta

Deep learning often requires a large amount of data. In real-world applications, e.g., healthcare applications, the data collected by a single organization (e.g., hospital) is often limited, and the majority of massive and diverse data is…

机器学习 · 计算机科学 2022-02-08 Di Zhuang , Mingchen Li , J. Morris Chang

Many high-stakes applications require machine learning models that protect user privacy and provide well-calibrated, accurate predictions. While Differential Privacy (DP) is the gold standard for protecting user privacy, standard DP…

Privacy is a growing concern in modern deep-learning systems and applications. Differentially private (DP) training prevents the leakage of sensitive information in the collected training data from the trained machine learning models. DP…

机器学习 · 计算机科学 2024-08-28 Xinwei Zhang , Zhiqi Bu , Mingyi Hong , Meisam Razaviyayn

Recent developments in deep learning have led to great success in various natural language processing (NLP) tasks. However, these applications may involve data that contain sensitive information. Therefore, how to achieve good performance…

计算与语言 · 计算机科学 2023-10-24 Lijie Hu , Ivan Habernal , Lei Shen , Di Wang

Privacy-preserving releasing of complex data (e.g., image, text, audio) represents a long-standing challenge for the data mining research community. Due to rich semantics of the data and lack of a priori knowledge about the analysis task,…

密码学与安全 · 计算机科学 2018-03-28 Xinyang Zhang , Shouling Ji , Ting Wang

Deep learning models leak significant amounts of information about their training datasets. Previous work has investigated training models with differential privacy (DP) guarantees through adding DP noise to the gradients. However, such…

机器学习 · 计算机科学 2020-07-23 Milad Nasr , Reza Shokri , Amir houmansadr

The rapid proliferation of image generation models and other artificial intelligence (AI) systems has intensified concerns regarding data privacy and user consent. As the availability of public datasets declines, major technology companies…

Machine learning techniques based on neural networks are achieving remarkable results in a wide variety of domains. Often, the training of models requires large, representative datasets, which may be crowdsourced and contain sensitive…

机器学习 · 统计学 2018-12-21 Martín Abadi , Andy Chu , Ian Goodfellow , H. Brendan McMahan , Ilya Mironov , Kunal Talwar , Li Zhang