English
Related papers

Related papers: Deep Learning with Differential Privacy

200 papers

We consider training machine learning models using Training data located on multiple private and geographically-scattered servers with different privacy settings. Due to the distributed nature of the data, communicating with all…

Machine Learning · Computer Science 2020-06-30 Farhad Farokhi , Nan Wu , David Smith , Mohamed Ali Kaafar

The rise of connected personal devices together with privacy concerns call for machine learning algorithms capable of leveraging the data of a large number of agents to learn personalized models under strong privacy requirements. In this…

Machine Learning · Computer Science 2018-02-20 Aurélien Bellet , Rachid Guerraoui , Mahsa Taziki , Marc Tommasi

Continual data collection and widespread deployment of machine learning algorithms, particularly the distributed variants, have raised new privacy challenges. In a distributed machine learning scenario, the dataset is stored among several…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-16 Shripad Gade , Nitin H. Vaidya

The performance of differentially private machine learning can be boosted significantly by leveraging the transfer learning capabilities of non-private models pretrained on large public datasets. We critically review this approach. We…

Machine Learning · Computer Science 2024-07-18 Florian Tramèr , Gautam Kamath , Nicholas Carlini

The use of Deep Neural Network based systems in the real world is growing. They have achieved state-of-the-art performance on many image, speech and text datasets. They have been shown to be powerful systems that are capable of learning…

Machine Learning · Computer Science 2026-04-21 Alizishaan Anwar Hussein Khatri

Federated Learning allows distributed entities to train a common model collaboratively without sharing their own data. Although it prevents data collection and aggregation by exchanging only parameter updates, it remains vulnerable to…

Machine Learning · Computer Science 2020-11-12 Raouf Kerkouche , Gergely Ács , Claude Castelluccia , Pierre Genevès

The ever-growing advances of deep learning in many areas including vision, recommendation systems, natural language processing, etc., have led to the adoption of Deep Neural Networks (DNNs) in production systems. The availability of large…

We study private prediction where differential privacy is achieved by adding noise to the outputs of a non-private model. Existing methods rely on noise proportional to the global sensitivity of the model, often resulting in sub-optimal…

While modern machine learning models rely on increasingly large training datasets, data is often limited in privacy-sensitive domains. Generative models trained with differential privacy (DP) on sensitive data can sidestep this challenge,…

Machine Learning · Statistics 2024-01-02 Tim Dockhorn , Tianshi Cao , Arash Vahdat , Karsten Kreis

Recent developments in deep learning have led to great success in various natural language processing (NLP) tasks. However, these applications may involve data that contain sensitive information. Therefore, how to achieve good performance…

Computation and Language · Computer Science 2023-10-24 Lijie Hu , Ivan Habernal , Lei Shen , Di Wang

Federated learning has emerged as a powerful framework for analysing distributed data, yet two challenges remain pivotal: heterogeneity across sites and privacy of local data. In this paper, we address both challenges within a federated…

Machine Learning · Computer Science 2026-04-07 Mengchu Li , Ye Tian , Yang Feng , Yi Yu

Machine learning models benefit from large and diverse datasets. Using such datasets, however, often requires trusting a centralized data aggregator. For sensitive applications like healthcare and finance this is undesirable as it could…

Machine Learning · Computer Science 2018-07-19 Nick Hynes , Raymond Cheng , Dawn Song

With the advent of the era of big data, deep learning has become a prevalent building block in a variety of machine learning or data mining tasks, such as signal processing, network modeling and traffic analysis, to name a few. The massive…

Cryptography and Security · Computer Science 2019-12-20 Zhiying Xu , Shuyu Shi , Alex X. Liu , Jun Zhao , Lin Chen

In statistical disclosure control, the goal of data analysis is twofold: The released information must provide accurate and useful statistics about the underlying population of interest, while minimizing the potential for an individual…

Methodology · Statistics 2016-07-15 Jing Lei , Anne-Sophie Charest , Aleksandra Slavkovic , Adam Smith , Stephen Fienberg

Differential Privacy can provide provable privacy guarantees for training data in machine learning. However, the presence of proofs does not preclude the presence of errors. Inspired by recent advances in auditing which have been used for…

Machine Learning · Computer Science 2022-03-29 Florian Tramer , Andreas Terzis , Thomas Steinke , Shuang Song , Matthew Jagielski , Nicholas Carlini

Many machine learning applications are based on data collected from people, such as their tastes and behaviour as well as biological traits and genetic data. Regardless of how important the application might be, one has to make sure…

Machine Learning · Statistics 2017-04-11 Joonas Jälkö , Onur Dikmen , Antti Honkela

The process of data mining with differential privacy produces results that are affected by two types of noise: sampling noise due to data collection and privacy noise that is designed to prevent the reconstruction of sensitive information.…

Machine Learning · Computer Science 2018-04-12 Yue Wang , Daniel Kifer , Jaewoo Lee

Privacy-preserving deep learning is crucial for deploying deep neural network based solutions, especially when the model works on data that contains sensitive information. Most privacy-preserving methods lead to undesirable performance…

Cryptography and Security · Computer Science 2019-09-19 Lichao Sun , Yingbo Zhou , Ji Wang , Jia Li , Richard Sochar , Philip S. Yu , Caiming Xiong

A critical concern in data-driven decision making is to build models whose outcomes do not discriminate against some demographic groups, including gender, ethnicity, or age. To ensure non-discrimination in learning tasks, knowledge of the…

Machine Learning · Computer Science 2020-09-29 Cuong Tran , Ferdinando Fioretto , Pascal Van Hentenryck

Attacks that aim to identify the training data of public neural networks represent a severe threat to the privacy of individuals participating in the training data set. A possible protection is offered by anonymization of the training data…

Cryptography and Security · Computer Science 2020-05-27 Daniel Bernau , Philip-William Grassal , Jonas Robl , Florian Kerschbaum