English
Related papers

Related papers: Toward Training at ImageNet Scale with Differentia…

200 papers

Traditional differential privacy is independent of the data distribution. However, this is not well-matched with the modern machine learning context, where models are trained on specific data. As a result, achieving meaningful privacy…

Machine Learning · Computer Science 2020-08-21 Aleksei Triastcyn , Boi Faltings

Despite intense interest and considerable effort, the current generation of neural networks suffers a significant loss of accuracy under most practically relevant privacy training regimes. One particularly challenging class of neural…

Machine Learning · Computer Science 2021-06-07 Huanyu Zhang , Ilya Mironov , Meisam Hejazinia

Imbalanced learning occurs in classification settings where the distribution of class-labels is highly skewed in the training data, such as when predicting rare diseases or in fraud detection. This class imbalance presents a significant…

Machine Learning · Computer Science 2024-11-11 Lucas Rosenblatt , Yuliia Lut , Eitan Turok , Marco Avella-Medina , Rachel Cummings

In this paper, we show that the process of continually learning new tasks and memorizing previous tasks introduces unknown privacy risks and challenges to bound the privacy loss. Based upon this, we introduce a formal definition of Lifelong…

Machine Learning · Computer Science 2022-07-27 Phung Lai , Han Hu , NhatHai Phan , Ruoming Jin , My T. Thai , An M. Chen

We demonstrate self-supervised pretraining (SSP) is a scalable solution to deep learning with differential privacy (DP) regardless of the size of available public datasets in image classification. When facing the lack of public datasets, we…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Arash Asadian , Evan Weidner , Lei Jiang

As deep learning-based, data-driven information extraction systems become increasingly integrated into modern document processing workflows, one primary concern is the risk of malicious leakage of sensitive private data from these systems.…

Cryptography and Security · Computer Science 2025-08-07 Saifullah Saifullah , Stefan Agne , Andreas Dengel , Sheraz Ahmed

Machine learning models in health care are often deployed in settings where it is important to protect patient privacy. In such settings, methods for differentially private (DP) learning provide a general-purpose approach to learn models…

Machine Learning · Computer Science 2020-10-15 Vinith M. Suriyakumar , Nicolas Papernot , Anna Goldenberg , Marzyeh Ghassemi

Deep learning models are known to put the privacy of their training data at risk, which poses challenges for their safe and ethical release to the public. Differentially private stochastic gradient descent is the de facto standard for…

Machine Learning · Computer Science 2023-01-03 Morgane Ayle , Jan Schuchardt , Lukas Gosch , Daniel Zügner , Stephan Günnemann

We consider a refinement of differential privacy --- per instance differential privacy (pDP), which captures the privacy of a specific individual with respect to a fixed data set. We show that this is a strict generalization of the standard…

Machine Learning · Statistics 2018-11-15 Yu-Xiang Wang

Training generative models with differential privacy (DP) typically involves injecting noise into gradient updates or adapting the discriminator's training procedure. As a result, such approaches often struggle with hyper-parameter tuning…

Machine Learning · Computer Science 2024-10-29 Kristjan Greenewald , Yuancheng Yu , Hao Wang , Kai Xu

Differential privacy is a strong notion for privacy that can be used to prove formal guarantees, in terms of a privacy budget, $\epsilon$, about how much information is leaked by a mechanism. However, implementations of privacy-preserving…

Machine Learning · Computer Science 2019-08-14 Bargav Jayaraman , David Evans

Motivated by the increasing deployment of reinforcement learning in the real world, involving a large consumption of personal data, we introduce a differentially private (DP) policy gradient algorithm. We show that, in this setting, the…

Machine Learning · Computer Science 2025-02-03 Alexandre Rio , Merwan Barlier , Igor Colin

Differentially private (DP) transfer learning, i.e., fine-tuning a pretrained model on private data, is the current state-of-the-art approach for training large models under privacy constraints. We focus on two key hyperparameters in this…

Machine Learning · Computer Science 2026-04-20 Aki Rehn , Linzh Zhao , Mikko A. Heikkilä , Antti Honkela

Secure multi-party computation-based machine learning, referred to as MPL, has become an important technology to utilize data from multiple parties with privacy preservation. While MPL provides rigorous security guarantees for the…

Cryptography and Security · Computer Science 2022-08-19 Wenqiang Ruan , Mingxin Xu , Wenjing Fang , Li Wang , Lei Wang , Weili Han

We address private deep offline reinforcement learning (RL), where the goal is to train a policy on standard control tasks that is differentially private (DP) with respect to individual trajectories in the dataset. To achieve this, we…

Machine Learning · Computer Science 2024-10-10 Alexandre Rio , Merwan Barlier , Igor Colin , Albert Thomas

Fine-tuning large language models on downstream tasks is crucial for realizing their cross-domain potential but often relies on sensitive data, raising privacy concerns. Differential privacy (DP) offers rigorous privacy guarantees and has…

Machine Learning · Computer Science 2026-01-19 Lele Zheng , Xiang Wang , Tao Zhang , Yang Cao , Ke Cheng , Yulong Shen

Training reliable deep learning models which avoid making overconfident but incorrect predictions is a longstanding challenge. This challenge is further exacerbated when learning has to be differentially private: protection provided to…

Machine Learning · Computer Science 2023-05-31 Stephan Rabanser , Anvith Thudi , Abhradeep Thakurta , Krishnamurthy Dvijotham , Nicolas Papernot

Learning with relational and network-structured data is increasingly vital in sensitive domains where protecting the privacy of individual entities is paramount. Differential Privacy (DP) offers a principled approach for quantifying privacy…

Machine Learning · Computer Science 2026-02-04 Yinan Huang , Haoteng Yin , Eli Chien , Rongzhe Wei , Pan Li

Leveraging parallel hardware (e.g. GPUs) for deep neural network (DNN) training brings high computing performance. However, it raises data privacy concerns as GPUs lack a trusted environment to protect the data. Trusted execution…

Cryptography and Security · Computer Science 2022-06-20 Yue Niu , Ramy E. Ali , Salman Avestimehr

Large language models (LLMs) are increasingly integrated into real-time machine learning applications, where safeguarding user privacy is paramount. Traditional differential privacy mechanisms often struggle to balance privacy and accuracy,…

Cryptography and Security · Computer Science 2024-10-04 Jessica Smith , David Williams , Emily Brown