English
Related papers

Related papers: Modeling Neural Networks with Privacy Using Neural…

200 papers

Learning often involves sensitive data and as such, privacy preserving extensions to Stochastic Gradient Descent (SGD) and other machine learning algorithms have been developed using the definitions of Differential Privacy (DP). In…

Machine Learning · Computer Science 2021-10-14 Friedrich Dörmann , Osvald Frisk , Lars Nørvang Andersen , Christian Fischer Pedersen

Dosing models often use differential equations to model biological dynamics. Neural differential equations in particular can learn to predict the derivative of a process, which permits predictions at irregular points of time. However, this…

Machine Learning · Computer Science 2023-06-27 Stav Belogolovsky , Ido Greenberg , Danny Eytan , Shie Mannor

Introducing noise in the training of machine learning systems is a powerful way to protect individual privacy via differential privacy guarantees, but comes at a cost to utility. This work looks at whether the inherent randomness of…

Machine Learning · Computer Science 2022-03-01 Stephanie L. Hyland , Shruti Tople

Deep learning techniques based on neural networks have shown significant success in a wide range of AI tasks. Large-scale training datasets are one of the critical factors for their success. However, when the training datasets are…

Cryptography and Security · Computer Science 2019-12-23 Lei Yu , Ling Liu , Calton Pu , Mehmet Emre Gursoy , Stacey Truex

In this paper, an adjustment to the original differentially private stochastic gradient descent (DPSGD) algorithm for deep learning models is proposed. As a matter of motivation, to date, almost no state-of-the-art machine learning…

Machine Learning · Computer Science 2021-07-13 Mehdi Amian

Despite intense interest and considerable effort, the current generation of neural networks suffers a significant loss of accuracy under most practically relevant privacy training regimes. One particularly challenging class of neural…

Machine Learning · Computer Science 2021-06-07 Huanyu Zhang , Ilya Mironov , Meisam Hejazinia

Neural ordinary differential equations (NODEs) are an effective approach for data-driven modeling of dynamical systems arising from simulations and experiments. One of the major shortcomings of NODEs, especially when coupled with explicit…

Numerical Analysis · Mathematics 2025-12-30 Allen Alvarez Loya , Daniel A. Serino , J. W. Burby , Qi Tang

Deep Learning has emerged as one of the most significant innovations in machine learning. However, a notable limitation of this field lies in the ``black box" decision-making processes, which have led to skepticism within groups like…

Machine Learning · Computer Science 2025-03-06 Shi Li

Attacks that aim to identify the training data of public neural networks represent a severe threat to the privacy of individuals participating in the training data set. A possible protection is offered by anonymization of the training data…

Cryptography and Security · Computer Science 2020-05-27 Daniel Bernau , Philip-William Grassal , Jonas Robl , Florian Kerschbaum

Deep learning models leak significant amounts of information about their training datasets. Previous work has investigated training models with differential privacy (DP) guarantees through adding DP noise to the gradients. However, such…

Machine Learning · Computer Science 2020-07-23 Milad Nasr , Reza Shokri , Amir houmansadr

Differential privacy (DP) is a prominent method for protecting information about individuals during data analysis. Training neural networks with differentially private stochastic gradient descent (DPSGD) influences the model's learning…

Machine Learning · Computer Science 2025-10-10 Lea Demelius , Dominik Kowald , Simone Kopeinik , Roman Kern , Andreas Trügler

Stochastic differential equations (SDEs) are used to describe a wide variety of complex stochastic dynamical systems. Learning the hidden physics within SDEs is crucial for unraveling fundamental understanding of these systems' stochastic…

Machine Learning · Computer Science 2022-07-26 Jared O'Leary , Joel A. Paulson , Ali Mesbah

We present RHODE, a novel system that enables privacy-preserving training of and prediction on Recurrent Neural Networks (RNNs) in a cross-silo federated learning setting by relying on multiparty homomorphic encryption. RHODE preserves the…

Cryptography and Security · Computer Science 2023-05-04 Sinem Sav , Abdulrahman Diaa , Apostolos Pyrgelis , Jean-Philippe Bossuat , Jean-Pierre Hubaux

Training generative models with differential privacy (DP) typically involves injecting noise into gradient updates or adapting the discriminator's training procedure. As a result, such approaches often struggle with hyper-parameter tuning…

Machine Learning · Computer Science 2024-10-29 Kristjan Greenewald , Yuancheng Yu , Hao Wang , Kai Xu

Training machine learning models based on neural networks requires large datasets, which may contain sensitive information. The models, however, should not expose private information from these datasets. Differentially private SGD [DP-SGD]…

Machine Learning · Computer Science 2024-09-26 Francisco Aguilera-Martínez , Fernando Berzal

In this paper, we aim to develop a scalable algorithm to preserve differential privacy (DP) in adversarial learning for deep neural networks (DNNs), with certified robustness to adversarial examples. By leveraging the sequential composition…

Cryptography and Security · Computer Science 2020-09-16 NhatHai Phan , My T. Thai , Han Hu , Ruoming Jin , Tong Sun , Dejing Dou

Deep learning models have been extensively adopted in various regions due to their ability to represent hierarchical features, which highly rely on the training set and procedures. Thus, protecting the training process and deep learning…

Cryptography and Security · Computer Science 2025-03-12 Haodi Wang , Tangyu Jiang , Yu Guo , Chengjun Cai , Cong Wang , Xiaohua Jia

Models need to be trained with privacy-preserving learning algorithms to prevent leakage of possibly sensitive information contained in their training data. However, canonical algorithms like differentially private stochastic gradient…

Machine Learning · Computer Science 2022-10-06 Yannis Cattan , Christopher A. Choquette-Choo , Nicolas Papernot , Abhradeep Thakurta

We present a comprehensive evaluation of the robustness and explainability of ResNet-like models in the context of Unintended Radiated Emission (URE) classification and suggest a new approach leveraging Neural Stochastic Differential…

Machine Learning · Computer Science 2023-09-28 Sumit Kumar Jha , Susmit Jha , Rickard Ewetz , Alvaro Velasquez

Training reliable deep learning models which avoid making overconfident but incorrect predictions is a longstanding challenge. This challenge is further exacerbated when learning has to be differentially private: protection provided to…

Machine Learning · Computer Science 2023-05-31 Stephan Rabanser , Anvith Thudi , Abhradeep Thakurta , Krishnamurthy Dvijotham , Nicolas Papernot