English
Related papers

Related papers: Tempered Sigmoid Activations for Deep Learning wit…

200 papers

Neural networks have shown tremendous growth in recent years to solve numerous problems. Various types of neural networks have been introduced to deal with different types of problems. However, the main goal of any neural network is to…

Machine Learning · Computer Science 2022-06-29 Shiv Ram Dubey , Satish Kumar Singh , Bidyut Baran Chaudhuri

Massive data exist among user local platforms that usually cannot support deep neural network (DNN) training due to computation and storage resource constraints. Cloud-based training schemes provide beneficial services but suffer from…

Machine Learning · Computer Science 2018-01-15 Meng Li , Liangzhen Lai , Naveen Suda , Vikas Chandra , David Z. Pan

Collaborative learning has gained great popularity due to its benefit of data privacy protection: participants can jointly train a Deep Learning model without sharing their training sets. However, recent works discovered that an adversary…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Wei Gao , Shangwei Guo , Tianwei Zhang , Han Qiu , Yonggang Wen , Yang Liu

Motivated by problems arising in digital advertising, we introduce the task of training differentially private (DP) machine learning models with semi-sensitive features. In this setting, a subset of the features is known to the attacker…

In recent years, formal methods of privacy protection such as differential privacy (DP), capable of deployment to data-driven tasks such as machine learning (ML), have emerged. Reconciling large-scale ML with the closed-form reasoning…

While Federated Learning (FL) mitigates direct data exposure, the resulting trained models remain susceptible to membership inference attacks (MIAs). This paper presents an empirical evaluation of Differential Privacy (DP) as a defense…

Cryptography and Security · Computer Science 2026-04-16 Gustavo de Carvalho Bertoli

A model of associative memory is studied, which stores and reliably retrieves many more patterns than the number of neurons in the network. We propose a simple duality between this dense associative memory and neural networks commonly used…

Neural and Evolutionary Computing · Computer Science 2017-03-28 Dmitry Krotov , John J Hopfield

We systematically investigate the preservation of differential privacy in functional data analysis, beginning with functional mean estimation and extending to varying coefficient model estimation. Our work introduces a distributed learning…

Statistics Theory · Mathematics 2026-02-11 Gengyu Xue , Zhenhua Lin , Yi Yu

Deep learning has shown incredible potential across a wide array of tasks, and accompanied by this growth has been an insatiable appetite for data. However, a large amount of data needed for enabling deep learning is stored on personal…

Federated learning (FL) has become an emerging machine learning technique lately due to its efficacy in safeguarding the client's confidential information. Nevertheless, despite the inherent and additional privacy-preserving mechanisms…

Cryptography and Security · Computer Science 2021-09-22 Md Tamjid Hossain , Shafkat Islam , Shahriar Badsha , Haoting Shen

ML models are ubiquitous in real world applications and are a constant focus of research. At the same time, the community has started to realize the importance of protecting the privacy of ML training data. Differential Privacy (DP) has…

Nowadays, Deep Neural Networks are widely applied to various domains. However, massive data collection required for deep neural network reveals the potential privacy issues and also consumes large mounts of communication bandwidth. To…

Cryptography and Security · Computer Science 2021-03-05 Sheng Lin , Chenghong Wang , Hongjia Li , Jieren Deng , Yanzhi Wang , Caiwen Ding

The combination of deep neural networks and Differential Privacy has been of increasing interest in recent years, as it offers important data protection guarantees to the individuals of the training datasets used. However, using…

Machine Learning · Computer Science 2021-06-03 Osvald Frisk , Friedrich Dörmann , Christian Marius Lillelund , Christian Fischer Pedersen

Federated Learning (FL) is increasingly adopted as a decentralized machine learning paradigm due to its capability to preserve data privacy by training models without centralizing user data. However, FL is susceptible to indirect privacy…

Machine Learning · Computer Science 2025-06-05 Md Nahid Hasan Shuvo , Moinul Hossain

We present new mechanisms for \emph{label differential privacy}, a relaxation of differentially private machine learning that only protects the privacy of the labels in the training set. Our mechanisms cluster the examples in the training…

Machine Learning · Computer Science 2021-10-06 Hossein Esfandiari , Vahab Mirrokni , Umar Syed , Sergei Vassilvitskii

We explore the training of generative adversarial networks with differential privacy to anonymize image data sets. On MNIST, we numerically measure the privacy-utility trade-off using parameters from $\epsilon$-$\delta$ differential privacy…

Machine Learning · Computer Science 2020-05-07 Justus T. C. Schwabedal , Pascal Michel , Mario S. Riontino

Federated Learning (FL) represents a significant advancement in distributed machine learning, enabling multiple participants to collaboratively train models without sharing raw data. This decentralized approach enhances privacy by keeping…

Cryptography and Security · Computer Science 2025-02-10 Jaydip Sen , Hetvi Waghela , Sneha Rakshit

A successful machine learning (ML) algorithm often relies on a large amount of high-quality data to train well-performed models. Supervised learning approaches, such as deep learning techniques, generate high-quality ML functions for…

Machine Learning · Computer Science 2022-11-15 Thilina Ranbaduge , Ming Ding

Protecting the privacy of people whose data is used by machine learning algorithms is important. Differential Privacy is the appropriate mathematical framework for formal guarantees of privacy, and boosted decision trees are a popular…

Machine Learning · Computer Science 2022-02-01 Vahid R. Asadi , Marco L. Carmosino , Mohammadmahdi Jahanara , Akbar Rafiey , Bahar Salamatian

Differential Privacy can provide provable privacy guarantees for training data in machine learning. However, the presence of proofs does not preclude the presence of errors. Inspired by recent advances in auditing which have been used for…

Machine Learning · Computer Science 2022-03-29 Florian Tramer , Andreas Terzis , Thomas Steinke , Shuang Song , Matthew Jagielski , Nicholas Carlini