English
Related papers

Related papers: Dropout is NOT All You Need to Prevent Gradient Le…

200 papers

An important problem in deep learning is the privacy and security of neural networks (NNs). Both aspects have long been considered separately. To date, it is still poorly understood how privacy enhancing training affects the robustness of…

Cryptography and Security · Computer Science 2021-05-18 Franziska Boenisch , Philip Sperl , Konstantin Böttinger

Dropout is a very effective way of regularizing neural networks. Stochastically "dropping out" units with a certain probability discourages over-specific co-adaptations of feature detectors, preventing overfitting and improving network…

Neural and Evolutionary Computing · Computer Science 2017-08-04 Pietro Morerio , Jacopo Cavazza , Riccardo Volpi , Rene Vidal , Vittorio Murino

Federated learning enables isolated clients to train a shared model collaboratively by aggregating the locally-computed gradient updates. However, privacy information could be leaked from uploaded gradients and be exposed to malicious…

Cryptography and Security · Computer Science 2023-02-28 Dun Zeng , Shiyu Liu , Siqi Liang , Zonghang Li , Hui Wang , Irwin King , Zenglin Xu

Dropout is often used in deep neural networks to prevent over-fitting. Conventionally, dropout training invokes \textit{random drop} of nodes from the hidden layers of a Neural Network. It is our hypothesis that a guided selection of nodes…

Machine Learning · Computer Science 2018-12-11 Rohit Keshari , Richa Singh , Mayank Vatsa

Federated learning (FL) has emerged as a privacy-preserving machine learning approach where multiple parties share gradient information rather than original user data. Recent work has demonstrated that gradient inversion attacks can exploit…

Machine Learning · Computer Science 2024-05-07 Jin Qian , Kaimin Wei , Yongdong Wu , Jilian Zhang , Jipeng Chen , Huan Bao

Backdoor attacks are dangerous and difficult to prevent in federated learning (FL), where training data is sourced from untrusted clients over long periods of time. These difficulties arise because: (a) defenders in FL do not have access to…

Machine Learning · Computer Science 2023-02-01 Shuaiqi Wang , Jonathan Hayase , Giulia Fanti , Sewoong Oh

Federated Learning (FL) enables distributed participants (e.g., mobile devices) to train a global model without sharing data directly to a central server. Recent studies have revealed that FL is vulnerable to gradient inversion attack…

Cryptography and Security · Computer Science 2023-09-15 Jiaheng Wei , Yanjun Zhang , Leo Yu Zhang , Chao Chen , Shirui Pan , Kok-Leong Ong , Jun Zhang , Yang Xiang

Federated learning can be used to train machine learning models on the edge on local data that never leave devices, providing privacy by default. This presents a challenge pertaining to the communication and computation costs associated…

Machine Learning · Computer Science 2021-10-08 Dhruv Guliani , Lillian Zhou , Changwan Ryu , Tien-Ju Yang , Harry Zhang , Yonghui Xiao , Francoise Beaufays , Giovanni Motta

Federated Learning(FL), in theory, preserves privacy of individual clients' data while producing quality machine learning models. However, attacks such as Deep Leakage from Gradients(DLG) severely question the practicality of FL. In this…

Machine Learning · Computer Science 2024-08-19 Joon Kim , Sejin Park

The advance of explainable artificial intelligence, which provides reasons for its predictions, is expected to accelerate the use of deep neural networks in the real world like Machine Learning as a Service (MLaaS) that returns predictions…

Cryptography and Security · Computer Science 2021-07-20 Takayuki Miura , Satoshi Hasegawa , Toshiki Shibahara

Federated Learning (FL) is a distributed learning framework, in which the local data never leaves clients devices to preserve privacy, and the server trains models on the data via accessing only the gradients of those local data. Without…

Machine Learning · Computer Science 2021-10-29 Jinwoo Jeon , Jaechang Kim , Kangwook Lee , Sewoong Oh , Jungseul Ok

Federated Learning (FL) is a decentralized machine learning method that enables participants to collaboratively train a model without sharing their private data. Despite its privacy and scalability benefits, FL is susceptible to backdoor…

Cryptography and Security · Computer Science 2024-09-11 Yujie Zhang , Neil Gong , Michael K. Reiter

Machine learning algorithms are vulnerable to data poisoning attacks. Prior taxonomies that focus on specific scenarios, e.g., indiscriminate or targeted, have enabled defenses for the corresponding subset of known attacks. Yet, this…

Cryptography and Security · Computer Science 2020-03-02 Sanghyun Hong , Varun Chandrasekaran , Yiğitcan Kaya , Tudor Dumitraş , Nicolas Papernot

Deep learning has transformed AI applications but faces critical security challenges, including adversarial attacks, data poisoning, model theft, and privacy leakage. This survey examines these vulnerabilities, detailing their mechanisms…

Backdoor attack is a new AI security risk that has emerged in recent years. Drawing on the previous research of adversarial attack, we argue that the backdoor attack has the potential to tap into the model learning process and improve model…

Cryptography and Security · Computer Science 2022-02-23 Shangxi Wu , Qiuyang He , Yi Zhang , Jitao Sang

Federated learning allows multiple users to collaboratively train a shared classification model while preserving data privacy. This approach, where model updates are aggregated by a central server, was shown to be vulnerable to poisoning…

Machine Learning · Computer Science 2020-12-17 Chien-Lun Chen , Leana Golubchik , Marco Paolieri

Machine unlearning is a newly popularized technique for removing specific training data from a trained model, enabling it to comply with data deletion requests. While it protects the rights of users requesting unlearning, it also introduces…

Machine Learning · Computer Science 2025-12-19 Lulu Xue , Shengshan Hu , Linqiang Qian , Peijin Guo , Yechao Zhang , Minghui Li , Yanjun Zhang , Dayong Ye , Leo Yu Zhang

This paper aims to understand and improve the utility of the dropout operation from the perspective of game-theoretic interactions. We prove that dropout can suppress the strength of interactions between input variables of deep neural…

Machine Learning · Computer Science 2021-03-17 Hao Zhang , Sen Li , Yinchao Ma , Mingjie Li , Yichen Xie , Quanshi Zhang

Although federated learning has increasingly gained attention in terms of effectively utilizing local devices for data privacy enhancement, recent studies show that publicly shared gradients in the training process can reveal the private…

Cryptography and Security · Computer Science 2021-09-22 Jieren Deng , Yijue Wang , Ji Li , Chao Shang , Hang Liu , Sanguthevar Rajasekaran , Caiwen Ding

We introduce Dynamic Dropout, a novel regularization technique designed to enhance the training efficiency of Transformer models by dynamically adjusting the dropout rate based on training epochs or validation loss improvements. This…

Machine Learning · Computer Science 2024-11-06 Hanrui Yan , Dan Shao