English
Related papers

Related papers: R-CONV: An Analytical Approach for Efficient Data …

200 papers

Federated learning has quickly gained popularity with its promises of increased user privacy and efficiency. Previous works have shown that federated gradient updates contain information that can be used to approximately recover user data…

Machine Learning · Computer Science 2022-03-21 Liam Fowl , Jonas Geiping , Wojtek Czaja , Micah Goldblum , Tom Goldstein

As the scale and size of the data increases significantly nowadays, federal learning (Bonawitz et al. [2019]) for high performance computing and machine learning has been much more important than ever before (Abadi et al. [2016]). People…

Machine Learning · Computer Science 2022-11-16 Yanchong Zheng

We show through theory and experiment that gradient-based explanations of a model quickly reveal the model itself. Our results speak to a tension between the desire to keep a proprietary model secret and the ability to offer model…

Machine Learning · Statistics 2018-07-16 Smitha Milli , Ludwig Schmidt , Anca D. Dragan , Moritz Hardt

Federated Learning (FL) has emerged as a machine learning approach able to preserve the privacy of user's data. Applying FL, clients train machine learning models on a local dataset and a central server aggregates the learned parameters…

Cryptography and Security · Computer Science 2024-09-27 Luiz Leite , Yuri Santo , Bruno L. Dalmazo , André Riker

While prior work has shown that Federated Learning updates can leak sensitive information, label reconstruction attacks, which aim to recover input labels from shared gradients, have not yet been examined in the context of Human Activity…

Machine Learning · Computer Science 2025-08-08 Marius Bock , Maximilian Hopp , Kristof Van Laerhoven , Michael Moeller

Federated learning claims to enable collaborative model training among multiple clients with data privacy by transmitting gradient updates instead of the actual client data. However, recent studies have shown the client privacy is still at…

Machine Learning · Computer Science 2025-03-04 Maria Drencheva , Ivo Petrov , Maximilian Baader , Dimitar I. Dimitrov , Martin Vechev

Exchanging gradients is a widely used method in modern multi-node machine learning system (e.g., distributed training, collaborative learning). For a long time, people believed that gradients are safe to share: i.e., the training data will…

Machine Learning · Computer Science 2019-12-20 Ligeng Zhu , Zhijian Liu , Song Han

Federated Learning is a machine learning setting that reduces direct data exposure, improving the privacy guarantees of machine learning models. Yet, the exchange of model updates between the participants and the aggregator can still leak…

Machine Learning · Computer Science 2025-12-18 Pablo Montaña-Fernández , Ines Ortega-Fernandez

Although federated learning has increasingly gained attention in terms of effectively utilizing local devices for data privacy enhancement, recent studies show that publicly shared gradients in the training process can reveal the private…

Cryptography and Security · Computer Science 2021-09-22 Jieren Deng , Yijue Wang , Ji Li , Chao Shang , Hang Liu , Sanguthevar Rajasekaran , Caiwen Ding

Distributed learning paradigms such as federated learning often involve transmission of model updates, or gradients, over a network, thereby avoiding transmission of private data. However, it is possible for sensitive information about the…

Machine Learning · Computer Science 2021-11-02 Trung Dang , Om Thakkar , Swaroop Ramaswamy , Rajiv Mathews , Peter Chin , Françoise Beaufays

Gradient inversion attacks are often presented as a serious privacy threat in federated learning, with recent work reporting increasingly strong reconstructions under favorable experimental settings. However, it remains unclear whether such…

Cryptography and Security · Computer Science 2026-02-10 Viktor Valadi , Mattias Åkesson , Johan Östman , Fazeleh Hoseini , Salman Toor , Andreas Hellander

We study the problem of learning one-hidden-layer neural networks with Rectified Linear Unit (ReLU) activation function, where the inputs are sampled from standard Gaussian distribution and the outputs are generated from a noisy teacher…

Machine Learning · Statistics 2018-06-21 Xiao Zhang , Yaodong Yu , Lingxiao Wang , Quanquan Gu

How can local-search methods such as stochastic gradient descent (SGD) avoid bad local minima in training multi-layer neural networks? Why can they fit random labels even given non-convex and non-smooth architectures? Most existing theory…

Machine Learning · Computer Science 2019-05-28 Zeyuan Allen-Zhu , Yuanzhi Li , Zhao Song

With the growing emphasis on users' privacy, federated learning has become more and more popular. Many architectures have been raised for a better security. Most architecture work on the assumption that data's gradient could not leak…

Cryptography and Security · Computer Science 2020-03-12 Zhaorui Li , Zhicong Huang , Chaochao Chen , Cheng Hong

Collaborative machine learning settings like federated learning can be susceptible to adversarial interference and attacks. One class of such attacks is termed model inversion attacks, characterised by the adversary reverse-engineering the…

Machine Learning · Computer Science 2022-03-02 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

The idea of federated learning is to train deep neural network models collaboratively and share them with multiple participants without exposing their private training data to each other. This is highly attractive in the medical domain due…

Image and Video Processing · Electrical Eng. & Systems 2022-05-02 Mads Emil Dahlgaard , Morten Wehlast Jørgensen , Niels Asp Fuglsang , Hiba Nassar

The growing concern over data privacy, the benefits of utilizing data from diverse sources for model training, and the proliferation of networked devices with enhanced computational capabilities have all contributed to the rise of federated…

Machine Learning · Computer Science 2024-12-18 Rui Zhang , Ka-Ho Chow , Ping Li

It is widely believed that sharing gradients will not leak private training data in distributed learning systems such as Collaborative Learning and Federated Learning, etc. Recently, Zhu et al. presented an approach which shows the…

Machine Learning · Computer Science 2020-01-09 Bo Zhao , Konda Reddy Mopuri , Hakan Bilen

Federated learning (FL) is an emerging collaborative learning paradigm that aims to protect data privacy. Unfortunately, recent works show FL algorithms are vulnerable to the serious data reconstruction attacks. However, existing works lack…

Cryptography and Security · Computer Science 2024-08-23 Zifan Wang , Binghui Zhang , Meng Pang , Yuan Hong , Binghui Wang

The Deep Leakage from Gradient (DLG) attack has emerged as a prevalent and highly effective method for extracting sensitive training data by inspecting exchanged gradients. This approach poses a substantial threat to the privacy of…

Machine Learning · Computer Science 2023-11-27 Chenyang Li , Zhao Song , Weixin Wang , Chiwun Yang