English
Related papers

Related papers: Seeing the Forest through the Trees: Data Leakage …

200 papers

Federated Learning (FL) is a distributed learning framework, in which the local data never leaves clients devices to preserve privacy, and the server trains models on the data via accessing only the gradients of those local data. Without…

Machine Learning · Computer Science 2021-10-29 Jinwoo Jeon , Jaechang Kim , Kangwook Lee , Sewoong Oh , Jungseul Ok

As a booming research area in the past decade, deep learning technologies have been driven by big data collected and processed on an unprecedented scale. However, privacy concerns arise due to the potential leakage of sensitive information…

Cryptography and Security · Computer Science 2024-02-05 Guangsheng Zhang , Bo Liu , Huan Tian , Tianqing Zhu , Ming Ding , Wanlei Zhou

These days, deep learning models have achieved great success in multiple fields, from autonomous driving to medical diagnosis. These models have expanded the abilities of artificial intelligence by offering great solutions to complex…

Cryptography and Security · Computer Science 2023-11-27 Gopichandh Golla

Gradient inversion attacks on federated learning systems reconstruct client training data from exchanged gradient information. To defend against such attacks, a variety of defense mechanisms were proposed. However, they usually lead to an…

Machine Learning · Computer Science 2022-11-24 Daniel Scheliga , Patrick Mäder , Marco Seeland

In the effort to learn from extensive collections of distributed data, federated learning has emerged as a promising approach for preserving privacy by using a gradient-sharing mechanism instead of exchanging raw data. However, recent…

Machine Learning · Computer Science 2024-12-17 Tamer Ahmed Eltaras , Qutaibah Malluhi , Alessandro Savino , Stefano Di Carlo , Adnan Qayyum , Junaid Qadir

Federated Learning (FL) is a distributed learning paradigm that enhances users privacy by eliminating the need for clients to share raw, private data with the server. Despite the success, recent studies expose the vulnerability of FL to…

Machine Learning · Computer Science 2023-12-15 Jing Wu , Munawar Hayat , Mingyi Zhou , Mehrtash Harandi

This paper studies model-inversion attacks, in which the access to a model is abused to infer information about the training data. Since its first introduction, such attacks have raised serious concerns given that training data usually…

Machine Learning · Computer Science 2020-04-21 Yuheng Zhang , Ruoxi Jia , Hengzhi Pei , Wenxiao Wang , Bo Li , Dawn Song

A large body of work shows that machine learning (ML) models can leak sensitive or confidential information about their training data. Recently, leakage due to distribution inference (or property inference) attacks is gaining attention. In…

Cryptography and Security · Computer Science 2022-09-20 Valentin Hartmann , Léo Meynent , Maxime Peyrard , Dimitrios Dimitriadis , Shruti Tople , Robert West

Federated learning has been proposed as a privacy-preserving machine learning framework that enables multiple clients to collaborate without sharing raw data. However, client privacy protection is not guaranteed by design in this framework.…

Cryptography and Security · Computer Science 2022-10-17 Kai Yue , Richeng Jin , Chau-Wai Wong , Dror Baron , Huaiyu Dai

The memorization of training data by neural networks raises pressing concerns for privacy and security. Recent work has shown that, under certain conditions, portions of the training set can be reconstructed directly from model parameters.…

Machine Learning · Computer Science 2025-09-26 Yehonatan Refael , Guy Smorodinsky , Ofir Lindenbaum , Itay Safran

Machine learning models have been shown to leak information violating the privacy of their training set. We focus on membership inference attacks on machine learning models which aim to determine whether a data point was used to train the…

Cryptography and Security · Computer Science 2020-09-02 Shadi Rahimian , Tribhuvanesh Orekondy , Mario Fritz

Privacy-Preserving machine learning (PPML) can help us train and deploy models that utilize private information. In particular, on-device machine learning allows us to avoid sharing raw data with a third-party server during inference.…

Machine Learning · Computer Science 2024-01-23 Xinchi Qiu , Ilias Leontiadis , Luca Melis , Alex Sablayrolles , Pierre Stock

Federated Learning (FL) allows for the training of Machine Learning models in a collaborative manner without the need to share sensitive data. However, it remains vulnerable to Gradient Leakage Attacks (GLAs), which can reveal private…

Machine Learning · Computer Science 2025-10-29 Miguel Fernandez-de-Retana , Unai Zulaika , Rubén Sánchez-Corcuera , Aitor Almeida

Models leak information about their training data. This enables attackers to infer sensitive information about their training sets, notably determine if a data sample was part of the model's training set. The existing works empirically show…

Machine Learning · Statistics 2021-02-18 Sasi Kumar Murakonda , Reza Shokri , George Theodorakopoulos

Federated learning is an established method for training machine learning models without sharing training data. However, recent work has shown that it cannot guarantee data privacy as shared gradients can still leak sensitive information.…

Machine Learning · Computer Science 2022-03-18 Mislav Balunović , Dimitar I. Dimitrov , Robin Staab , Martin Vechev

In the federated learning system, parameter gradients are shared among participants and the central modulator, while the original data never leave their protected source domain. However, the gradient itself might carry enough information…

Cryptography and Security · Computer Science 2021-03-01 Yong Liu , Xinghua Zhu , Jianzong Wang , Jing Xiao

Federated learning is a decentralized learning paradigm introduced to preserve privacy of client data. Despite this, prior work has shown that an attacker at the server can still reconstruct the private training data using only the client…

Cryptography and Security · Computer Science 2024-03-28 Joshua C. Zhao , Ahaan Dabholkar , Atul Sharma , Saurabh Bagchi

Machine learning models often pose a threat to the privacy of individuals whose data is part of the training set. Several recent attacks have been able to infer sensitive information from trained models, including model inversion or…

Machine Learning · Computer Science 2020-06-30 Abigail Goldsteen , Gilad Ezov , Ariel Farkash

We introduce a new class of attacks on machine learning models. We show that an adversary who can poison a training dataset can cause models trained on this dataset to leak significant private details of training points belonging to other…

Cryptography and Security · Computer Science 2022-10-07 Florian Tramèr , Reza Shokri , Ayrton San Joaquin , Hoang Le , Matthew Jagielski , Sanghyun Hong , Nicholas Carlini

Federated Learning (FL) enables collaborative model training while preserving data privacy by keeping raw data locally stored on client devices, preventing access from other clients or the central server. However, recent studies reveal that…

Cryptography and Security · Computer Science 2025-09-26 Ren-Yi Huang , Dumindu Samaraweera , Prashant Shekhar , J. Morris Chang