English
Related papers

Related papers: Uncovering Gradient Inversion Risks in Practical L…

200 papers

Typical machine learning approaches require centralized data for model training, which may not be possible where restrictions on data sharing are in place due to, for instance, privacy and gradient protection. The recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Hanchi Ren , Jingjing Deng , Xianghua Xie , Xiaoke Ma , Yichuan Wang

Vertical federated learning (vFL) has gained much attention and been deployed to solve machine learning problems with data privacy concerns in recent years. However, some recent work demonstrated that vFL is vulnerable to privacy leakage…

Machine Learning · Computer Science 2022-05-26 Jiankai Sun , Xin Yang , Yuanshun Yao , Chong Wang

Adversarial training was introduced as a way to improve the robustness of deep learning models to adversarial attacks. This training method improves robustness against adversarial attacks, but increases the models vulnerability to privacy…

Federated Learning (FL) is a distributed machine learning paradigm based on protecting data privacy of devices, which however, can still be broken by gradient leakage attack via parameter inversion techniques. Differential privacy (DP)…

Machine Learning · Computer Science 2025-05-27 Pengcheng Sun , Erwu Liu , Wei Ni , Rui Wang , Yuanzhe Geng , Lijuan Lai , Abbas Jamalipour

Federated Averaging remains the most widely used aggregation strategy in federated learning due to its simplicity and scalability. However, its performance degrades significantly in non-IID data settings, where client distributions are…

Machine Learning · Computer Science 2025-03-07 Marco Arazzi , Mert Cihangiroglu , Antonino Nocera

Recent studies have shown that Federated learning (FL) is vulnerable to Gradient Inversion Attacks (GIA), which can recover private training data from shared gradients. However, existing methods are designed for dense, continuous data such…

Machine Learning · Computer Science 2024-12-25 Tianzhe Xiao , Yichen Li , Yining Qi , Haozhao Wang , Ruixuan Li

Private data, being larger and quality-higher than public data, can greatly improve large language models (LLM). However, due to privacy concerns, this data is often dispersed in multiple silos, making its secure utilization for LLM…

Cryptography and Security · Computer Science 2024-12-24 JiaYing Zheng , HaiNan Zhang , LingXiang Wang , WangJie Qiu , HongWei Zheng , ZhiMing Zheng

Gradient-based adversarial training is widely used in improving the robustness of neural networks, while it cannot be easily adapted to natural language processing tasks since the embedding space is discrete. In natural language processing…

Computation and Language · Computer Science 2020-12-07 Linyang Li , Xipeng Qiu

Machine learning models are susceptible to membership inference attacks (MIAs), which aim to infer whether a sample is in the training set. Existing work utilizes gradient ascent to enlarge the loss variance of training data, alleviating…

Machine Learning · Computer Science 2024-06-19 Zhenlong Liu , Lei Feng , Huiping Zhuang , Xiaofeng Cao , Hongxin Wei

Obtaining high-quality data for collaborative training of machine learning models can be a challenging task due to A) regulatory concerns and B) a lack of data owner incentives to participate. The first issue can be addressed through the…

Machine Learning · Computer Science 2024-04-17 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

Federated graph learning (FGL) has recently emerged as a promising privacy-preserving paradigm that enables distributed graph learning across multiple data owners. A critical privacy concern in federated learning is whether an adversary can…

Machine Learning · Computer Science 2026-01-28 Shuyue Wei , Wantong Chen , Tongyu Wei , Chen Gong , Yongxin Tong , Lizhen Cui

Machine learning models are known to memorize private data to reduce their training loss, which can be inadvertently exploited by privacy attacks such as model inversion and membership inference. To protect against these attacks,…

Machine Learning · Computer Science 2023-11-30 Jie Fu , Qingqing Ye , Haibo Hu , Zhili Chen , Lulu Wang , Kuncan Wang , Xun Ran

Federated Learning (FL) is designed to prevent data leakage through collaborative model training without centralized data storage. However, it remains vulnerable to gradient reconstruction attacks that recover original training data from…

Machine Learning · Computer Science 2024-11-07 Yuxiao Chen , Gamze Gürsoy , Qi Lei

With changes in privacy laws, there is often a hard requirement for client data to remain on the device rather than being sent to the server. Therefore, most processing happens on the device, and only an altered element is sent to the…

Cryptography and Security · Computer Science 2022-12-27 Ajinkya K Mulay

While generative models have proved successful in many domains, they may pose a privacy leakage risk in practical deployment. To address this issue, differentially private generative model learning has emerged as a solution to train private…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Bochao Liu , Pengju Wang , Weijia Guo , Yong Li , Liansheng Zhuang , Weiping Wang , Shiming Ge

Federated learning, as a distributed architecture, shows great promise for applications in Cyber-Physical-Social Systems (CPSS). In order to mitigate the privacy risks inherent in CPSS, the integration of differential privacy with federated…

Machine Learning · Computer Science 2025-06-05 Jiayi Wan , Xiang Zhu , Fanzhen Liu , Wei Fan , Xiaolong Xu

Federated learning platforms are gaining popularity. One of the major benefits is to mitigate the privacy risks as the learning of algorithms can be achieved without collecting or sharing data. While federated learning (i.e., many based on…

Machine Learning · Computer Science 2020-09-01 Seok-Ju Hahn , Junghye Lee

The idea of federated learning is to collaboratively train a neural network on a server. Each user receives the current weights of the network and in turns sends parameter updates (gradients) based on local data. This protocol has been…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Jonas Geiping , Hartmut Bauermeister , Hannah Dröge , Michael Moeller

The success of current Large-Language Models (LLMs) hinges on extensive training data that is collected and stored centrally, called Centralized Learning (CL). However, such a collection manner poses a privacy threat, and one potential…

Machine Learning · Computer Science 2025-11-18 Huiwen Wu , Xiaogang Xu , Deyi Zhang , Xiaohan Li , Jiafei Wu , Zhe Liu

The surge in multimodal AI's success has sparked concerns over data privacy in vision-and-language tasks. While CLIP has revolutionized multimodal learning through joint training on images and text, its potential to unintentionally disclose…

Machine Learning · Computer Science 2024-03-04 Alyssa Huang , Peihan Liu , Ryumei Nakada , Linjun Zhang , Wanrong Zhang