English
Related papers

Related papers: FedSynth: Gradient Compression via Synthetic Data …

200 papers

Federated representation learning (FRL) aims to learn personalized federated models with effective feature extraction from local data. FRL algorithms that share the majority of the model parameters face significant challenges with huge…

Machine Learning · Computer Science 2024-10-15 Haolin Yu , Guojun Zhang , Pascal Poupart

In classical federated learning, the clients contribute to the overall training by communicating local updates for the underlying model on their private data to a coordinating server. However, updating and communicating the entire model…

Machine Learning · Computer Science 2022-02-18 Jianyu Wang , Hang Qi , Ankit Singh Rawat , Sashank Reddi , Sagar Waghmare , Felix X. Yu , Gauri Joshi

Federated learning (FL) is an emerging paradigm for training deep neural networks (DNNs) in distributed manners. Current FL approaches all suffer from high communication overhead and information leakage. In this work, we present a federated…

Machine Learning · Computer Science 2023-11-10 Guangchen Lan

Federated Learning (FL) is a communication-efficient and privacy-preserving distributed machine learning framework that has gained a significant amount of research attention recently. Despite the different forms of FL algorithms (e.g.,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-16 Jieming Bian , Cong Shen , Jie Xu

Federated learning (FL) aims to train machine learning (ML) models across potentially millions of edge client devices. Yet, training and customizing models for FL clients is notoriously challenging due to the heterogeneity of client data,…

Machine Learning · Computer Science 2024-04-29 Yuxuan Zhu , Jiachen Liu , Mosharaf Chowdhury , Fan Lai

Federated Learning allows multiple parties to jointly train a deep learning model on their combined data, without any of the participants having to reveal their local data to a centralized server. This form of privacy-preserving…

Machine Learning · Computer Science 2019-03-08 Felix Sattler , Simon Wiedemann , Klaus-Robert Müller , Wojciech Samek

As the state-of-the-art machine learning methods in many fields rely on larger datasets, storing datasets and training models on them become significantly more expensive. This paper proposes a training set synthesis technique for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Bo Zhao , Konda Reddy Mopuri , Hakan Bilen

Federated learning (FL) is a privacy-promoting framework that enables potentially large number of clients to collaboratively train machine learning models. In a FL system, a server coordinates the collaboration by collecting and aggregating…

Machine Learning · Computer Science 2023-04-21 Huancheng Chen , Haris Vikalo

While Federated Learning (FL) is gaining popularity for training machine learning models in a decentralized fashion, numerous challenges persist, such as asynchronization, computational expenses, data heterogeneity, and gradient and…

Machine Learning · Computer Science 2025-03-13 Chun-Yin Huang , Ruinan Jin , Can Zhao , Daguang Xu , Xiaoxiao Li

Federated Learning (FL) enables collaborative training without centralizing data, essential for privacy compliance in real-world scenarios involving sensitive visual information. Most FL approaches rely on expensive, iterative deep network…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Alejandro Dopico-Castro , Oscar Fontenla-Romero , Bertha Guijarro-Berdiñas , Amparo Alonso-Betanzos , Iván Pérez Digón

In federated learning (FL), a global model is trained at a Parameter Server (PS) by aggregating model updates obtained from multiple remote learners. Generally, the communication between the remote users and the PS is rate-limited, while…

Machine Learning · Computer Science 2022-06-06 Sadaf Salehkalaibar , Stefano Rini

Federated learning (FL) enables devices in mobile edge computing (MEC) to collaboratively train a shared model without uploading the local data. Gradient compression may be applied to FL to alleviate the communication overheads but current…

Machine Learning · Computer Science 2023-11-01 Peichun Li , Xumin Huang , Miao Pan , Rong Yu

Distributed and federated learning are essential paradigms for training models across decentralized data sources while preserving privacy, yet communication overhead remains a major bottleneck. This dissertation explores strategies to…

Machine Learning · Computer Science 2025-09-11 Kai Yi

Federated learning (FL) aims to train models collaboratively across clients without sharing data for privacy-preserving. However, one major challenge is the data heterogeneity issue, which refers to the biased labeling preferences at…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Huan Wang , Haoran Li , Huaming Chen , Jun Yan , Jiahua Shi , Jun Shen

In Federated Learning (FL) paradigm, a parameter server (PS) concurrently communicates with distributed participating clients for model collection, update aggregation, and model distribution over multiple rounds, without touching private…

Machine Learning · Computer Science 2024-02-07 Xiaoxin Su , Yipeng Zhou , Laizhong Cui , John C. S. Lui , Jiangchuan Liu

Cross-device Federated Learning is an increasingly popular machine learning setting to train a model by leveraging a large population of client devices with high privacy and security guarantees. However, communication efficiency remains a…

Machine Learning · Computer Science 2022-07-27 Karthik Prasad , Sayan Ghosh , Graham Cormode , Ilya Mironov , Ashkan Yousefpour , Pierre Stock

Federated Learning (FL) enables collaborative model training across decentralized clients without sharing private data. However, FL suffers from biased global models due to non-IID and long-tail data distributions. We propose…

Machine Learning · Computer Science 2026-01-08 Jingrui Zhang , Yimeng Xu , Shujie Li , Feng Liang , Haihan Duan , Yanjie Dong , Victor C. M. Leung , Xiping Hu

Federated learning is a method of training models on private data distributed over multiple devices. To keep device data private, the global model is trained by only communicating parameters and updates which poses scalability challenges…

Learning image representations on decentralized data can bring many benefits in cases where data cannot be aggregated across data silos. Softmax cross entropy loss is highly effective and commonly used for learning image representations.…

Machine Learning · Computer Science 2022-03-10 Sagar M. Waghmare , Hang Qi , Huizhong Chen , Mikhail Sirotenko , Tomer Meron

Recently, semi-supervised federated learning (semi-FL) has been proposed to handle the commonly seen real-world scenarios with labeled data on the server and unlabeled data on the clients. However, existing methods face several challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Mingzhao Yang , Shangchao Su , Bin Li , Xiangyang Xue