English
Related papers

Related papers: Compressed-VFL: Communication-Efficient Learning w…

200 papers

In Federated Learning (FL) paradigm, a parameter server (PS) concurrently communicates with distributed participating clients for model collection, update aggregation, and model distribution over multiple rounds, without touching private…

Machine Learning · Computer Science 2024-02-07 Xiaoxin Su , Yipeng Zhou , Laizhong Cui , John C. S. Lui , Jiangchuan Liu

Split learning is a simple solution for Vertical Federated Learning (VFL), which has drawn substantial attention in both research and application due to its simplicity and efficiency. However, communication efficiency is still a crucial…

Machine Learning · Computer Science 2024-01-25 Fei Zheng , Chaochao Chen , Lingjuan Lyu , Binhui Yao

Federated learning can enable remote workers to collaboratively train a shared machine learning model while allowing training data to be kept locally. In the use case of wireless mobile devices, the communication overhead is a critical…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-11 Kai Yue , Richeng Jin , Chau-Wai Wong , Huaiyu Dai

Decentralized federated learning (DFL) is a variant of federated learning, where edge nodes only communicate with their one-hop neighbors to learn the optimal model. However, as information exchange is restricted in a range of one-hop in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-11 Li Chen , Wei Liu , Yunfei Chen , Weidong Wang

With the increasing number and enhanced capabilities of IoT devices in smart buildings, these devices are evolving beyond basic data collection and control to actively participate in deep learning tasks. Federated Learning (FL), as a…

Machine Learning · Computer Science 2025-04-15 Heqiang Wang , Xiang Liu , Yucheng Liu , Jia Zhou , Weihong Yang , Xiaoxiong Zhong

E-health allows smart devices and medical institutions to collaboratively collect patients' data, which is trained by Artificial Intelligence (AI) technologies to help doctors make diagnosis. By allowing multiple devices to train models…

Machine Learning · Computer Science 2024-04-17 Chong Yu , Shuaiqi Shen , Shiqiang Wang , Kuan Zhang , Hai Zhao

Federated Learning (FL) incurs high communication overhead, which can be greatly alleviated by compression for model updates. Yet the tradeoff between compression and model accuracy in the networked environment remains unclear and, for…

Machine Learning · Computer Science 2021-12-14 Laizhong Cui , Xiaoxin Su , Yipeng Zhou , Jiangchuan Liu

Federated learning (FL) is a useful tool in distributed machine learning that utilizes users' local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless environment; however, training models in a…

Machine Learning · Computer Science 2022-05-06 Jake Perazzone , Shiqiang Wang , Mingyue Ji , Kevin Chan

Split federated learning (SFL) is a recent distributed approach for collaborative model training among multiple clients. In SFL, a global model is typically split into two parts, where clients train one part in a parallel federated manner,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-10 Pengchao Han , Chao Huang , Geng Tian , Ming Tang , Xin Liu

Vertical Federated Learning (VFL) attracts increasing attention because it empowers multiple parties to jointly train a privacy-preserving model over vertically partitioned data. Recent research has shown that applying zeroth-order…

Machine Learning · Computer Science 2023-06-30 Ganyu Wang , Qingsong Zhang , Li Xiang , Boyu Wang , Bin Gu , Charles Ling

Decentralized stochastic gradient descent (SGD) is a driving engine for decentralized federated learning (DFL). The performance of decentralized SGD is jointly influenced by inter-node communications and local updates. In this paper, we…

Machine Learning · Computer Science 2022-02-14 Wei Liu , Li Chen , Wenyi Zhang

Federated learning (FL) operates based on model exchanges between the server and the clients, and it suffers from significant client-side computation and communication burden. Split federated learning (SFL) arises a promising solution by…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-23 Yiannis Papageorgiou , Yannis Thomas , Alexios Filippakopoulos , Ramin Khalili , Iordanis Koutsopoulos

Existing Vertical FL (VFL) methods often struggle with realistic and unaligned data partitions, and incur into high communication costs and significant operational complexity. This work introduces a novel approach to VFL, Active Participant…

Machine Learning · Computer Science 2025-02-20 Jon Irureta , Jon Imaz , Aizea Lojo , Javier Fernandez-Marques , Marco González , Iñigo Perona

We propose Flexible Vertical Federated Learning (Flex-VFL), a distributed machine algorithm that trains a smooth, non-convex function in a distributed system with vertically partitioned data. We consider a system with several parties that…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-31 Timothy Castiglia , Shiqiang Wang , Stacy Patterson

Federated Learning allows multiple parties to jointly train a deep learning model on their combined data, without any of the participants having to reveal their local data to a centralized server. This form of privacy-preserving…

Machine Learning · Computer Science 2019-03-08 Felix Sattler , Simon Wiedemann , Klaus-Robert Müller , Wojciech Samek

Federated Learning (FL) has recently received a lot of attention for large-scale privacy-preserving machine learning. However, high communication overheads due to frequent gradient transmissions decelerate FL. To mitigate the communication…

Machine Learning · Computer Science 2021-05-27 Milad Khademi Nori , Sangseok Yun , Il-Min Kim

Federated learning can train models without directly providing local data to the server. However, the frequent updating of the local model brings the problem of large communication overhead. Recently, scholars have achieved the…

Machine Learning · Computer Science 2024-05-07 Ying Zhuansun , Dandan Li , Xiaohong Huang , Caijun Sun

Vertical Federated Learning (VFL) is a privacy-preserving collaborative learning paradigm that enables multiple parties with distinct feature sets to jointly train machine learning models without sharing their raw data. Despite its…

Machine Learning · Computer Science 2025-02-13 Zhaomin Wu , Zhen Qin , Junyi Hou , Haodong Zhao , Qinbin Li , Bingsheng He , Lixin Fan

Distributed learning, particularly Federated Learning (FL), faces a significant bottleneck in the communication cost, particularly the uplink transmission of client-to-server updates, which is often constrained by asymmetric bandwidth…

Machine Learning · Computer Science 2026-02-19 Tomas Ortega , Chun-Yin Huang , Xiaoxiao Li , Hamid Jafarkhani

For distributed learning among collaborative users, this paper develops and analyzes a communication-efficient scheme for federated learning (FL) over the air, which incorporates 1-bit compressive sensing (CS) into analog aggregation…

Machine Learning · Computer Science 2021-03-31 Xin Fan , Yue Wang , Yan Huo , Zhi Tian