English
Related papers

Related papers: Guided Model Merging for Hybrid Data Learning: Lev…

200 papers

Many IoT applications at the network edge demand intelligent decisions in a real-time manner. The edge device alone, however, often cannot achieve real-time edge intelligence due to its constrained computing resources and limited local…

Machine Learning · Computer Science 2020-05-12 Sen Lin , Guang Yang , Junshan Zhang

Federated learning (FL) is an emerging machine learning paradigm that allows to accomplish model training without aggregating data at a central server. Most studies on FL consider a centralized framework, in which a single server is endowed…

Machine Learning · Computer Science 2023-03-22 Bin Wang , Jun Fang , Hongbin Li , Xiaojun Yuan , Qing Ling

The arrival of Machine Learning (ML) completely changed how we can unlock valuable information from data. Traditional methods, where everything was stored in one place, had big problems with keeping information private, handling large…

Federated continual learning (FCL) has garnered increasing attention for its ability to support distributed computation in environments with evolving data distributions. However, the emergence of new tasks introduces both temporal and…

Machine Learning · Computer Science 2025-09-30 Danni Yang , Zhikang Chen , Sen Cui , Mengyue Yang , Ding Li , Abudukelimu Wuerkaixi , Haoxuan Li , Jinke Ren , Mingming Gong

Much of federated learning (FL) focuses on settings where local dataset statistics remain the same between training and testing. However, this assumption often does not hold in practice due to distribution shifts, motivating the development…

Machine Learning · Computer Science 2026-02-02 Shahryar Zehtabi , Dong-Jun Han , Seyyedali Hosseinalipour , Christopher G. Brinton

Federated learning is promising for its capability to collaboratively train models with multiple clients without accessing their data, but vulnerable when clients' data distributions diverge from each other. This divergence further leads to…

Machine Learning · Computer Science 2022-07-12 Hong-You Chen , Wei-Lun Chao

The rapid advancement of deep learning models often attributes to their ability to leverage massive training data. In contrast, such privilege has not yet fully benefited 3D deep learning, mainly due to the limited availability of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Xiaoyang Wu , Zhuotao Tian , Xin Wen , Bohao Peng , Xihui Liu , Kaicheng Yu , Hengshuang Zhao

Federated learning allows a large number of devices to jointly learn a model without sharing data. In this work, we enable clients with limited computing power to perform action recognition, a computationally heavy task. We first perform…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-27 Pranjal Jain , Shreyas Goenka , Saurabh Bagchi , Biplab Banerjee , Somali Chaterji

Distributed learning techniques such as federated learning have enabled multiple workers to train machine learning models together to reduce the overall training time. However, current distributed training algorithms (centralized or…

Machine Learning · Computer Science 2020-02-25 Zhenheng Tang , Shaohuai Shi , Xiaowen Chu

Federated learning has gained popularity as a means of training models distributed across the wireless edge. The paper introduces delay-aware hierarchical federated learning (DFL) to improve the efficiency of distributed machine learning…

Machine Learning · Computer Science 2023-09-29 Frank Po-Chen Lin , Seyyedali Hosseinalipour , Nicolò Michelusi , Christopher Brinton

Federated Learning (FL) has emerged as a prominent privacy-preserving technique for enabling use cases like confidential clinical machine learning. FL operates by aggregating models trained by remote devices which owns the data. Thus, FL…

Machine Learning · Computer Science 2024-04-23 Michael Duchesne , Kaiwen Zhang , Chamseddine Talhi

Distributed learning paradigms, such as federated and decentralized learning, allow for the coordination of models across a collection of agents, and without the need to exchange raw data. Instead, agents compute model updates locally based…

Machine Learning · Computer Science 2022-04-04 Stefan Vlaski , Christian Schroth , Michael Muma , Abdelhak M. Zoubir

Most decentralized optimization algorithms are handcrafted. While endowed with strong theoretical guarantees, these algorithms generally target a broad class of problems, thereby not being adaptive or customized to specific problem…

Optimization and Control · Mathematics 2024-10-03 Yutong He , Qiulin Shang , Xinmeng Huang , Jialin Liu , Kun Yuan

In this work, we explore the limitations of combining models by averaging intermediate features, referred to as model merging, and propose a new direction for achieving collective model intelligence through what we call compatible…

Machine Learning · Computer Science 2024-11-05 Jyothish Pari , Samy Jelassi , Pulkit Agrawal

Data aggregation has been widely implemented as an infrastructure of data-driven systems. However, a centralized data aggregation model requires a set of strong trust assumptions to ensure security and privacy. In recent years,…

Software Engineering · Computer Science 2023-03-22 Yepeng Ding , Hiroyuki Sato , Maro G. Machizawa

Federated Learning is a training framework that enables multiple participants to collaboratively train a shared model while preserving data privacy and minimizing communication overhead. The heterogeneity of devices and networking resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-08 Rahul Mishra , Hari Prabhat Gupta , Garvit Banga

In diverse fields ranging from finance to omics, it is increasingly common that data is distributed and with multiple individual sources (referred to as ``clients'' in some studies). Integrating raw data, although powerful, is often not…

Methodology · Statistics 2022-11-08 Yuanxing Chen , Qingzhao Zhang , Shuangge Ma , Kuangnan Fang

Federated learning enables machine learning models to learn from private decentralized data without compromising privacy. The standard formulation of federated learning produces one shared model for all clients. Statistical heterogeneity…

Machine Learning · Computer Science 2020-03-20 Viraj Kulkarni , Milind Kulkarni , Aniruddha Pant

Federated learning shows promise as a privacy-preserving collaborative learning technique. Existing heterogeneous federated learning mainly focuses on skewing the label distribution across clients. However, most approaches suffer from…

Machine Learning · Computer Science 2023-12-18 Shunxin Guo , Hongsong Wang , Xin Geng

Federated Learning is a collaborative machine learning framework to train a deep learning model without accessing clients' private data. Previous works assume one central parameter server either at the cloud or at the edge. The cloud server…

Networking and Internet Architecture · Computer Science 2019-11-01 Lumin Liu , Jun Zhang , S. H. Song , Khaled B. Letaief