English
Related papers

Related papers: Federated Foundation Models on Heterogeneous Time …

200 papers

Spectral clustering has emerged as one of the most effective clustering algorithms due to its superior performance. However, most existing models are designed for centralized settings, rendering them inapplicable in modern decentralized…

Machine Learning · Computer Science 2026-04-17 Suyan Dai , Gan Sun , Fazeng Li , Xu Tang , Qianqian Wang , Yang Cong

Federated learning is a distributed learning paradigm in which multiple mobile clients train a global model while keeping data local. These mobile clients can have various available memory and network bandwidth. However, to achieve the best…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-16 Dixi Yao

To tackle the global climate challenge, it urgently needs to develop a collaborative platform for comprehensive weather forecasting on large-scale meteorological data. Despite urgency, heterogeneous meteorological sensors across countries…

Machine Learning · Computer Science 2023-05-30 Shengchao Chen , Guodong Long , Tao Shen , Jing Jiang

Federated learning learns from scattered data by fusing collaborative models from local nodes. However, due to chaotic information distribution, the model fusion may suffer from structural misalignment with regard to unmatched parameters.…

Machine Learning · Computer Science 2022-03-22 Fuxun Yu , Weishan Zhang , Zhuwei Qin , Zirui Xu , Di Wang , Chenchen Liu , Zhi Tian , Xiang Chen

In recent advancements in machine learning, federated learning allows a network of distributed clients to collaboratively develop a global model without needing to share their local data. This technique aims to safeguard privacy, countering…

Machine Learning · Computer Science 2024-07-18 Davide Domini , Gianluca Aguzzi , Nicolas Farabegoli , Mirko Viroli , Lukas Esterle

In medical image segmentation tasks, Domain Generalization (DG) under the Federated Learning (FL) framework is crucial for addressing challenges related to privacy protection and data heterogeneity. However, traditional federated learning…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yucheng Song , Chenxi Li , Haokang Ding , Zhining Liao , Zhifang Liao

Federated Learning (FL) is a prominent framework that enables training a centralized model while securing user privacy by fusing local, decentralized models. In this setting, one major obstacle is data heterogeneity, i.e., each client…

Machine Learning · Computer Science 2022-06-22 Artur Back de Luca , Guojun Zhang , Xi Chen , Yaoliang Yu

In the field of heterogeneous federated learning (FL), the key challenge is to efficiently and collaboratively train models across multiple clients with different data distributions, model structures, task objectives, computational…

Machine Learning · Computer Science 2025-03-11 Chuan Chen , Tianchi Liao , Xiaojun Deng , Zihou Wu , Sheng Huang , Zibin Zheng

Federated learning enables the clients to collaboratively train a global model, which is aggregated from local models. Due to the heterogeneous data distributions over clients and data privacy in federated learning, it is difficult to train…

Machine Learning · Computer Science 2025-05-20 Wujun Zhou , Shu Ding , ZeLin Li , Wei Wang

Heterogeneity across clients in federated learning (FL) usually hinders the optimization convergence and generalization performance when the aggregation of clients' knowledge occurs in the gradient space. For example, clients may differ in…

Machine Learning · Computer Science 2022-03-08 Yue Tan , Guodong Long , Lu Liu , Tianyi Zhou , Qinghua Lu , Jing Jiang , Chengqi Zhang

This paper focuses on addressing the practical yet challenging problem of model heterogeneity in federated learning, where clients possess models with different network structures. To track this problem, we propose a novel framework called…

Machine Learning · Computer Science 2023-10-30 Jiaqi Wang , Xingyi Yang , Suhan Cui , Liwei Che , Lingjuan Lyu , Dongkuan Xu , Fenglong Ma

Data heterogeneity across clients is one of the key challenges in Federated Learning (FL), which may slow down the global model convergence and even weaken global model performance. Most existing approaches tackle the heterogeneity by…

Machine Learning · Computer Science 2023-07-18 Jun Nie , Danyang Xiao , Lei Yang , Weigang Wu

Over the last years, topic modeling has emerged as a powerful technique for organizing and summarizing big collections of documents or searching for particular patterns in them. However, privacy concerns may arise when cross-analyzing data…

Machine Learning · Computer Science 2023-06-13 Lorena Calvo-Bartolomé , Jerónimo Arenas-García

Federated learning (FL) has emerged as a new paradigm for privacy-preserving collaborative training. Under domain skew, the current FL approaches are biased and face two fairness problems. 1) Parameter Update Conflict: data disparity among…

Machine Learning · Computer Science 2024-05-28 Yuhang Chen , Wenke Huang , Mang Ye

Federated Learning is a fast growing area of ML where the training datasets are extremely distributed, all while dynamically changing over time. Models need to be trained on clients' devices without any guarantees for either homogeneity or…

Machine Learning · Computer Science 2021-10-20 Tae Jin Park , Kenichi Kumatani , Dimitrios Dimitriadis

At the intersection of the cutting-edge technologies and privacy concerns, Federated Learning (FL) with its distributed architecture, stands at the forefront in a bid to facilitate collaborative model training across multiple clients while…

Machine Learning · Computer Science 2025-09-03 Noorain Mukhtiar , Adnan Mahmood , Quan Z. Sheng

Federated learning shows promise as a privacy-preserving collaborative learning technique. Existing heterogeneous federated learning mainly focuses on skewing the label distribution across clients. However, most approaches suffer from…

Machine Learning · Computer Science 2023-12-18 Shunxin Guo , Hongsong Wang , Xin Geng

Federated learning (FL) is a distributed learning paradigm that enables multiple clients to learn a powerful global model by aggregating local training. However, the performance of the global model is often hampered by non-i.i.d.…

Machine Learning · Computer Science 2023-08-21 Chun-Mei Feng , Kai Yu , Nian Liu , Xinxing Xu , Salman Khan , Wangmeng Zuo

Federated learning obtains a central model on the server by aggregating models trained locally on clients. As a result, federated learning does not require clients to upload their data to the server, thereby preserving the data privacy of…

Machine Learning · Computer Science 2020-08-31 Yang Chen , Xiaoyan Sun , Yaochu Jin

Federated Learning (FL) suffers from severe performance degradation due to the data heterogeneity among clients. Existing works reveal that the fundamental reason is that data heterogeneity can cause client drift where the local model…

Machine Learning · Computer Science 2025-01-22 Haoran Xu , Jiaze Li , Wanyi Wu , Hao Ren