English
Related papers

Related papers: Collaborating Heterogeneous Natural Language Proce…

200 papers

Federated learning (FL) addresses data privacy concerns by enabling collaborative training of AI models across distributed data owners. Wide adoption of FL faces the fundamental challenges of data heterogeneity and the large scale of data…

Machine Learning · Computer Science 2023-08-23 Yulan Gao , Zhaoxiang Hou , Chengyi Yang , Zengxiang Li , Han Yu

Federated Learning (FL) with pre-trained Vision-Language Models (VLMs) has emerged as a promising paradigm for various downstream tasks. By leveraging its strong representations, recent studies improve task adaptation under insufficient…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yuting Ma , Lechao Cheng , Xiaohua Xu

Federated Learning (FL) enables collaborative intelligence across decentralized data source devices in a privacy-preserving way. While substantial research attention has been drawn to optimizing the learning process for an individual task,…

Machine Learning · Computer Science 2026-05-04 Md Sirajul Islam , Isabelle G Chapman , N I Md Ashafuddula , Xu Yuan , Li Chen , Nian-Feng Tzeng , Klara Nahrstedt

The standard class-incremental continual learning setting assumes a set of tasks seen one after the other in a fixed and predefined order. This is not very realistic in federated learning environments where each client works independently…

Machine Learning · Computer Science 2023-04-10 Donald Shenaj , Marco Toldo , Alberto Rigon , Pietro Zanuttigh

Federated Learning (FL) is a rising approach towards collaborative and privacy-preserving machine learning where large-scale medical datasets remain localized to each client. However, the issue of data heterogeneity among clients often…

Machine Learning · Computer Science 2024-10-01 Shuang Zeng , Pengxin Guo , Shuai Wang , Jianbo Wang , Yuyin Zhou , Liangqiong Qu

Federated learning (FL) is a new paradigm for distributed machine learning that allows a global model to be trained across multiple clients without compromising their privacy. Although FL has demonstrated remarkable success in various…

Machine Learning · Computer Science 2023-06-06 Haolin Wang , Xuefeng Liu , Jianwei Niu , Shaojie Tang , Jiaxing Shen

Federated Learning (FL) is a novel machine learning approach that allows the model trainer to access more data samples, by training the model across multiple decentralized data sources, while data access constraints are in place. Such…

Computation and Language · Computer Science 2022-11-18 Andre Manoel , Mirian Hipolito Garcia , Tal Baumel , Shize Su , Jialei Chen , Dan Miller , Danny Karmon , Robert Sim , Dimitrios Dimitriadis

Federated Learning (FL) applied to real world data may suffer from several idiosyncrasies. One such idiosyncrasy is the data distribution across devices. Data across devices could be distributed such that there are some "heavy devices" with…

Machine Learning · Computer Science 2022-02-09 Christophe Dupuy , Tanya G. Roosta , Leo Long , Clement Chung , Rahul Gupta , Salman Avestimehr

Federated Learning (FL) allows collaborative model training among distributed parties without pooling local datasets at a central server. However, the distributed nature of FL poses challenges in training fair federated learning models. The…

Machine Learning · Computer Science 2025-01-28 Yi Zhou , Naman Goel

Federated Learning (FL) is an emerging approach for collaboratively training Deep Neural Networks (DNNs) on mobile devices, without private user data leaving the devices. Previous works have shown that non-Independent and Identically…

Machine Learning · Computer Science 2021-07-23 Jed Mills , Jia Hu , Geyong Min

Although Federated Learning (FL) promises privacy and distributed collaboration, its effectiveness in real-world scenarios is often hampered by the stochastic heterogeneity of clients and unpredictable system dynamics. Existing static…

Multiagent Systems · Computer Science 2026-04-07 Rafael O. Jarczewski , Gabriel U. Talasso , Leandro Villas , Allan M. de Souza

Federated learning (FL) enables collaboratively training deep learning models on decentralized data. However, there are three types of heterogeneities in FL setting bringing about distinctive challenges to the canonical federated learning…

Machine Learning · Computer Science 2020-09-18 Tao Shen , Jie Zhang , Xinkang Jia , Fengda Zhang , Gang Huang , Pan Zhou , Kun Kuang , Fei Wu , Chao Wu

Meta federated learning (FL) is a personalized variant of FL, where multiple agents collaborate on training an initial shared model without exchanging raw data samples. The initial model should be trained in a way that current or new agents…

Machine Learning · Computer Science 2025-05-14 Mohammad Vahid Jamali , Hamid Saber , Jung Hyun Bae

Over the past few years, Federated Learning (FL) has become a popular distributed machine learning paradigm. FL involves a group of clients with decentralized data who collaborate to learn a common model under the coordination of a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-21 Jieming Bian , Lei Wang , Kun Yang , Cong Shen , Jie Xu

Federated learning (FL) is a distributed learning framework that leverages commonalities between distributed client datasets to train a global model. Under heterogeneous clients, however, FL can fail to produce stable training results.…

Machine Learning · Computer Science 2024-11-04 Connor J. Mclaughlin , Lili Su

Heterogeneous federated learning (HtFL) aims to enable collaboration among clients that differ in both data distributions and model architectures. Prototype-based methods, which communicate class-level feature centers (prototypes) instead…

Artificial Intelligence · Computer Science 2026-05-08 Xinghao Wu , Jianwei Niu , Guogang Zhu , Xuefeng Liu , Shaojie Tang , Jiayuan Zhang

Federated Learning (FL) is a privacy-preserving machine learning framework facilitating collaborative training across distributed clients. However, its performance is often compromised by data heterogeneity among participants, which can…

Machine Learning · Computer Science 2026-02-16 Ziru Niu , Hai Dong , A. K. Qin

Federated learning (FL) offers a solution to train a global machine learning model while still maintaining data privacy, without needing access to data stored locally at the clients. However, FL suffers performance degradation when client…

Machine Learning · Computer Science 2021-08-13 Zihan Chen , Kai Fong Ernest Chong , Tony Q. S. Quek

Federated Learning (FL) is a decentralized machine learning approach that has gained attention for its potential to enable collaborative model training across clients while protecting data privacy, making it an attractive solution for the…

Task-adaptive pre-training (TAPT) and Self-training (ST) have emerged as the major semi-supervised approaches to improve natural language understanding (NLU) tasks with massive amount of unlabeled data. However, it's unclear whether they…

Computation and Language · Computer Science 2023-02-21 Shiyang Li , Semih Yavuz , Wenhu Chen , Xifeng Yan