English
Related papers

Related papers: Towards Federated Foundation Models: Scalable Data…

200 papers

Federated Learning (FL) enables collaborative model training across multiple clients without sharing their private data. However, data heterogeneity across clients leads to client drift, which degrades the overall generalization performance…

Machine Learning · Computer Science 2026-03-02 Alina Devkota , Jacob Thrasher , Donald Adjeroh , Binod Bhattarai , Prashnna K. Gyawali

Federated Learning (FL) enables multiple clients to collaboratively train a shared model while preserving data privacy. However, the high memory demand during model training severely limits the deployment of FL on resource-constrained…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-14 Yebo Wu , Jingguang Li , Chunlin Tian , Kahou Tam , Li Li , Chengzhong Xu

Most existing personalized federated learning approaches are based on intricate designs, which often require complex implementation and tuning. In order to address this limitation, we propose a simple yet effective personalized federated…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-30 Jiaqi Wang , Yuzhong Chen , Yuhang Wu , Mahashweta Das , Hao Yang , Fenglong Ma

Federated learning is a distributed, on-device computation framework that enables training global models without exporting sensitive user data to servers. In this work, we describe methods to extend the federation framework to evaluate…

Machine Learning · Computer Science 2019-10-24 Kangkang Wang , Rajiv Mathews , Chloé Kiddon , Hubert Eichner , Françoise Beaufays , Daniel Ramage

While Federated Learning (FL) is gaining popularity for training machine learning models in a decentralized fashion, numerous challenges persist, such as asynchronization, computational expenses, data heterogeneity, and gradient and…

Machine Learning · Computer Science 2025-03-13 Chun-Yin Huang , Ruinan Jin , Can Zhao , Daguang Xu , Xiaoxiao Li

Federated machine learning has great promise to overcome the input privacy challenge in machine learning. The appearance of several projects capable of simulating federated learning has led to a corresponding rapid progress on algorithmic…

Text summarization is essential for information aggregation and demands large amounts of training data. However, concerns about data privacy and security limit data collection and model training. To eliminate this concern, we propose a…

Artificial Intelligence · Computer Science 2023-04-25 Rongfeng Pan , Jianzong Wang , Lingwei Kong , Zhangcheng Huang , Jing Xiao

Federated learning (FL) is a machine learning field in which researchers try to facilitate model learning process among multiparty without violating privacy protection regulations. Considerable effort has been invested in FL optimization…

Machine Learning · Computer Science 2022-04-25 Dun Zeng , Siqi Liang , Xiangjing Hu , Hui Wang , Zenglin Xu

Many organizations rely on data from government and third-party sources, and those sources rarely follow the same data formatting. This introduces challenges in integrating data from multiple sources or aligning external sources with…

Databases · Computer Science 2023-12-27 Arash Dargahi Nobari , Davood Rafiei

Federated Learning (FL) allows collaborative model training among distributed parties without pooling local datasets at a central server. However, the distributed nature of FL poses challenges in training fair federated learning models. The…

Machine Learning · Computer Science 2025-01-28 Yi Zhou , Naman Goel

With the wealth of information produced by social networks, smartphones, medical or financial applications, speculations have been raised about the sensitivity of such data in terms of users' personal privacy and data security. To address…

Machine Learning · Computer Science 2019-08-21 Vito Walter Anelli , Yashar Deldjoo , Tommaso Di Noia , Antonio Ferrara

Most languages of the world pose low-resource challenges to natural language processing models. With multilingual training, knowledge can be shared among languages. However, not all languages positively influence each other and it is an…

Machine Learning · Computer Science 2023-10-25 Mingyang Wang , Heike Adel , Lukas Lange , Jannik Strötgen , Hinrich Schütze

Federated learning enables many applications benefiting distributed and private datasets of a large number of potential data-holding clients. However, different clients usually have their own particular objectives in terms of the tasks to…

Machine Learning · Computer Science 2022-07-19 Cihat Keçeci , Mohammad Shaqfeh , Hayat Mbayed , Erchin Serpedin

In Federated Learning, we aim to train models across multiple computing units (users), while users can only communicate with a common central server, without exchanging their data samples. This mechanism exploits the computational power of…

Machine Learning · Computer Science 2020-10-26 Alireza Fallah , Aryan Mokhtari , Asuman Ozdaglar

Federated Learning is a distributed machine learning approach which enables model training on a large corpus of decentralized data. We have built a scalable production system for Federated Learning in the domain of mobile devices, based on…

Chemistry research has both high material and computational costs to conduct experiments. Institutions thus consider chemical data to be valuable and there have been few efforts to construct large public datasets for machine learning.…

Machine Learning · Computer Science 2022-05-10 Wei Zhu , Jiebo Luo , Andrew White

Federated learning is a training paradigm that learns from multiple distributed users without aggregating data on a centralized server. Such a paradigm promises the ability to deploy machine-learning at-scale to a diverse population of…

Computation and Language · Computer Science 2022-10-11 Andrew Silva , Pradyumna Tambwekar , Matthew Gombolay

Traditionally, clustered federated learning groups clients with the same data distribution into a cluster, so that every client is uniquely associated with one data distribution and helps train a model for this distribution. We relax this…

Machine Learning · Computer Science 2022-03-24 Yichen Ruan , Carlee Joe-Wong

Federated Learning (FL) holds great potential for diverse applications owing to its privacy-preserving nature. However, its convergence is often challenged by non-IID data distributions, limiting its effectiveness in real-world deployments.…

Machine Learning · Computer Science 2025-04-22 Kun Zhai , Yifeng Gao , Difan Zou , Guangnan Ye , Siheng Chen , Xingjun Ma , Yu-Gang Jiang

Federated Learning (FL) enables training Artificial Intelligence (AI) models over end devices without compromising their privacy. As computing tasks are increasingly performed by a combination of cloud, edge, and end devices, FL can benefit…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-30 Zhiyuan Wu , Sheng Sun , Yuwei Wang , Min Liu , Bo Gao , Quyang Pan , Tianliu He , Xuefeng Jiang