中文
相关论文

相关论文: Federating to Grow Transformers with Constrained R…

200 篇论文

This work tackles the challenges of data heterogeneity and communication limitations in decentralized federated learning. We focus on creating a collaboration graph that guides each client in selecting suitable collaborators for training…

机器学习 · 计算机科学 2024-06-11 Salma Kharrat , Marco Canini , Samuel Horvath

Federated learning (FL) is a promising and powerful approach for training deep learning models without sharing the raw data of clients. During the training process of FL, the central server and distributed clients need to exchange a vast…

机器学习 · 计算机科学 2021-04-27 Zhefeng Qiao , Xianghao Yu , Jun Zhang , Khaled B. Letaief

Federated learning (FL) allows machine learning models to be trained on distributed datasets without directly accessing local data. In FL markets, numerous Data Consumers compete to recruit Data Owners for their respective training tasks,…

分布式、并行与集群计算 · 计算机科学 2025-02-27 Zhuan Shi , Patrick Ohl , Boi Faltings

With the increasing availability of Foundation Models, federated tuning has garnered attention in the field of federated learning, utilizing data and computation resources from multiple clients to collaboratively fine-tune foundation…

机器学习 · 计算机科学 2024-03-13 Shangchao Su , Bin Li , Xiangyang Xue

In this paper, we show how the Federated Learning (FL) framework enables learning collectively from distributed data in connected robot teams. This framework typically works with clients collecting data locally, updating neural network…

机器人学 · 计算机科学 2020-10-20 Nathalie Majcherczyk , Nishan Srishankar , Carlo Pinciroli

Federated Learning (FL) enables distributed training by learners using local data, thereby enhancing privacy and reducing communication. However, it presents numerous challenges relating to the heterogeneity of the data distribution, device…

机器学习 · 计算机科学 2022-11-07 Ahmed M. Abdelmoniem , Atal Narayan Sahu , Marco Canini , Suhaib A. Fahmy

Federated Learning (FL) trains machine learning models on edge devices with distributed data. However, the computational and memory limitations of these devices restrict the training of large models using FL. Split Federated Learning (SFL)…

机器学习 · 计算机科学 2025-04-02 Di Wu , Weibo He , Wanglei Feng , Zhenyu Wen , Bin Qian , Blesson Varghese

Federated Learning is an emerging learning paradigm that allows training models from samples distributed across a large network of clients while respecting privacy and communication restrictions. Despite its success, federated learning…

机器学习 · 计算机科学 2022-06-07 Isidoros Tziotis , Zebang Shen , Ramtin Pedarsani , Hamed Hassani , Aryan Mokhtari

Federated learning (FL) enables distributed training while preserving data privacy, but stragglers-slow or incapable clients-can significantly slow down the total training time and degrade performance. To mitigate the impact of stragglers,…

机器学习 · 计算机科学 2024-09-11 Honggu Kang , Seohyeon Cha , Jinwoo Shin , Jongmyeong Lee , Joonhyuk Kang

SplitFed Learning (SFL) combines federated learning and split learning to enable collaborative training across distributed edge devices; however, it faces significant challenges in heterogeneous environments with diverse computational and…

分布式、并行与集群计算 · 计算机科学 2026-05-27 Abdullah Al Asif , Sixing Yu , Juan Pablo Munoz , Arya Mazaheri , Ali Jannesari

In federated learning (FL), accommodating clients with diverse resource constraints remains a significant challenge. A widely adopted approach is to use a shared full-size model, from which each client extracts a submodel aligned with its…

机器学习 · 计算机科学 2026-04-14 Wenfei Liang , Wee Peng Tay

Restrictive rules for data sharing in many industries have led to the development of federated learning. Federated learning is a machine-learning technique that allows distributed clients to train models collaboratively without the need to…

计算机与社会 · 计算机科学 2023-09-07 Joaquin Delgado Fernandez , Martin Brennecke , Tom Barbereau , Alexander Rieger , Gilbert Fridgen

Standard Federated Learning (FL) techniques are limited to clients with identical network architectures. This restricts potential use-cases like cross-platform training or inter-organizational collaboration when both data privacy and…

机器学习 · 计算机科学 2022-01-24 Or Litany , Haggai Maron , David Acuna , Jan Kautz , Gal Chechik , Sanja Fidler

Federated learning enables collaborative model training across numerous edge devices without requiring participants to share data; however, memory and communication constraints on these edge devices may preclude their participation in…

机器学习 · 计算机科学 2025-09-04 Gwen Legate , Irina Rish , Eugene Belilovsky

Federated learning (FL) is a new paradigm for distributed machine learning that allows a global model to be trained across multiple clients without compromising their privacy. Although FL has demonstrated remarkable success in various…

机器学习 · 计算机科学 2023-06-06 Haolin Wang , Xuefeng Liu , Jianwei Niu , Shaojie Tang , Jiaxing Shen

Conventional federated learning (FL) trains one global model for a federation of clients with decentralized data, reducing the privacy risk of centralized training. However, the distribution shift across non-IID datasets, often poses a…

机器学习 · 计算机科学 2022-06-07 Jun Luo , Shandong Wu

Federated Learning (FL) is increasingly adopted in edge computing scenarios, where a large number of heterogeneous clients operate under constrained or sufficient resources. The iterative training process in conventional FL introduces…

机器学习 · 计算机科学 2025-02-13 Dezhong Yao , Yuexin Shi , Tongtong Liu , Zhiqiang Xu

Federated learning (FL) is an important paradigm for training global models from decentralized data in a privacy-preserving way. Existing FL methods usually assume the global model can be trained on any participating client. However, in…

机器学习 · 计算机科学 2022-07-19 Ruixuan Liu , Fangzhao Wu , Chuhan Wu , Yanlin Wang , Lingjuan Lyu , Hong Chen , Xing Xie

One global model in federated learning (FL) might not be sufficient to serve many clients with non-IID tasks and distributions. While there has been advances in FL to train multiple global models for better personalization, they only…

机器学习 · 计算机科学 2026-02-19 Shutong Chen , Tianyi Zhou , Guodong Long , Jing Jiang , Chengqi Zhang

As an emerging technology, federated learning (FL) involves training machine learning models over distributed edge devices, which attracts sustained attention and has been extensively studied. However, the heterogeneity of client data…

机器学习 · 计算机科学 2022-12-29 Hao Zhang , Tingting Wu , Siyao Cheng , Jie Liu