English
Related papers

Related papers: Photon: Federated LLM Pre-Training

200 papers

Federated learning (FL) has emerged as a widely adopted paradigm for enabling edge learning with distributed data while ensuring data privacy. However, the traditional FL with deep neural networks trained via backpropagation can hardly meet…

Machine Learning · Computer Science 2025-11-05 Jierui Zhang , Jianhao Huang , Kaibin Huang

Transfer learning via fine-tuning pre-trained transformer models has gained significant success in delivering state-of-the-art results across various NLP tasks. In the absence of centralized data, Federated Learning (FL) can benefit from…

Objective: Federated Learning (FL) enables collaborative model training while keeping data locally. Currently, most FL studies in radiology are conducted in simulated environments due to numerous hurdles impeding its translation into…

In this paper, we explore FP8 low-bit data formats for efficient training of large language models (LLMs). Our key insight is that most variables, such as gradients and optimizer states, in LLM training can employ low-precision data formats…

Federated Learning (FL) provides a privacy-preserving mechanism for distributed training of machine learning models on networked devices (e.g., mobile devices, IoT edge nodes). It enables Artificial Intelligence (AI) at the edge by creating…

Machine Learning · Computer Science 2024-04-03 Paul Joe Maliakel , Shashikant Ilager , Ivona Brandic

Large language models (LLMs) are proliferating rapidly at the edge, delivering intelligent capabilities across diverse application scenarios. However, their practical deployment in collaborative scenarios confronts fundamental challenges:…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-05 Xiumei Deng , Zehui Xiong , Binbin Chen , Dong In Kim , Merouane Debbah , H. Vincent Poor

Federated learning is an emerging technique used to prevent the leakage of private information. Unlike centralized learning that needs to collect data from users and store them collectively on a cloud server, federated learning makes it…

Machine Learning · Computer Science 2019-06-11 Hangyu Zhu , Yaochu Jin

Federated Learning (FL) facilitates collaborative training of a shared global model without exposing clients' private data. In practical FL systems, clients (e.g., edge servers, smartphones, and wearables) typically have disparate system…

Machine Learning · Computer Science 2025-03-03 Leming Shen , Qiang Yang , Kaiyan Cui , Yuanqing Zheng , Xiao-Yong Wei , Jianwei Liu , Jinsong Han

Federated learning (FL) is a key enabler for efficient communication and computing, leveraging devices' distributed computing capabilities. However, applying FL in practice is challenging due to the local devices' heterogeneous energy,…

Machine Learning · Computer Science 2022-12-23 Won Joon Yun , Yunseok Kwak , Hankyul Baek , Soyi Jung , Mingyue Ji , Mehdi Bennis , Jihong Park , Joongheon Kim

The success of current Large-Language Models (LLMs) hinges on extensive training data that is collected and stored centrally, called Centralized Learning (CL). However, such a collection manner poses a privacy threat, and one potential…

Machine Learning · Computer Science 2025-11-18 Huiwen Wu , Xiaogang Xu , Deyi Zhang , Xiaohan Li , Jiafei Wu , Zhe Liu

Pre-trained foundation models (FMs), with extensive number of neurons, are key to advancing next-generation intelligence services, where personalizing these models requires massive amount of task-specific data and computational resources.…

Systems and Control · Electrical Eng. & Systems 2024-07-04 Zixin Wang , Yong Zhou , Yuanming Shi , Khaled. B. Letaief

We study few-shot Natural Language Understanding (NLU) tasks with Large Language Models (LLMs) in federated learning (FL) scenarios. It is a challenging task due to limited labeled data and communication capacities in FL, especially with…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-27 Jingang Jiang , Xiangyang Liu , Chenyou Fan

Federated learning (FL) is a recently proposed distributed machine learning paradigm dealing with distributed and private data sets. Based on the data partition pattern, FL is often categorized into horizontal, vertical, and hybrid…

Machine Learning · Computer Science 2021-02-19 Xinwei Zhang , Wotao Yin , Mingyi Hong , Tianyi Chen

Artificial Intelligence (AI) is expected to play an instrumental role in the next generation of wireless systems, such as sixth-generation (6G) mobile network. However, massive data, energy consumption, training complexity, and sensitive…

Machine Learning · Computer Science 2023-12-11 Maryam Ben Driss , Essaid Sabir , Halima Elbiaze , Walid Saad

Federated learning (FL) was proposed to facilitate the training of models in a distributed environment. It supports the protection of (local) data privacy and uses local resources for model training. Until now, the majority of research has…

Federated learning (FL) enables a neural network (NN) to be trained using privacy-sensitive data on mobile devices while retaining all the data on their local storages. However, FL asks the mobile devices to perform heavy communication and…

Networking and Internet Architecture · Computer Science 2022-02-11 Sohei Itahara , Takayuki Nishio , Masahiro Morikura , Koji Yamamoto

As a promising distributed machine learning paradigm, Federated Learning (FL) enables all the involved devices to train a global model collaboratively without exposing their local data privacy. However, for non-IID scenarios, the…

Machine Learning · Computer Science 2022-02-28 Ming Hu , Tian Liu , Zhiwei Ling , Zhihao Yue , Mingsong Chen

Federated learning (FL) supports training models on geographically distributed devices. However, traditional FL systems adopt a centralized synchronous strategy, putting high communication pressure and model generalization challenge.…

Machine Learning · Computer Science 2021-11-17 Jing Cao , Zirui Lian , Weihong Liu , Zongwei Zhu , Cheng Ji

In recent years, deep learning has made remarkable progress in a wide range of domains, with a particularly notable impact on natural language processing tasks. One of the challenges associated with training deep neural networks in the…

Machine Learning · Computer Science 2024-06-27 Hanna Mazzawi , Xavi Gonzalvo , Michael Wunder , Sammy Jerome , Benoit Dherin

Federated Learning (FL) is a decentralized machine learning approach where local models are trained on distributed clients, allowing privacy-preserving collaboration by sharing model updates instead of raw data. However, the added…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-17 Pratik Agrawal , Philipp Wiesner , Odej Kao