中文
相关论文

相关论文: Towards Federated Learning with On-device Training…

200 篇论文

Low-precision formats have proven to be an efficient way to reduce not only the memory footprint but also the hardware resources and power consumption of deep learning computations. Under this premise, the posit numerical format appears to…

机器学习 · 计算机科学 2021-05-17 Gonçalo Raposo , Pedro Tomás , Nuno Roma

Federated Learning aims to learn machine learning models from multiple decentralized edge devices (e.g. mobiles) or servers without sacrificing local data privacy. Recent Natural Language Processing techniques rely on deep learning and…

计算与语言 · 计算机科学 2021-07-28 Ming Liu , Stella Ho , Mengqi Wang , Longxiang Gao , Yuan Jin , He Zhang

We propose using federated learning, a decentralized on-device learning paradigm, to train speech recognition models. By performing epochs of training on a per-user basis, federated learning must incur the cost of dealing with non-IID data…

机器学习 · 计算机科学 2021-05-18 Dhruv Guliani , Francoise Beaufays , Giovanni Motta

Federated learning (FL) enables distribution of machine learning workloads from the cloud to resource-limited edge devices. Unfortunately, current deep networks remain not only too compute-heavy for inference and training on edge devices,…

机器学习 · 计算机科学 2021-12-21 Sameer Bibikar , Haris Vikalo , Zhangyang Wang , Xiaohan Chen

Federated learning has attracted growing interest as it preserves the clients' privacy. As a variant of federated learning, federated transfer learning utilizes the knowledge from similar tasks and thus has also been intensively studied.…

机器学习 · 计算机科学 2022-09-13 Feng Wang , M. Cenk Gursoy , Senem Velipasalar

Federated learning is a new learning paradigm for extracting knowledge from distributed data. Due to its favorable properties in preserving privacy and saving communication costs, it has been extensively studied and widely applied to…

机器学习 · 计算机科学 2023-06-06 Hongchang Gao , My T. Thai , Jie Wu

Federated learning (FL) is a privacy-preserving distributed machine learning technique that trains models while keeping all the original data generated on devices locally. Since devices may be resource constrained, offloading can be used to…

分布式、并行与集群计算 · 计算机科学 2022-07-18 Rehmat Ullah , Di Wu , Paul Harvey , Peter Kilpatrick , Ivor Spence , Blesson Varghese

As a promising paradigm federated Learning (FL) is widely used in privacy-preserving machine learning, which allows distributed devices to collaboratively train a model while avoiding data transmission among clients. Despite its immense…

机器学习 · 计算机科学 2023-08-29 Jinglong Shen , Xiucheng Wang , Nan Cheng , Longfei Ma , Conghao Zhou , Yuan Zhang

Federated learning (FL) is one of the popular distributed machine learning (ML) solutions but incurs significant communication and computation costs at edge devices. Federated split learning (FSL) can train sub-models in parallel and reduce…

机器学习 · 计算机科学 2025-07-22 Yujia Mu , Cong Shen

The burgeoning computational demands for training large language models (LLMs) necessitate efficient methods, including quantized training, which leverages low-bit arithmetic operations to reduce costs. While FP8 precision has shown…

机器学习 · 计算机科学 2025-02-18 Jiecheng Zhou , Ding Tang , Rong Fu , Boni Hu , Haoran Xu , Yi Wang , Zhilin Pei , Zhongling Su , Liang Liu , Xingcheng Zhang , Weiming Zhang

Federated learning enables resource-constrained edge compute devices, such as mobile phones and IoT devices, to learn a shared model for prediction, while keeping the training data local. This decentralized approach to train models provides…

机器学习 · 计算机科学 2022-07-22 Yue Zhao , Meng Li , Liangzhen Lai , Naveen Suda , Damon Civin , Vikas Chandra

Under the federated learning paradigm, a set of nodes can cooperatively train a machine learning model with the help of a centralized server. Such a server is also tasked with assigning a weight to the information received from each node,…

网络与互联网体系结构 · 计算机科学 2021-02-04 Francesco Malandrino , Carla Fabiana Chiasserini

Federated Learning (FL) enables multiple clients to collaboratively train a shared model while preserving data privacy. However, the high memory demand during model training severely limits the deployment of FL on resource-constrained…

分布式、并行与集群计算 · 计算机科学 2025-10-14 Yebo Wu , Jingguang Li , Chunlin Tian , Kahou Tam , Li Li , Chengzhong Xu

In recent years, data and computing resources are typically distributed in the devices of end users, various regions or organizations. Because of laws or regulations, the distributed data and computing resources cannot be directly shared…

分布式、并行与集群计算 · 计算机科学 2022-03-28 Ji Liu , Jizhou Huang , Yang Zhou , Xuhong Li , Shilei Ji , Haoyi Xiong , Dejing Dou

Federated learning (FL) has emerged as a powerful approach to safeguard data privacy by training models across distributed edge devices without centralizing local data. Despite advancements in homogeneous data scenarios, maintaining…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Yuting Ma , Shengeng Tang , Xiaohua Xu , Lechao Cheng

Federated Learning is a modern decentralized machine learning technique where user equipments perform machine learning tasks locally and then upload the model parameters to a central server. In this paper, we consider a 3-layer hierarchical…

机器学习 · 计算机科学 2022-10-11 Chang Liu , Terence Jie Chua , Jun Zhao

Federated learning (FL) enables distributed learning across edge devices while protecting data privacy. However, the learning accuracy decreases due to the heterogeneity of devices' data, and the computation and communication latency…

机器学习 · 计算机科学 2024-01-17 Xiaonan Liu , Tharmalingam Ratnarajah , Mathini Sellathurai , Yonina C. Eldar

Federated learning (FL) is recognized as a key enabling technology to support distributed artificial intelligence (AI) services in future 6G. By supporting decentralized data training and collaborative model training among devices, FL…

信号处理 · 电气工程与系统科学 2021-11-02 Shaoming Huang , Pengfei Zhang , Yijie Mao , Lixiang Lian , Yuanming Shi

In Federated Learning (FL) client devices connected over the internet collaboratively train a machine learning model without sharing their private data with a central server or with other clients. The seminal Federated Averaging (FedAvg)…

机器学习 · 计算机科学 2023-05-17 Jed Mills , Jia Hu , Geyong Min

Federated Learning (FL) is a distributed approach to collaboratively training machine learning models. FL requires a high level of communication between the devices and a central server, thus imposing several challenges, including…