中文
相关论文

相关论文: Decentralized Federated Learning via SGD over Wire…

200 篇论文

As a paradigm of distributed machine learning, federated learning typically requires all edge devices to train a complete model locally. However, with the increasing scale of artificial intelligence models, the limited resources on edge…

机器学习 · 计算机科学 2024-12-11 Junhe Zhang , Wanli Ni , Dongyu Wang

Stochastic Gradient Descent (SGD) is the most popular algorithm for training deep neural networks (DNNs). As larger networks and datasets cause longer training times, training on distributed systems is common and distributed SGD variants,…

机器学习 · 计算机科学 2019-06-17 Kwangmin Yu , Thomas Flynn , Shinjae Yoo , Nicholas D'Imperio

Federated Learning (FL) is a promising privacy-preserving distributed learning framework where a server aggregates models updated by multiple devices without accessing their private datasets. Hierarchical FL (HFL), as a device-edge-cloud…

机器学习 · 计算机科学 2023-05-17 Xiaonan Liu , Shiqiang Wang , Yansha Deng , Arumugam Nallanathan

Decentralized federated learning (D-FL) allows clients to aggregate learning models locally, offering flexibility and scalability. Existing D-FL methods use gossip protocols, which are inefficient when not all nodes in the network are D-FL…

分布式、并行与集群计算 · 计算机科学 2025-03-31 Weicai Li , Tiejun Lv , Wei Ni , Jingbo Zhao , Ekram Hossain , H. Vincent Poor

Federated learning (FL) enables geographically dispersed edge devices (i.e., clients) to learn a global model without sharing the local datasets, where each client performs gradient descent with its local data and uploads the gradients to a…

分布式、并行与集群计算 · 计算机科学 2022-12-19 Heting Liu , Fang He , Guohong Cao

Federated Learning (FL) is a distributed machine learning (ML) paradigm, aiming to train a global model by exploiting the decentralized data across millions of edge devices. Compared with centralized learning, FL preserves the clients'…

分布式、并行与集群计算 · 计算机科学 2023-08-15 Bocheng Chen , Nikolay Ivanov , Guangjing Wang , Qiben Yan

Decentralized federated learning (DFL) uses peer-to-peer communication to avoid the single point of failure problem in federated learning and has been considered an attractive solution for machine learning tasks on distributed devices. We…

分布式、并行与集群计算 · 计算机科学 2024-09-10 Yifan Hua , Jinlong Pang , Xiaoxue Zhang , Yi Liu , Xiaofeng Shi , Bao Wang , Yang Liu , Chen Qian

The conventional federated learning (FedL) architecture distributes machine learning (ML) across worker devices by having them train local models that are periodically aggregated by a server. FedL ignores two important characteristics of…

网络与互联网体系结构 · 计算机科学 2021-09-15 Su Wang , Mengyuan Lee , Seyyedali Hosseinalipour , Roberto Morabito , Mung Chiang , Christopher G. Brinton

Internet of Things (IoT) services will use machine learning tools to efficiently analyze various types of data collected by IoT devices for inference, autonomy, and control purposes. However, due to resource constraints and privacy…

信息论 · 计算机科学 2020-09-01 Mingzhe Chen , H. Vincent Poor , Walid Saad , Shuguang Cui

Large-scale federated learning (FL) over wireless multiple access channels (MACs) has emerged as a crucial learning paradigm with a wide range of applications. However, its widespread adoption is hindered by several major challenges,…

机器学习 · 计算机科学 2024-11-01 Vineet Sunil Gattani , Junshan Zhang , Gautam Dasarathy

In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with…

机器学习 · 计算机科学 2020-04-07 Muhammad Asad , Ahmed Moustafa , Takayuki Ito , Muhammad Aslam

Federated Learning (FL) revolutionizes collaborative machine learning among Internet of Things (IoT) devices by enabling them to train models collectively while preserving data privacy. FL algorithms fall into two primary categories:…

分布式、并行与集群计算 · 计算机科学 2024-03-12 Liangkun Yu , Xiang Sun , Rana Albelaihi , Chaeeun Park , Sihua Shao

Distributed Deep Learning (DDL) is essential for large-scale Deep Learning (DL) training. Synchronous Stochastic Gradient Descent (SSGD) 1 is the de facto DDL optimization method. Using a sufficiently large batch size is critical to…

机器学习 · 计算机科学 2021-12-03 Wei Zhang , Mingrui Liu , Yu Feng , Xiaodong Cui , Brian Kingsbury , Yuhai Tu

Federated learning (FL) is able to manage edge devices to cooperatively train a model while maintaining the training data local and private. One common assumption in FL is that all edge devices share the same machine learning model in…

机器学习 · 计算机科学 2022-07-07 Chan Yun Hin , Ngai Edith

Distributed learning algorithms aim to leverage distributed and diverse data stored at users' devices to learn a global phenomena by performing training amongst participating devices and periodically aggregating their local models'…

机器学习 · 计算机科学 2021-02-04 Naram Mhaisen , Alaa Awad , Amr Mohamed , Aiman Erbad , Mohsen Guizani

Federated learning (FL) is a popular framework for training an AI model using distributed mobile data in a wireless network. It features data parallelism by distributing the learning task to multiple edge devices while attempting to…

机器学习 · 计算机科学 2022-02-08 Dingzhu Wen , Ki-Jun Jeon , Kaibin Huang

Motivated by the increasing computational capacity of wireless user equipments (UEs), e.g., smart phones, tablets, or vehicles, as well as the increasing concerns about sharing private data, a new machine learning model has emerged, namely…

信息论 · 计算机科学 2019-10-10 Howard H. Yang , Zuozhu Liu , Tony Q. S. Quek , H. Vincent Poor

Federated Learning (FL) makes a large amount of edge computing devices (e.g., mobile phones) jointly learn a global model without data sharing. In FL, data are generated in a decentralized manner with high heterogeneity. This paper studies…

机器学习 · 统计学 2021-12-20 Xiang Li , Jiadong Liang , Xiangyu Chang , Zhihua Zhang

Federated Learning (FL) is an innovative distributed machine learning paradigm that enables neural network training across devices without centralizing data. While this addresses issues of information sharing and data privacy, challenges…

机器学习 · 计算机科学 2024-12-09 Jiayu Liu , Yong Wang , Nianbin Wang , Jing Yang , Xiaohui Tao

Federated learning (FL) is an effective paradigm for enhancing the learning capability of edge devices while preserving data privacy. In geographically dispersed FL systems, such as sensor networks in remote areas, unmanned aerial vehicles…

机器学习 · 计算机科学 2026-05-26 Shiqian Guo , Jianqing Liu , Beatriz Lorenzo