中文
相关论文

相关论文: Federated Dropout: Convergence Analysis and Resour…

200 篇论文

As the number of sensors becomes massive in Internet of Things (IoT) networks, the amount of data is humongous. To process data in real-time while protecting user privacy, federated learning (FL) has been regarded as an enabling technique…

信息论 · 计算机科学 2023-10-05 Jianyang Ren , Wanli Ni , Hui Tian , Gaofeng Nie

Federated learning has been extensively studied and is the prevalent method for privacy-preserving distributed learning in edge devices. Correspondingly, continual learning is an emerging field targeted towards learning multiple tasks…

机器学习 · 计算机科学 2022-03-28 Yeshwanth Venkatesha , Youngeun Kim , Hyoungseob Park , Yuhang Li , Priyadarshini Panda

Adaptive optimization has achieved notable success for distributed learning while extending adaptive optimizer to federated Learning (FL) suffers from severe inefficiency, including (i) rugged convergence due to inaccurate gradient…

机器学习 · 计算机科学 2023-08-02 Yan Sun , Li Shen , Hao Sun , Liang Ding , Dacheng Tao

The future of machine learning lies in moving data collection along with training to the edge. Federated Learning, for short FL, has been recently proposed to achieve this goal. The principle of this approach is to aggregate models learned…

机器学习 · 计算机科学 2023-07-13 Adnan Ben Mansour , Gaia Carenini , Alexandre Duplessis

The ever-growing volume and decentralized nature of data, coupled with the need to harness it and extract knowledge, have led to the extensive use of distributed deep learning (DDL) techniques for training. These techniques rely on local…

Dropout is a standard training technique for neural networks that consists of randomly deactivating units at each step of their gradient-based training. It is known to improve performance in many settings, including in the large-scale…

机器学习 · 计算机科学 2025-10-10 Lénaïc Chizat , Pierre Marion , Yerkin Yesbay

There is an increasing interest in a fast-growing machine learning technique called Federated Learning, in which the model training is distributed over mobile user equipments (UEs), exploiting UEs' local computation and training data.…

Federated learning (FL) necessitates that edge devices conduct local training and communicate with a parameter server, resulting in significant energy consumption. A key challenge in practical FL systems is the rapid depletion of…

机器学习 · 计算机科学 2025-06-24 Kai Zhang , Xuanyu Cao , Khaled B. Letaief

Federated Learning is a machine learning setting where the goal is to train a high-quality centralized model while training data remains distributed over a large number of clients each with unreliable and relatively slow network…

This paper studies issues that arise with respect to the joint optimization for convergence time in federated learning over wireless networks (FLOWN). We consider the criterion and protocol for selection of participating devices in FLOWN…

机器学习 · 计算机科学 2024-06-18 Kaidi Wang , Yi Ma , Mahdi Boloursaz Mashhadi , Chuan Heng Foh , Rahim Tafazolli , Zhi Ding

We demonstrate that merely analog transmissions and match filtering can realize the function of an edge server in federated learning (FL). Therefore, a network with massively distributed user equipments (UEs) can achieve large-scale FL…

信息论 · 计算机科学 2022-04-19 Howard H. Yang , Zihan Chen , Tony Q. S. Quek

Federated Learning (FL) is a promising framework for performing privacy-preserving, distributed learning with a set of clients. However, the data distribution among clients often exhibits non-IID, i.e., distribution shift, which makes…

机器学习 · 计算机科学 2022-06-07 Zhe Qu , Xingyu Li , Rui Duan , Yao Liu , Bo Tang , Zhuo Lu

Federated learning (FL) is a promising learning paradigm that can tackle the increasingly prominent isolated data islands problem while keeping users' data locally with privacy and security guarantees. However, FL could result in…

信息论 · 计算机科学 2022-03-30 Peng Yang , Yuning Jiang , Ting Wang , Yong Zhou , Yuanming Shi , Colin N. Jones

Federated learning (FL), an emerging distributed machine learning paradigm, in conflux with edge computing is a promising area with novel applications over mobile edge devices. In FL, since mobile devices collaborate to train a model based…

机器学习 · 计算机科学 2021-11-02 Pavana Prakash , Jiahao Ding , Maoqiang Wu , Minglei Shu , Rong Yu , Miao Pan

Federated learning is an emerging technique used to prevent the leakage of private information. Unlike centralized learning that needs to collect data from users and store them collectively on a cloud server, federated learning makes it…

机器学习 · 计算机科学 2019-06-11 Hangyu Zhu , Yaochu Jin

Federated learning (FL) involves multiple distributed devices jointly training a shared model without any of the participants having to reveal their local data to a centralized server. Most of previous FL approaches assume that data on…

机器学习 · 计算机科学 2021-09-02 Yujing Chen , Zheng Chai , Yue Cheng , Huzefa Rangwala

Federated learning (FL) is a privacy-preserving distributed machine learning technique that trains models while keeping all the original data generated on devices locally. Since devices may be resource constrained, offloading can be used to…

分布式、并行与集群计算 · 计算机科学 2022-07-18 Rehmat Ullah , Di Wu , Paul Harvey , Peter Kilpatrick , Ivor Spence , Blesson Varghese

A recent take towards Federated Analytics (FA), which allows analytical insights of distributed datasets, reuses the Federated Learning (FL) infrastructure to evaluate the summary of model performances across the training devices. However,…

机器学习 · 计算机科学 2021-06-01 Shashi Raj Pandey , Minh N. H. Nguyen , Tri Nguyen Dang , Nguyen H. Tran , Kyi Thar , Zhu Han , Choong Seon Hong

Recently, a considerable amount of works have been made to tackle the communication burden in federated learning (FL) (e.g., model quantization, data sparsification, and model compression). However, the existing methods, that boost the…

信息论 · 计算机科学 2022-06-15 Xuan-Tung Nguyen , Minh-Duong Nguyen , Quoc-Viet Pham , Vinh-Quang Do , Won-Joo Hwang

In recent years, distributed optimization is proven to be an effective approach to accelerate training of large scale machine learning models such as deep neural networks. With the increasing computation power of GPUs, the bottleneck of…

机器学习 · 计算机科学 2021-09-14 Xiangyi Chen , Xiaoyun Li , Ping Li