English
Related papers

Related papers: Federated Two-stage Learning with Sign-based Votin…

200 papers

Federated learning ensures the privacy of clients by conducting distributed training on individual client devices and sharing only the model weights with a central server. However, in real-world scenarios, the heterogeneity of data among…

Machine Learning · Computer Science 2024-04-30 Jaewon Jang , Bonjun Choi

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez

Federated learning is a distributed machine learning paradigm where multiple data owners (clients) collaboratively train one machine learning model while keeping data on their own devices. The heterogeneity of client datasets is one of the…

Machine Learning · Computer Science 2021-08-18 Ye Xue , Diego Klabjan , Yuan Luo

Federated Learning rests on the notion of training a global model distributedly on various devices. Under this setting, users' devices perform computations on their own data and then share the results with the cloud server to update the…

Machine Learning · Computer Science 2020-09-15 Rui Hu , Yanmin Gong

Many application scenarios call for training a machine learning model among multiple participants. Federated learning (FL) was proposed to enable joint training of a deep learning model using the local data in each party without revealing…

Machine Learning · Computer Science 2021-02-12 Kai-Fung Chu , Lintao Zhang

Federated learning enables resource-constrained edge compute devices, such as mobile phones and IoT devices, to learn a shared model for prediction, while keeping the training data local. This decentralized approach to train models provides…

Machine Learning · Computer Science 2022-07-22 Yue Zhao , Meng Li , Liangzhen Lai , Naveen Suda , Damon Civin , Vikas Chandra

Federated learning achieves joint training of deep models by connecting decentralized data sources, which can significantly mitigate the risk of privacy leakage. However, in a more general case, the distributions of labels among clients are…

Machine Learning · Computer Science 2022-12-20 Tao Sheng , Chengchao Shen , Yuan Liu , Yeyu Ou , Zhe Qu , Jianxin Wang

Distributed learning, particularly variants of distributed stochastic gradient descent (DSGD), are widely employed to speed up training by leveraging computational resources of several workers. However, in practise, communication delay…

Machine Learning · Computer Science 2020-11-13 Kerem Ozfatura , Emre Ozfatura , Deniz Gunduz

Federated learning (FL) is one of the popular distributed machine learning (ML) solutions but incurs significant communication and computation costs at edge devices. Federated split learning (FSL) can train sub-models in parallel and reduce…

Machine Learning · Computer Science 2025-07-22 Yujia Mu , Cong Shen

Federated Learning (FL) is a promising distributed method for edge-level machine learning, particularly for privacysensitive applications such as those in military and medical domains, where client data cannot be shared or transferred to a…

Machine Learning · Computer Science 2024-06-27 Lucas Grativol Ribeiro , Mathieu Leonardon , Guillaume Muller , Virginie Fresse , Matthieu Arzel

We consider a many-to-one wireless architecture for federated learning at the network edge, where multiple edge devices collaboratively train a model using local data. The unreliable nature of wireless connectivity, together with…

Networking and Internet Architecture · Computer Science 2021-02-17 Junshan Zhang , Na Li , Mehmet Dedeoglu

Existing approaches in Federated Learning (FL) mainly focus on sending model parameters or gradients from clients to a server. However, these methods are plagued by significant inefficiency, privacy, and security concerns. Thanks to the…

Machine Learning · Computer Science 2024-06-04 Jie Zhang , Xiaohua Qi , Bo Zhao

Federated learning (FL) enables collaborative model training without centralizing data. However, the traditional FL framework is cloud-based and suffers from high communication latency. On the other hand, the edge-based FL framework that…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-28 Zhenxiao Zhang , Zhidong Gao , Yuanxiong Guo , Yanmin Gong

There are situations where data relevant to a machine learning problem are distributed among multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. For example, data present in users'…

Machine Learning · Computer Science 2020-08-27 Dimitris Stripelis , Jose Luis Ambite

Federated learning (FL) is a machine learning paradigm where a shared central model is learned across distributed edge devices while the training data remains on these devices. Federated Averaging (FedAvg) is the leading optimization method…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-22 Yujing Chen , Yue Ning , Martin Slawski , Huzefa Rangwala

Local Stochastic Gradient Descent (SGD) with periodic model averaging (FedAvg) is a foundational algorithm in Federated Learning. The algorithm independently runs SGD on multiple workers and periodically averages the model across all the…

Machine Learning · Computer Science 2022-01-12 Sunwoo Lee , Anit Kumar Sahu , Chaoyang He , Salman Avestimehr

The ubiquity of edge devices has led to a growing amount of unlabeled data produced at the edge. Deep learning models deployed on edge devices are required to learn from these unlabeled data to continuously improve accuracy. Self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Jiahe Shi , Yawen Wu , Dewen Zeng , Jun Tao , Jingtong Hu , Yiyu Shi

The stringent requirements for low-latency and privacy of the emerging high-stake applications with intelligent devices such as drones and smart vehicles make the cloud computing inapplicable in these scenarios. Instead, edge machine…

Machine Learning · Computer Science 2019-02-19 Kai Yang , Tao Jiang , Yuanming Shi , Zhi Ding

Federated learning (FL) is a recently developed area of machine learning, in which the private data of a large number of distributed clients is used to develop a global model under the coordination of a central server without explicitly…

Machine Learning · Computer Science 2022-07-21 Amit Kumar Kundu , Joseph Jaja

Training large neural networks requires distributing learning across multiple workers, where the cost of communicating gradients can be a significant bottleneck. signSGD alleviates this problem by transmitting just the sign of each…

Machine Learning · Computer Science 2018-08-09 Jeremy Bernstein , Yu-Xiang Wang , Kamyar Azizzadenesheli , Anima Anandkumar