English
Related papers

Related papers: Communication-Efficient Federated Learning via Pre…

200 papers

Recently, federated learning (FL), which replaces data sharing with model sharing, has emerged as an efficient and privacy-friendly machine learning (ML) paradigm. One of the main challenges in FL is the huge communication cost for model…

Signal Processing · Electrical Eng. & Systems 2023-02-14 Huiyuan Yang , Tian Ding , Xiaojun Yuan

Everyday, large amounts of sensitive data is distributed across mobile phones, wearable devices, and other sensors. Traditionally, these enormous datasets have been processed on a single system, with complex models being trained to make…

Machine Learning · Computer Science 2023-01-10 Zongshun Zhang , Andrea Pinto , Valeria Turina , Flavio Esposito , Ibrahim Matta

Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessible, such as domain-specific datasets decentralized across…

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a…

Machine Learning · Computer Science 2016-10-11 Jakub Konečný , H. Brendan McMahan , Daniel Ramage , Peter Richtárik

The provision of communication services via portable and mobile devices, such as aerial base stations, is a crucial concept to be realized in 5G/6G networks. Conventionally, IoT/edge devices need to transmit the data directly to the base…

Machine Learning · Computer Science 2022-01-21 Sunder Ali Khowaja , Kapal Dev , Parus Khuwaja , Paolo Bellavista

As a prevalent distributed learning paradigm, Federated Learning (FL) trains a global model on a massive amount of devices with infrequent communication. This paper investigates a class of composite optimization and statistical recovery…

Machine Learning · Computer Science 2022-10-04 Yajie Bao , Michael Crawshaw , Shan Luo , Mingrui Liu

The popular federated edge learning (FEEL) framework allows privacy-preserving collaborative model training via frequent learning-updates exchange between edge devices and server. Due to the constrained bandwidth, only a subset of devices…

Networking and Internet Architecture · Computer Science 2021-07-27 Maojun Zhang , Guangxu Zhu , Shuai Wang , Jiamo Jiang , Caijun Zhong , Shuguang Cui

Federated learning has shown its advances over the last few years but is facing many challenges, such as how algorithms save communication resources, how they reduce computational costs, and whether they converge. To address these issues,…

Machine Learning · Computer Science 2022-02-01 Shenglong Zhou , Geoffrey Ye Li

This paper investigates the feasibility of federated representation learning under the constraints of communication cost and privacy protection. Existing works either conduct annotation-guided local training which requires frequent…

Machine Learning · Computer Science 2022-01-19 Haizhou Shi , Youcai Zhang , Zijin Shen , Siliang Tang , Yaqian Li , Yandong Guo , Yueting Zhuang

Recently, federated learning (FL) has sparked widespread attention as a promising decentralized machine learning approach which provides privacy and low delay. However, communication bottleneck still constitutes an issue, that needs to be…

Signal Processing · Electrical Eng. & Systems 2022-03-14 Pavlos S. Bouzinis , Panagiotis D. Diamantoulakis , George K. Karagiannidis

Internet of Things (IoT) services will use machine learning tools to efficiently analyze various types of data collected by IoT devices for inference, autonomy, and control purposes. However, due to resource constraints and privacy…

Information Theory · Computer Science 2020-09-01 Mingzhe Chen , H. Vincent Poor , Walid Saad , Shuguang Cui

Federated learning involves training statistical models over edge devices such as mobile phones such that the training data is kept local. Federated Learning (FL) can serve as an ideal candidate for training spatial temporal models that…

Machine Learning · Computer Science 2024-02-09 Yacine Belal , Sonia Ben Mokhtar , Hamed Haddadi , Jaron Wang , Afra Mashhadi

Federated learning (FL) is recognized as a key enabling technology to support distributed artificial intelligence (AI) services in future 6G. By supporting decentralized data training and collaborative model training among devices, FL…

Signal Processing · Electrical Eng. & Systems 2021-11-02 Shaoming Huang , Pengfei Zhang , Yijie Mao , Lixiang Lian , Yuanming Shi

Learning over massive data stored in different locations is essential in many real-world applications. However, sharing data is full of challenges due to the increasing demands of privacy and security with the growing use of smart mobile…

Machine Learning · Computer Science 2022-10-11 Jinjin Xu , Wenli Du , Ran Cheng , Wangli He , Yaochu Jin

Federated learning (FL) is a powerful machine learning paradigm which leverages the data as well as the computational resources of clients, while protecting clients' data privacy. However, the substantial model size and frequent aggregation…

Machine Learning · Computer Science 2024-10-23 Linping Qu , Shenghui Song , Chi-Ying Tsui

Federated Learning(FL) is a privacy-preserving machine learning paradigm where a global model is trained in-situ across a large number of distributed edge devices. These systems are often comprised of millions of user devices and only a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-05 Yuanli Wang , Lei Huang

We show that a word-level recurrent neural network can predict emoji from text typed on a mobile keyboard. We demonstrate the usefulness of transfer learning for predicting emoji by pretraining the model using a language modeling task. We…

Computation and Language · Computer Science 2019-06-12 Swaroop Ramaswamy , Rajiv Mathews , Kanishka Rao , Françoise Beaufays

In systems neuroscience, most models posit that brain regions communicate information under constraints of efficiency. Yet, evidence for efficient communication in structural brain networks characterized by hierarchical organization and…

Federated learning (FL) is a machine learning paradigm that facilitates massively distributed model training with end-user data on edge devices directed by a central server. However, the large number of heterogeneous clients in FL…

Machine Learning · Computer Science 2025-04-23 Qifan Yan , Andrew Liu , Shiqi He , Mathias Lécuyer , Ivan Beschastnikh

Wirelessly connected devices can collaborately train a machine learning model using federated learning, where the aggregation of model updates occurs using over-the-air computation. Carrier frequency offset caused by imprecise clocks in…

Signal Processing · Electrical Eng. & Systems 2024-01-17 Martin Dahl , Erik G. Larsson
‹ Prev 1 8 9 10 Next ›