English
Related papers

Related papers: Federated Pruning: Improving Neural Network Effici…

200 papers

Federated Learning (FL) is a rapidly growing field in machine learning that allows data to be trained across multiple decentralized devices. The selection of clients to participate in the training process is a critical factor for the…

Machine Learning · Computer Science 2023-11-14 Ala Gouissem , Zina Chkirbene , Ridha Hamila

Federated Learning (FL) has become an established technique to facilitate privacy-preserving collaborative training across a multitude of clients. However, new approaches to FL often discuss their contributions involving small deep-learning…

Machine Learning · Computer Science 2026-05-05 Herbert Woisetschläger , Alexander Isenko , Shiqiang Wang , Ruben Mayer , Hans-Arno Jacobsen

In response to growing concerns about user privacy, federated learning has emerged as a promising tool to train statistical models over networks of devices while keeping data localized. Federated learning methods run training tasks directly…

Machine Learning · Computer Science 2019-11-06 Zaoxing Liu , Tian Li , Virginia Smith , Vyas Sekar

We train a recurrent neural network language model using a distributed, on-device learning framework called federated learning for the purpose of next-word prediction in a virtual keyboard for smartphones. Server-based training using…

Federated learning enables training a global machine learning model from data distributed across multiple sites, without having to move the data. This is particularly relevant in healthcare applications, where data is rife with personal,…

Cryptography and Security · Computer Science 2020-02-24 Olivia Choudhury , Aris Gkoulalas-Divanis , Theodoros Salonidis , Issa Sylla , Yoonyoung Park , Grace Hsu , Amar Das

We propose using federated learning, a decentralized on-device learning paradigm, to train speech recognition models. By performing epochs of training on a per-user basis, federated learning must incur the cost of dealing with non-IID data…

Machine Learning · Computer Science 2021-05-18 Dhruv Guliani , Francoise Beaufays , Giovanni Motta

Robust machine learning (ML) models can be developed by leveraging large volumes of data and distributing the computational tasks across numerous devices or servers. Federated learning (FL) is a technique in the realm of ML that facilitates…

Federated learning (FL) is a collaborative learning paradigm for decentralized private data from mobile terminals (MTs). However, it suffers from issues in terms of communication, resource of MTs, and privacy. Existing privacy-preserving FL…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-03 Yifan Shi , Kang Wei , Li Shen , Jun Li , Xueqian Wang , Bo Yuan , Song Guo

Large scale contextual representation models have significantly advanced NLP in recent years, understanding the semantics of text to a degree never seen before. However, they need to process large amounts of data to achieve high-quality…

Computation and Language · Computer Science 2021-05-04 Daniel Garcia Bernal , Lodovico Giaretta , Sarunas Girdzijauskas , Magnus Sahlgren

Availability of large, diverse, and multi-national datasets is crucial for the development of effective and clinically applicable AI systems in the medical imaging domain. However, forming a global model by bringing these datasets together…

Machine Learning · Computer Science 2022-09-07 Ece Isik-Polat , Gorkem Polat , Altan Kocyigit , Alptekin Temizel

Many image and vision applications require a large amount of data for model training. Collecting all such data at a central location can be challenging due to data privacy and communication bandwidth restrictions. Federated learning is an…

Machine Learning · Computer Science 2020-06-24 Tiffany Tuor , Shiqiang Wang , Bong Jun Ko , Changchang Liu , Kin K. Leung

Pre-training is prevalent in nowadays deep learning to improve the learned model's performance. However, in the literature on federated learning (FL), neural networks are mostly initialized with random weights. These attract our interest in…

Machine Learning · Computer Science 2023-03-24 Hong-You Chen , Cheng-Hao Tu , Ziwei Li , Han-Wei Shen , Wei-Lun Chao

Federated learning involves training statistical models over remote devices or siloed data centers, such as mobile phones or hospitals, while keeping data localized. Training in heterogeneous and potentially massive networks introduces…

Machine Learning · Computer Science 2020-06-24 Tian Li , Anit Kumar Sahu , Ameet Talwalkar , Virginia Smith

Federated learning allows multiple parties to collaboratively train a joint model without sharing local data. This enables applications of machine learning in settings of inherently distributed, undisclosable data such as in the medical…

Machine Learning · Computer Science 2023-10-13 Michael Kamp , Jonas Fischer , Jilles Vreeken

Federated learning (FL) is a new paradigm for distributed machine learning that allows a global model to be trained across multiple clients without compromising their privacy. Although FL has demonstrated remarkable success in various…

Machine Learning · Computer Science 2023-06-06 Haolin Wang , Xuefeng Liu , Jianwei Niu , Shaojie Tang , Jiaxing Shen

Federated learning (FL) has emerged as a promising paradigm for training models on decentralized data while safeguarding data privacy. Most existing FL systems, however, assume that all machine learning models are of the same type, although…

Machine Learning · Computer Science 2024-06-17 Yingchao Yu , Yuping Yan , Jisong Cai , Yaochu Jin

Federated Learning (FL) is a distributed approach to collaboratively training machine learning models. FL requires a high level of communication between the devices and a central server, thus imposing several challenges, including…

Federated learning is a new learning paradigm for extracting knowledge from distributed data. Due to its favorable properties in preserving privacy and saving communication costs, it has been extensively studied and widely applied to…

Machine Learning · Computer Science 2023-06-06 Hongchang Gao , My T. Thai , Jie Wu

Many application scenarios call for training a machine learning model among multiple participants. Federated learning (FL) was proposed to enable joint training of a deep learning model using the local data in each party without revealing…

Machine Learning · Computer Science 2021-02-12 Kai-Fung Chu , Lintao Zhang

Federated learning (FL) enables distributed model training from local data collected by users. In distributed systems with constrained resources and potentially high dynamics, e.g., mobile edge networks, the efficiency of FL is an important…

Machine Learning · Computer Science 2022-12-19 Shiqiang Wang , Jake Perazzone , Mingyue Ji , Kevin S. Chan