English
Related papers

Related papers: Specialized federated learning using a mixture of …

200 papers

Federated Learning aims to learn machine learning models from multiple decentralized edge devices (e.g. mobiles) or servers without sacrificing local data privacy. Recent Natural Language Processing techniques rely on deep learning and…

Computation and Language · Computer Science 2021-07-28 Ming Liu , Stella Ho , Mengqi Wang , Longxiang Gao , Yuan Jin , He Zhang

Federated learning is a method of training a global model from decentralized data distributed across client devices. Here, model parameters are computed locally by each client device and exchanged with a central server, which aggregates the…

Machine Learning · Computer Science 2020-12-23 Sagar Dhakal , Saurav Prakash , Yair Yona , Shilpa Talwar , Nageen Himayat

Personalized Federated Learning (PFL) which collaboratively trains a federated model while considering local clients under privacy constraints has attracted much attention. Despite its popularity, it has been observed that existing PFL…

Machine Learning · Computer Science 2022-12-05 Tianchun Wang , Wei Cheng , Dongsheng Luo , Wenchao Yu , Jingchao Ni , Liang Tong , Haifeng Chen , Xiang Zhang

Federated Learning (FL) aims to learn a single global model that enables the central server to help the model training in local clients without accessing their local data. The key challenge of FL is the heterogeneity of local data in…

Machine Learning · Computer Science 2023-04-17 Sicong Liang , Junchao Tian , Shujun Yang , Yu Zhang

Federated learning (FL) is an appealing concept to perform distributed training of Neural Networks (NN) while keeping data private. With the industrialization of the FL framework, we identify several problems hampering its successful…

Machine Learning · Computer Science 2020-11-13 Lixuan Yang , Cedric Beliard , Dario Rossi

Personalized federated learning (FL) aims to train model(s) that can perform well for individual clients that are highly data and system heterogeneous. Most work in personalized FL, however, assumes using the same model architecture at all…

Machine Learning · Computer Science 2021-09-17 Yae Jee Cho , Jianyu Wang , Tarun Chiruvolu , Gauri Joshi

Federated learning has emerged as an effective paradigm to achieve privacy-preserving collaborative learning among different parties. Compared to traditional centralized learning that requires collecting data from each party, in federated…

Machine Learning · Computer Science 2023-01-05 Bingyan Liu , Nuoyan Lv , Yuanchun Guo , Yawen Li

A distinguishing characteristic of federated learning is that the (local) client data could have statistical heterogeneity. This heterogeneity has motivated the design of personalized learning, where individual (personalized) models are…

Machine Learning · Computer Science 2022-07-06 Kaan Ozkara , Antonious M. Girgis , Deepesh Data , Suhas Diggavi

Chemistry research has both high material and computational costs to conduct experiments. Institutions thus consider chemical data to be valuable and there have been few efforts to construct large public datasets for machine learning.…

Machine Learning · Computer Science 2022-05-10 Wei Zhu , Jiebo Luo , Andrew White

Autonomous vehicles (AVs) must interact with a diverse set of human drivers in heterogeneous geographic areas. Ideally, fleets of AVs should share trajectory data to continually re-train and improve trajectory forecasting models from…

Machine Learning · Computer Science 2021-12-03 Manabu Nakanoya , Junha Im , Hang Qiu , Sachin Katti , Marco Pavone , Sandeep Chinchali

As privacy concerns continue to grow, federated learning (FL) has gained significant attention as a promising privacy-preserving technology, leading to considerable advancements in recent years. Unlike traditional machine learning, which…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-05 Boyu Fan , Siyang Jiang , Xiang Su , Sasu Tarkoma , Pan Hui

Federated learning is a data decentralization privacy-preserving technique used to perform machine or deep learning in a secure way. In this paper we present theoretical aspects about federated learning, such as the presentation of an…

Machine Learning · Computer Science 2022-11-09 Judith Sáinz-Pardo Díaz , Álvaro López García

Federated Learning (FL) is a novel machine learning approach that allows the model trainer to access more data samples, by training the model across multiple decentralized data sources, while data access constraints are in place. Such…

Computation and Language · Computer Science 2022-11-18 Andre Manoel , Mirian Hipolito Garcia , Tal Baumel , Shize Su , Jialei Chen , Dan Miller , Danny Karmon , Robert Sim , Dimitrios Dimitriadis

Automatic Speech Recognition models require large amount of speech data for training, and the collection of such data often leads to privacy concerns. Federated learning has been widely used and is considered to be an effective…

Machine Learning · Computer Science 2022-09-15 Rongmei Lin , Yonghui Xiao , Tien-Ju Yang , Ding Zhao , Li Xiong , Giovanni Motta , Françoise Beaufays

Federated learning (FL for simplification) is a distributed machine learning technique that utilizes global servers and collaborative clients to achieve privacy-preserving global model training without direct data sharing. However,…

Machine Learning · Computer Science 2022-11-28 Mingjia Shi , Yuhao Zhou , Qing Ye , Jiancheng Lv

A novel federated learning training framework for heterogeneous environments is presented, taking into account the diverse network speeds of clients in realistic settings. This framework integrates asynchronous learning algorithms and…

Machine Learning · Computer Science 2024-03-26 Chengjie Ma

Federated learning involves training statistical models over remote devices or siloed data centers, such as mobile phones or hospitals, while keeping data localized. Training in heterogeneous and potentially massive networks introduces…

Machine Learning · Computer Science 2020-06-24 Tian Li , Anit Kumar Sahu , Ameet Talwalkar , Virginia Smith

Federated Learning provides a privacy-preserving paradigm for distributed learning, but suffers from statistical heterogeneity across clients. Personalized Federated Learning (PFL) mitigates this issue by considering client-specific models.…

Machine Learning · Statistics 2026-02-17 Ala Emrani , Amir Najafi , Abolfazl Motahari

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

Federated learning becomes a prominent approach when different entities want to learn collaboratively a common model without sharing their training data. However, Federated learning has two main drawbacks. First, it is quite bandwidth…

Cryptography and Security · Computer Science 2021-03-02 Raouf Kerkouche , Gergely Ács , Claude Castelluccia , Pierre Genevès