English
Related papers

Related papers: FedNST: Federated Noisy Student Training for Autom…

200 papers

Federated learning (FL) is emerging as a new paradigm to train machine learning models in distributed systems. Rather than sharing, and disclosing, the training dataset with the server, the model parameters (e.g. neural networks weights and…

Signal Processing · Electrical Eng. & Systems 2020-05-27 Stefano Savazzi , Monica Nicoli , Vittorio Rampa

Automatic Speech Recognition models require large amount of speech data for training, and the collection of such data often leads to privacy concerns. Federated learning has been widely used and is considered to be an effective…

Machine Learning · Computer Science 2022-09-15 Rongmei Lin , Yonghui Xiao , Tien-Ju Yang , Ding Zhao , Li Xiong , Giovanni Motta , Françoise Beaufays

In this paper, a Federated Learning (FL) simulation platform is introduced. The target scenario is Acoustic Model training based on this platform. To our knowledge, this is the first attempt to apply FL techniques to Speech Recognition…

Machine Learning · Computer Science 2020-08-07 Dimitrios Dimitriadis , Kenichi Kumatani , Robert Gmyr , Yashesh Gaur , Sefik Emre Eskimez

This paper presents Conformer-1, an end-to-end Automatic Speech Recognition (ASR) model trained on an extensive dataset of 570k hours of speech audio data, 91% of which was acquired from publicly available sources. To achieve this, we…

Collaborative training methods like Federated Learning (FL) and Split Learning (SL) enable distributed machine learning without sharing raw data. However, FL assumes clients can train entire models, which is infeasible for large-scale…

Machine Learning · Computer Science 2025-06-18 Srijith Nair , Michael Lin , Peizhong Ju , Amirreza Talebi , Elizabeth Serena Bentley , Jia Liu

Federated learning (FL) leverages client-server communications to train global models on decentralized data. However, communication noise or errors can impair model accuracy. To address this problem, we propose a novel FL algorithm that…

Machine Learning · Computer Science 2025-12-15 Ehsan Lari , Reza Arablouei , Vinay Chakravarthi Gogineni , Stefan Werner

Federated learning has become a popular method to learn from decentralized heterogeneous data. Federated semi-supervised learning (FSSL) emerges to train models from a small fraction of labeled data due to label scarcity on decentralized…

Machine Learning · Computer Science 2024-03-12 Sikai Bai , Shuaicheng Li , Weiming Zhuang , Jie Zhang , Song Guo , Kunlin Yang , Jun Hou , Shuai Zhang , Junyu Gao , Shuai Yi

In Federated Learning (FL), multiple clients collaborate to learn a shared model through a central server while keeping data decentralized. Personalized Federated Learning (PFL) further extends FL by learning a personalized model per…

Machine Learning · Computer Science 2022-10-25 Ohad Amosy , Gal Eyal , Gal Chechik

Neuro-symbolic learning (NSL) models complex symbolic rule patterns into latent variable distributions by neural networks, which reduces rule search space and generates unseen rules to improve downstream task performance. Centralized NSL…

Artificial Intelligence · Computer Science 2024-05-28 Pengwei Xing , Songtao Lu , Han Yu

Federated Learning (FL) enables distributed Artificial Intelligence (AI) across cloud-edge environments by allowing collaborative model training without centralizing data. In cross-device deployments, FL systems face strict communication…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-11 Daniel M. Jimenez-Gutierrez , Giovanni Giunta , Mehrdad Hassanzadeh , Aris Anagnostopoulos , Ioannis Chatzigiannakis , Andrea Vitaletti

Supervised federated learning (FL) enables multiple clients to share the trained model without sharing their labeled data. However, potential clients might even be reluctant to label their own data, which could limit the applicability of FL…

Machine Learning · Computer Science 2022-05-12 Nan Lu , Zhao Wang , Xiaoxiao Li , Gang Niu , Qi Dou , Masashi Sugiyama

Federated learning provides a privacy-preserving manner to collaboratively train models on data distributed over multiple local clients via the coordination of a global server. In this paper, we focus on label distribution skew in federated…

Machine Learning · Computer Science 2024-09-23 Jianghu Lu , Shikun Li , Kexin Bao , Pengju Wang , Zhenxing Qian , Shiming Ge

Federated Learning (FL) enables training ML models on edge clients without sharing data. However, the federated model's performance on local data varies, disincentivising the participation of clients who benefit little from FL. Fair FL…

Machine Learning · Computer Science 2023-05-05 Alex Iacob , Pedro P. B. Gusmão , Nicholas D. Lane

This paper studies a new task of federated learning (FL) for semantic parsing, where multiple clients collaboratively train one global model without sharing their semantic parsing data. By leveraging data from multiple clients, the FL…

Computation and Language · Computer Science 2023-05-30 Tianshu Zhang , Changchang Liu , Wei-Han Lee , Yu Su , Huan Sun

Federated learning is a distributed paradigm that aims at training models using samples distributed across multiple users in a network while keeping the samples on users' devices with the aim of efficiency and protecting users privacy. In…

Machine Learning · Computer Science 2020-06-17 Amirhossein Reisizadeh , Farzan Farnia , Ramtin Pedarsani , Ali Jadbabaie

Federated Learning (FL) is a machine learning paradigm that enables the training of a shared global model across distributed clients while keeping the training data local. While most prior work on designing systems for FL has focused on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-21 Mohamed Elzohairy , Mohak Chadha , Anshul Jindal , Andreas Grafberger , Jianfeng Gu , Michael Gerndt , Osama Abboud

Federated learning (FL) is a recently developed area of machine learning, in which the private data of a large number of distributed clients is used to develop a global model under the coordination of a central server without explicitly…

Machine Learning · Computer Science 2022-07-21 Amit Kumar Kundu , Joseph Jaja

The integration of Federated Learning (FL) and Self-supervised Learning (SSL) offers a unique and synergetic combination to exploit the audio data for general-purpose audio understanding, without compromising user data privacy. However,…

Sound · Computer Science 2024-02-07 Yasar Abbas Ur Rehman , Kin Wai Lau , Yuyang Xie , Lan Ma , Jiajun Shen

Federated learning (FL) has emerged as a promising distributed learning paradigm for training deep neural networks (DNNs) at the wireless edge, but its performance can be severely hindered by unreliable wireless transmission and inherent…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-29 Yanmeng Wang , Wenkai Ji , Jian Zhou , Fu Xiao , Tsung-Hui Chang

Federated learning (FL) systems enable multiple clients to train a machine learning model iteratively through synchronously exchanging the intermediate model weights with a single server. The scalability of such FL systems can be limited by…

Machine Learning · Computer Science 2024-06-21 Yuncong Zuo , Bart Cox , Lydia Y. Chen , Jérémie Decouchant