English
Related papers

Related papers: UNIDEAL: Curriculum Knowledge Distillation Federat…

200 papers

Federated Learning (FL) is a decentralized machine learning approach that has gained attention for its potential to enable collaborative model training across clients while protecting data privacy, making it an attractive solution for the…

Federated Learning (FL) is a novel approach that allows for collaborative machine learning while preserving data privacy by leveraging models trained on decentralized devices. However, FL faces challenges due to non-uniformly distributed…

Machine Learning · Computer Science 2024-04-16 Changlin Song , Divya Saxena , Jiannong Cao , Yuqing Zhao

Federated learning is a distributed machine learning paradigm designed to protect data privacy. However, data heterogeneity across various clients results in catastrophic forgetting, where the model rapidly forgets previous knowledge while…

Machine Learning · Computer Science 2024-11-07 Pengju Wang , Bochao Liu , Weijia Guo , Yong Li , Shiming Ge

Federated Learning (FL) is a decentralized learning method used to train machine learning algorithms. In FL, a global model iteratively collects the parameters of local models without accessing their local data. However, a significant…

Machine Learning · Computer Science 2023-08-29 Mingjie Wang , Jianxiong Guo , Weijia Jia

Federated learning (FL) offers a privacy-preserving paradigm for machine learning, but its application in intrusion detection systems (IDS) within IoT networks is challenged by severe class imbalance, non-IID data, and high communication…

Machine Learning · Computer Science 2025-10-28 Gurpreet Singh , Keshav Sood , P. Rajalakshmi , Yong Xiang

Federated Learning (FL) is a machine learning technique that enables multiple entities to collaboratively learn a shared model without exchanging their local data. Over the past decade, FL systems have achieved substantial progress, scaling…

Machine Learning · Computer Science 2025-03-04 Katharine Daly , Hubert Eichner , Peter Kairouz , H. Brendan McMahan , Daniel Ramage , Zheng Xu

Traditionally, federated learning (FL) aims to train a single global model while collaboratively using multiple clients and a server. Two natural challenges that FL algorithms face are heterogeneity in data across clients and collaboration…

Machine Learning · Computer Science 2022-07-06 Kaan Ozkara , Navjot Singh , Deepesh Data , Suhas Diggavi

Federated Learning (FL) enables collaborative model training among participants while guaranteeing the privacy of raw data. Mainstream FL methodologies overlook the dynamic nature of real-world data, particularly its tendency to grow in…

Machine Learning · Computer Science 2024-04-18 Zhiyuan Wu , Tianliu He , Sheng Sun , Yuwei Wang , Min Liu , Bo Gao , Xuefeng Jiang

We propose a learning framework named Feature Fusion Learning (FFL) that efficiently trains a powerful classifier through a fusion module which combines the feature maps generated from parallel neural networks. Specifically, we train a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Jangho Kim , Minsung Hyun , Inseop Chung , Nojun Kwak

Heterogeneity of data distributed across clients limits the performance of global models trained through federated learning, especially in the settings with highly imbalanced class distributions of local datasets. In recent years,…

Machine Learning · Computer Science 2023-04-11 Huancheng Chen , Johnny , Wang , Haris Vikalo

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

One-shot Federated learning (FL) is a powerful technology facilitating collaborative training of machine learning models in a single round of communication. While its superiority lies in communication efficiency and privacy preservation…

Machine Learning · Computer Science 2024-12-09 Junyuan Zhang , Songhua Liu , Xinchao Wang

Federated Learning (FL) is a novel, multidisciplinary Machine Learning paradigm where multiple clients, such as mobile devices, collaborate to solve machine learning problems. Initially introduced in Kone{\v{c}}n{\'y} et al. (2016a,b);…

Machine Learning · Computer Science 2025-09-11 Konstantin Burlachenko

Federated Learning (FL) is a machine learning paradigm that allows decentralized clients to learn collaboratively without sharing their private data. However, excessive computation and communication demands pose challenges to current FL…

Cryptography and Security · Computer Science 2022-09-22 Yue Tan , Guodong Long , Jie Ma , Lu Liu , Tianyi Zhou , Jing Jiang

Large models, renowned for superior performance, outperform smaller ones even without billion-parameter scales. While mobile network servers have ample computational resources to support larger models than client devices, privacy…

Machine Learning · Computer Science 2025-08-20 Wenxuan Ye , Xueli An , Onur Ayan , Junfan Wang , Xueqiang Yan , Georg Carle

Federated Learning (FL) has emerged as a prominent alternative to the traditional centralized learning approach. Generally speaking, FL is a decentralized approach that allows for collaborative training of Machine Learning (ML) models…

Machine Learning · Computer Science 2024-03-19 S. Jamal Seyedmohammadi , S. Kawa Atapour , Jamshid Abouei , Arash Mohammadi

Federated learning (FL) is a promising paradigm to enable privacy-preserving deep learning from distributed data. Most previous works are based on federated average (FedAvg), which, however, faces several critical issues, including a high…

Machine Learning · Computer Science 2022-03-15 Lumin Liu , Jun Zhang , S. H. Song , Khaled B. Letaief

In Federated Learning (FL), the distributed nature and heterogeneity of client data present both opportunities and challenges. While collaboration among clients can significantly enhance the learning process, not all collaborations are…

Machine Learning · Computer Science 2024-07-18 Nazarii Tupitsa , Samuel Horváth , Martin Takáč , Eduard Gorbunov

Federated learning (FL) enables collaboratively training deep learning models on decentralized data. However, there are three types of heterogeneities in FL setting bringing about distinctive challenges to the canonical federated learning…

Machine Learning · Computer Science 2020-09-18 Tao Shen , Jie Zhang , Xinkang Jia , Fengda Zhang , Gang Huang , Pan Zhou , Kun Kuang , Fei Wu , Chao Wu

Federated learning (FL) is a recently proposed distributed machine learning paradigm dealing with distributed and private data sets. Based on the data partition pattern, FL is often categorized into horizontal, vertical, and hybrid…

Machine Learning · Computer Science 2021-02-19 Xinwei Zhang , Wotao Yin , Mingyi Hong , Tianyi Chen