English
Related papers

Related papers: Closing the Generalization Gap in Parameter-effici…

200 papers

Federated Learning is a modern decentralized machine learning technique where user equipments perform machine learning tasks locally and then upload the model parameters to a central server. In this paper, we consider a 3-layer hierarchical…

Machine Learning · Computer Science 2022-10-11 Chang Liu , Terence Jie Chua , Jun Zhao

Large-scale Internet of Things (IoT) networks enable intelligent services such as smart cities and autonomous driving, but often face resource constraints. Collecting heterogeneous sensory data, especially in small-scale datasets, is…

Machine Learning · Computer Science 2026-04-14 Haihui Xie , Wenkun Wen , Shuwu Chen , Zhaogang Shu , Minghua Xia

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

Machine Learning · Computer Science 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

A recent take towards Federated Analytics (FA), which allows analytical insights of distributed datasets, reuses the Federated Learning (FL) infrastructure to evaluate the summary of model performances across the training devices. However,…

Machine Learning · Computer Science 2021-06-01 Shashi Raj Pandey , Minh N. H. Nguyen , Tri Nguyen Dang , Nguyen H. Tran , Kyi Thar , Zhu Han , Choong Seon Hong

Federated learning has emerged as a promising approach for training machine learning models on decentralized data sources while preserving data privacy. However, challenges such as communication bottlenecks, heterogeneity of client devices,…

Machine Learning · Computer Science 2023-12-27 Anna Vettoruzzo , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson

Federated learning (FL) enables collaboratively training deep learning models on decentralized data. However, there are three types of heterogeneities in FL setting bringing about distinctive challenges to the canonical federated learning…

Machine Learning · Computer Science 2020-09-18 Tao Shen , Jie Zhang , Xinkang Jia , Fengda Zhang , Gang Huang , Pan Zhou , Kun Kuang , Fei Wu , Chao Wu

Federated Learning (FL) has revolutionized how we train deep neural networks by enabling decentralized collaboration while safeguarding sensitive data and improving model performance. However, FL faces two crucial challenges: the diverse…

Cryptography and Security · Computer Science 2023-09-22 Yusen Wu , Jamie Deng , Hao Chen , Phuong Nguyen , Yelena Yesha

Federated learning (FL) has proven essential for privacy-preserving, collaborative training across distributed clients. Our prior work, TransFed, introduced a robust transformer-based FL framework that leverages a learn-to-adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Tajamul Ashraf , Iqra Altaf Gillani

Federated learning is proposed as a machine learning setting to enable distributed edge devices, such as mobile phones, to collaboratively learn a shared prediction model while keeping all the training data on device, which can not only…

Machine Learning · Computer Science 2020-03-13 Lifeng Liu , Fengda Zhang , Jun Xiao , Chao Wu

Federated learning (FL) is an appealing paradigm that allows a group of machines (a.k.a. clients) to learn collectively while keeping their data local. However, due to the heterogeneity between the clients' data distributions, the model…

Machine Learning · Computer Science 2024-10-01 Youssef Allouah , Abdellah El Mrini , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot

Recently, federated learning (FL) has emerged as a popular technique for edge AI to mine valuable knowledge in edge computing (EC) systems. To mitigate the computing/communication burden on resource-constrained workers and protect model…

Machine Learning · Computer Science 2024-07-23 Yunming Liao , Yang Xu , Hongli Xu , Lun Wang , Zhiwei Yao , Chunming Qiao

Mass data traffics, low-latency wireless services and advanced artificial intelligence (AI) technologies have driven the emergence of a new paradigm for wireless networks, namely edge-intelligent networks, which are more efficient and…

Information Theory · Computer Science 2022-05-17 Qiao Qi , Xiaoming Chen

Distributed Artificial Intelligence (AI) model training over mobile edge networks encounters significant challenges due to the data and resource heterogeneity of edge devices. The former hampers the convergence rate of the global model,…

Machine Learning · Computer Science 2023-10-31 Peichun Li , Hanwen Zhang , Yuan Wu , Liping Qian , Rong Yu , Dusit Niyato , Xuemin Shen

Federated learning (FL) is a distributed machine learning technique in which multiple clients cooperate to train a shared model without exchanging their raw data. However, heterogeneity of data distribution among clients usually leads to…

Machine Learning · Computer Science 2023-03-23 Yu Qiao , Seong-Bae Park , Sun Moo Kang , Choong Seon Hong

Federated Learning (FL) is a distributed learning approach that trains machine learning models across multiple devices while keeping their local data private. However, FL often faces challenges due to data heterogeneity, leading to…

Machine Learning · Computer Science 2025-10-21 Dun Zeng , Zheshun Wu , Shiyu Liu , Yu Pan , Xiaoying Tang , Zenglin Xu

Federated Learning (FL) provides a privacy-preserving framework for training machine learning models on mobile edge devices. Traditional FL algorithms, e.g., FedAvg, impose a heavy communication workload on these devices. To mitigate this…

Machine Learning · Computer Science 2024-10-01 Zhidong Gao , Yu Zhang , Yanmin Gong , Yuanxiong Guo

In this work, we propose a fast adaptive federated meta-learning (FAM) framework for collaboratively learning a single global model, which can then be personalized locally on individual clients. Federated learning enables multiple clients…

Machine Learning · Computer Science 2023-09-04 Indrajeet Kumar Sinha , Shekhar Verma , Krishna Pratap Singh

Federated learning has received great attention for its capability to train a large-scale model in a decentralized manner without needing to access user data directly. It helps protect the users' private data from centralized collecting.…

Machine Learning · Computer Science 2023-02-07 Guodong Long , Ming Xie , Tao Shen , Tianyi Zhou , Xianzhi Wang , Jing Jiang , Chengqi Zhang

We present a partially personalized formulation of Federated Learning (FL) that strikes a balance between the flexibility of personalization and cooperativeness of global training. In our framework, we split the variables into global…

Machine Learning · Computer Science 2023-05-30 Konstantin Mishchenko , Rustem Islamov , Eduard Gorbunov , Samuel Horváth

Federated learning (FL) can fully leverage large-scale terminal data while ensuring privacy and security, and is considered as a distributed alternative for the centralized machine learning. However, the issue of data heterogeneity poses…

Machine Learning · Computer Science 2025-03-27 Xianke Qiang , Zheng Chang , Ying-Chang Liang