English
Related papers

Related papers: Towards Understanding and Mitigating Dimensional C…

200 papers

Federated Learning (FL) provides decentralised model training, which effectively tackles problems such as distributed data and privacy preservation. However, the generalisation of global models frequently faces challenges from data…

Machine Learning · Computer Science 2025-09-05 Ozgu Goksu , Nicolas Pugeault

Federated learning (FL) allows multiple clients to collectively train a high-performance global model without sharing their private data. However, the key challenge in federated learning is that the clients have significant statistical…

Machine Learning · Computer Science 2022-03-23 Liang Gao , Huazhu Fu , Li Li , Yingwen Chen , Ming Xu , Cheng-Zhong Xu

Federated Learning (FL) is a rising approach towards collaborative and privacy-preserving machine learning where large-scale medical datasets remain localized to each client. However, the issue of data heterogeneity among clients often…

Machine Learning · Computer Science 2024-10-01 Shuang Zeng , Pengxin Guo , Shuai Wang , Jianbo Wang , Yuyin Zhou , Liangqiong Qu

Federated learning (FL) aims to train models collaboratively across clients without sharing data for privacy-preserving. However, one major challenge is the data heterogeneity issue, which refers to the biased labeling preferences at…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Huan Wang , Haoran Li , Huaming Chen , Jun Yan , Jiahua Shi , Jun Shen

Data heterogeneity across clients is one of the key challenges in Federated Learning (FL), which may slow down the global model convergence and even weaken global model performance. Most existing approaches tackle the heterogeneity by…

Machine Learning · Computer Science 2023-07-18 Jun Nie , Danyang Xiao , Lei Yang , Weigang Wu

With the advancement of edge computing, federated learning (FL) displays a bright promise as a privacy-preserving collaborative learning paradigm. However, one major challenge for FL is the data heterogeneity issue, which refers to the…

Machine Learning · Computer Science 2025-05-27 Huan Wang , Haoran Li , Huaming Chen , Jun Yan , Lijuan Wang , Jiahua Shi , Shiping Chen , Jun Shen

Federated learning aims at training models collaboratively across participants while protecting privacy. However, one major challenge for this paradigm is the data heterogeneity issue, where biased data preferences across multiple clients,…

Machine Learning · Computer Science 2025-07-21 Huan Wang , Haoran Li , Huaming Chen , Jun Yan , Jiahua Shi , Jun Shen

Data heterogeneity is one of the most challenging issues in federated learning, which motivates a variety of approaches to learn personalized models for participating clients. One such approach in deep neural networks based tasks is…

Machine Learning · Computer Science 2023-06-22 Jian Xu , Xinyi Tong , Shao-Lun Huang

Federated Learning (FL) enables decentralized training of machine learning models on distributed data while preserving privacy. However, in real-world FL settings, client data is often non-identically distributed and imbalanced, resulting…

Machine Learning · Computer Science 2025-09-18 Gergely D. Németh , Eros Fanì , Yeat Jeng Ng , Barbara Caputo , Miguel Ángel Lozano , Nuria Oliver , Novi Quadrianto

Heterogeneity arising from label distribution skew and data scarcity can cause inaccuracy and unfairness in intelligent communication applications that heavily rely on distributed computing. To deal with it, this paper proposes a novel…

Machine Learning · Computer Science 2025-09-18 Chenghao Huang , Xiaolu Chen , Yanru Zhang , Hao Wang

Heterogeneous federated learning (HFL) aims to ensure effective and privacy-preserving collaboration among different entities. As newly joined clients require significant adjustments and additional training to align with the existing…

Machine Learning · Computer Science 2026-01-29 Kaile Wang , Jiannong Cao , Yu Yang , Xiaoyin Li , Mingjin Zhang

Federated Learning (FL) confronts a significant challenge known as data heterogeneity, which impairs model performance and convergence. Existing methods have made notable progress in addressing this issue. However, improving performance in…

Machine Learning · Computer Science 2025-10-24 Zhiqin Yang , Yonggang Zhang , Chenxin Li , Yiu-ming Cheung , Bo Han , Yixuan Yuan

Federated learning (FL) is a promising strategy for performing privacy-preserving, distributed learning with a network of clients (i.e., edge devices). However, the data distribution among clients is often non-IID in nature, making…

Machine Learning · Computer Science 2022-04-15 Matias Mendieta , Taojiannan Yang , Pu Wang , Minwoo Lee , Zhengming Ding , Chen Chen

Federated learning (FL) on heterogeneous data (non-IID data) has recently received great attention. Most existing methods focus on studying the convergence guarantees for the global objective. While these methods can guarantee the decrease…

Machine Learning · Computer Science 2023-11-22 Shu Zheng , Tiandi Ye , Xiang Li , Ming Gao

Federated learning, as a promising distributed learning paradigm, enables collaborative training of a global model across multiple network edge clients without the need for central data collecting. However, the heterogeneity of edge data…

Machine Learning · Computer Science 2024-03-06 Xingyan Chen , Tian Du , Mu Wang , Tiancheng Gu , Yu Zhao , Gang Kou , Changqiao Xu , Dapeng Oliver Wu

Data heterogeneity across clients in federated learning (FL) settings is a widely acknowledged challenge. In response, personalized federated learning (PFL) emerged as a framework to curate local models for clients' tasks. In PFL, a common…

Machine Learning · Computer Science 2023-12-27 Yutong Dai , Zeyuan Chen , Junnan Li , Shelby Heinecke , Lichao Sun , Ran Xu

Federated learning (FL) has emerged as a promising approach to training machine learning models across decentralized data sources while preserving data privacy, particularly in manufacturing and shared production environments. However, the…

Machine Learning · Computer Science 2024-08-20 Tatjana Legler , Vinit Hegiste , Ahmed Anwar , Martin Ruskowski

Deep neural networks have shown the ability to extract universal feature representations from data such as images and text that have been useful for a variety of learning tasks. However, the fruits of representation learning have yet to be…

Machine Learning · Computer Science 2023-03-28 Liam Collins , Hamed Hassani , Aryan Mokhtari , Sanjay Shakkottai

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

Representations learned via self-supervised learning (SSL) can be susceptible to dimensional collapse, where the learned representation subspace is of extremely low dimensionality and thus fails to represent the full data distribution and…

Machine Learning · Computer Science 2024-03-15 Hanxun Huang , Ricardo J. G. B. Campello , Sarah Monazam Erfani , Xingjun Ma , Michael E. Houle , James Bailey
‹ Prev 1 2 3 10 Next ›