English
Related papers

Related papers: Federated Unsupervised Representation Learning

200 papers

To eliminate the requirement of fully-labeled data for supervised model training in traditional Federated Learning (FL), extensive attention has been paid to the application of Self-supervised Learning (SSL) approaches on FL to tackle the…

Machine Learning · Computer Science 2022-11-15 Yi Liu , Song Guo , Jie Zhang , Qihua Zhou , Yingchun Wang , Xiaohan Zhao

Data heterogeneity poses a fundamental challenge in federated learning (FL), especially when clients differ not only in distribution but also in the reliability of their predictions across individual examples. While personalized FL (PFL)…

Machine Learning · Computer Science 2025-09-29 Amr Abourayya , Jens Kleesiek , Bharat Rao , Michael Kamp

Federated learning (FL) is an important technique for learning models from decentralized data in a privacy-preserving way. Existing FL methods usually uniformly sample clients for local model learning in each round. However, different…

Machine Learning · Computer Science 2023-06-27 Tao Qi , Fangzhao Wu , Lingjuan Lyu , Yongfeng Huang , Xing Xie

Federated Learning (FL) is a privacy-protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity…

Machine Learning · Computer Science 2021-08-20 Zirui Zhu , Ziyi Ye

Continual learning aims to improve the ability of modern learning systems to deal with non-stationary distributions, typically by attempting to learn a series of tasks sequentially. Prior art in the field has largely considered supervised…

Machine Learning · Computer Science 2019-11-01 Dushyant Rao , Francesco Visin , Andrei A. Rusu , Yee Whye Teh , Razvan Pascanu , Raia Hadsell

Federated Learning (FL) is a decentralized paradigm that enables a client-server architecture to collaboratively train a global Artificial Intelligence model without sharing raw data, thereby preserving privacy. A key challenge in FL is…

Machine Learning · Computer Science 2025-10-07 Michael Ben Ali , Imen Megdiche , André Peninou , Olivier Teste

Federated Learning (FL) has surged in prominence due to its capability of collaborative model training without direct data sharing. However, the vast disparity in local data distributions among clients, often termed the Non-Independent…

Machine Learning · Computer Science 2024-12-12 Zheshun Wu , Zenglin Xu , Dun Zeng , Qifan Wang , Jie Liu

Federated Learning (FL) is a distributed learning paradigm where clients collaboratively train a model while keeping their own data private. With an increasing scale of clients and models, FL encounters two key challenges, client drift due…

Machine Learning · Computer Science 2025-01-20 Jianhui Sun , Xidong Wu , Heng Huang , Aidong Zhang

Federated Edge Learning (FEEL) emerges as a pioneering distributed machine learning paradigm for the 6G Hyper-Connectivity, harnessing data from the Internet of Things (IoT) devices while upholding data privacy. However, current FEEL…

Machine Learning · Computer Science 2024-12-10 Gang Hu , Yinglei Teng , Nan Wang , Zhu Han

Federated Unsupervised Learning (FUL) aims to learn expressive representations in federated and self-supervised settings. The quality of representations learned in FUL is usually determined by uniformity, a measure of how uniformly…

Machine Learning · Computer Science 2025-08-05 Hung-Chieh Fang , Hsuan-Tien Lin , Irwin King , Yifei Zhang

Federated Learning (FL) has become a popular paradigm for learning from distributed data. To effectively utilize data at different devices without moving them to the cloud, algorithms such as the Federated Averaging (FedAvg) have adopted a…

Machine Learning · Computer Science 2021-11-24 Xinwei Zhang , Mingyi Hong , Sairaj Dhople , Wotao Yin , Yang Liu

Federated learning (FL) is an emerging paradigm that permits a large number of clients with heterogeneous data to coordinate learning of a unified global model without the need to share data amongst each other. A major challenge in…

Machine Learning · Computer Science 2023-11-16 Irene Tenison , Sai Aravind Sreeramadas , Vaikkunth Mugunthan , Edouard Oyallon , Irina Rish , Eugene Belilovsky

The emerging paradigm of federated learning (FL) strives to enable collaborative training of deep models on the network edge without centrally aggregating raw data and hence improving data privacy. In most cases, the assumption of…

Machine Learning · Computer Science 2021-05-12 Xiaoxiao Li , Meirui Jiang , Xiaofei Zhang , Michael Kamp , Qi Dou

While existing federated learning approaches mostly require that clients have fully-labeled data to train on, in realistic settings, data obtained at the client-side often comes without any accompanying labels. Such deficiency of labels may…

Machine Learning · Computer Science 2021-03-30 Wonyong Jeong , Jaehong Yoon , Eunho Yang , Sung Ju Hwang

Vision-language pre-training (VLP) has emerged as an effective scheme for multimodal representation learning, but its reliance on large-scale multimodal data poses significant challenges for medical applications. Federated learning (FL)…

Machine Learning · Computer Science 2024-11-25 Zitao Shuai , Chenwei Wu , Zhengxu Tang , Liyue Shen

Federated learning (FL) has emerged as an effective technique to co-training machine learning models without actually sharing data and leaking privacy. However, most existing FL methods focus on the supervised setting and ignore the…

Machine Learning · Computer Science 2021-07-06 Zewei Long , Liwei Che , Yaqing Wang , Muchao Ye , Junyu Luo , Jinze Wu , Houping Xiao , Fenglong Ma

Federated learning (FL) is an emerging technique that trains massive and geographically distributed edge data while maintaining privacy. However, FL has inherent challenges in terms of fairness and computational efficiency due to the rising…

Machine Learning · Computer Science 2023-04-28 Yingchun Wang , Jingcai Guo , Jie Zhang , Song Guo , Weizhan Zhang , Qinghua Zheng

Federated representation learning (FRL) is a popular personalized federated learning (FL) framework where clients work together to train a common representation while retaining their personalized heads. Existing studies, however, largely…

Machine Learning · Computer Science 2024-07-19 Renpu Liu , Cong Shen , Jing Yang

Federated Learning (FL) is a distributed machine learning paradigm that achieves a globally robust model through decentralized computation and periodic model synthesis, primarily focusing on the global model's accuracy over aggregated…

Machine Learning · Computer Science 2024-11-27 Han Liang , Ziwei Zhan , Weijie Liu , Xiaoxi Zhang , Chee Wei Tan , Xu Chen

Federated learning (FL) aims to train models collaboratively across clients without sharing data for privacy-preserving. However, one major challenge is the data heterogeneity issue, which refers to the biased labeling preferences at…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Huan Wang , Haoran Li , Huaming Chen , Jun Yan , Jiahua Shi , Jun Shen