English
Related papers

Related papers: Federated Contrastive Learning for Personalized Se…

200 papers

Federated learning (FL) enables leveraging distributed private data for model training in a privacy-preserving way. However, data heterogeneity significantly limits the performance of current FL methods. In this paper, we propose a novel FL…

Machine Learning · Computer Science 2023-12-12 Rui Ye , Xinyu Zhu , Jingyi Chai , Siheng Chen , Yanfeng Wang

Federated learning is a paradigm of increasing relevance in real world applications, aimed at building a global model across a network of heterogeneous users without requiring the sharing of private data. We focus on model learning over…

Machine Learning · Computer Science 2025-07-24 Aritz Pérez , Carlos Echegoyen , Guzmán Santafé

Contrastive learning has achieved great success in self-supervised visual representation learning, but existing approaches mostly ignored spatial information which is often crucial for visual representation. This paper presents…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Xinyue Huo , Lingxi Xie , Longhui Wei , Xiaopeng Zhang , Hao Li , Zijie Yang , Wengang Zhou , Houqiang Li , Qi Tian

This work considers supervised contrastive learning for semantic segmentation. We apply contrastive learning to enhance the discriminative power of the multi-scale features extracted by semantic segmentation networks. Our key methodological…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Theodoros Pissas , Claudio S. Ravasio , Lyndon Da Cruz , Christos Bergeles

Semantic communication is designed to tackle issues like bandwidth constraints and high latency in communication systems. However, in complex network topologies with multiple users, the enormous combinations of client data and channel state…

Image and Video Processing · Electrical Eng. & Systems 2025-03-19 Xingrun Yan , Shiyuan Zuo , Yifeng Lyu , Rongfei Fan , Han Hu

We focus on the problem of Personalized Federated Continual Learning (PFCL): a group of distributed clients, each with a sequence of local tasks on arbitrary data distributions, collaborate through a central server to train a personalized…

Machine Learning · Computer Science 2024-04-22 Jin Xie , Chenqing Zhu , Songze Li

Pre-trained BERT models have achieved impressive performance in many natural language processing (NLP) tasks. However, in many real-world situations, textual data are usually decentralized over many clients and unable to be uploaded to a…

Computation and Language · Computer Science 2022-05-27 Zhengyang Li , Shijing Si , Jianzong Wang , Jing Xiao

Federated learning (FL) enables collaborative training of a global model in the centralized server with data from multiple parties while preserving privacy. However, data heterogeneity can significantly degrade the performance of the global…

Machine Learning · Computer Science 2025-11-11 Yong Zhang , Feng Liang , Guanghu Yuan , Min Yang , Chengming Li , Xiping Hu

Federated Learning (FL) is a collaborative machine learning framework that allows multiple users to train models utilizing their local data in a distributed manner. However, considerable statistical heterogeneity in local data across…

Machine Learning · Computer Science 2024-09-10 Qi Le , Enmao Diao , Xinran Wang , Vahid Tarokh , Jie Ding , Ali Anwar

Contrastive learning has been widely applied to graph representation learning, where the view generators play a vital role in generating effective contrastive samples. Most of the existing contrastive learning methods employ pre-defined…

Machine Learning · Computer Science 2022-01-04 Yihang Yin , Qingzhong Wang , Siyu Huang , Haoyi Xiong , Xiang Zhang

Knowledge sharing and model personalization are essential components to tackle the non-IID challenge in federated learning (FL). Most existing FL methods focus on two extremes: 1) to learn a shared model to serve all clients with non-IID…

Machine Learning · Computer Science 2022-06-08 Jie Ma , Guodong Long , Tianyi Zhou , Jing Jiang , Chengqi Zhang

Mental disorder populations exhibit pronounced heterogeneity -- that is, the significant differences between samples -- poses a significant challenge to the definition of positive pairs in contrastive learning. To address this, we propose a…

Machine Learning · Computer Science 2026-03-23 Xiaolong Li , Guiliang Guo , Guangqi Wen , Peng Cao , Jinzhu Yang , Honglin Wu , Xiaoli Liu , Fei Wang , Osmar R. Zaiane

Federated cross-domain recommendation (Federated CDR) aims to collaboratively learn personalized recommendation models across heterogeneous domains while preserving data privacy. Recently, large language model (LLM)-based recommendation…

Information Retrieval · Computer Science 2026-02-19 Xinrui He , Ting-Wei Li , Tianxin Wei , Xuying Ning , Xinyu He , Wenxuan Bao , Hanghang Tong , Jingrui He

Cross-domain recommendation (CDR) aims to improve recommendation accuracy in sparse domains by transferring knowledge from data-rich domains. However, existing CDR approaches often assume that user-item interaction data across domains is…

Information Retrieval · Computer Science 2025-05-16 Li Wang , Qiang Wu , Min Xu

Federated Learning (FL) for face recognition aggregates locally optimized models from individual clients to construct a generalized face recognition model. However, previous studies present two major challenges: insufficient incorporation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Hansol Kim , Hoyeol Choi , Youngjun Kwak

Data heterogeneity poses a fundamental challenge in federated learning (FL), especially when clients differ not only in distribution but also in the reliability of their predictions across individual examples. While personalized FL (PFL)…

Machine Learning · Computer Science 2025-09-29 Amr Abourayya , Jens Kleesiek , Bharat Rao , Michael Kamp

Federated Learning (FL) has emerged as a groundbreaking distributed learning paradigm enabling clients to train a global model collaboratively without exchanging data. Despite enhancing privacy and efficiency in information retrieval and…

Machine Learning · Computer Science 2024-10-30 Long Tan Le , Tuan Dung Nguyen , Tung-Anh Nguyen , Choong Seon Hong , Suranga Seneviratne , Wei Bao , Nguyen H. Tran

Federated learning (FL) is a machine learning paradigm that facilitates massively distributed model training with end-user data on edge devices directed by a central server. However, the large number of heterogeneous clients in FL…

Machine Learning · Computer Science 2025-04-23 Qifan Yan , Andrew Liu , Shiqi He , Mathias Lécuyer , Ivan Beschastnikh

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

Personalized Federated Learning (PFL) is proposed to find the greatest personalized models for each client. To avoid the central failure and communication bottleneck in the server-based FL, we concentrate on the Decentralized Personalized…

Machine Learning · Computer Science 2024-05-29 Yingqi Liu , Yifan Shi , Qinglun Li , Baoyuan Wu , Xueqian Wang , Li Shen