English
Related papers

Related papers: FedCLIP: Fast Generalization and Personalization f…

200 papers

Personalized Federated Learning (PFL) enables distributed training on edge devices, allowing models to collaboratively learn global patterns while tailoring their parameters to better fit each client's local data, all while preserving data…

Machine Learning · Computer Science 2025-07-08 Sannara Ek , Kaile Wang , François Portet , Philippe Lalanda , Jiannong Cao

Federated Learning provides a privacy-preserving paradigm for distributed learning, but suffers from statistical heterogeneity across clients. Personalized Federated Learning (PFL) mitigates this issue by considering client-specific models.…

Machine Learning · Statistics 2026-02-17 Ala Emrani , Amir Najafi , Abolfazl Motahari

LLMs have demonstrated great capabilities in various NLP tasks. Different entities can further improve the performance of those LLMs on their specific downstream tasks by fine-tuning LLMs. When several entities have similar interested…

Machine Learning · Computer Science 2023-09-04 Weirui Kuang , Bingchen Qian , Zitao Li , Daoyuan Chen , Dawei Gao , Xuchen Pan , Yuexiang Xie , Yaliang Li , Bolin Ding , Jingren Zhou

Federated Learning (FL) holds great potential for diverse applications owing to its privacy-preserving nature. However, its convergence is often challenged by non-IID data distributions, limiting its effectiveness in real-world deployments.…

Machine Learning · Computer Science 2025-04-22 Kun Zhai , Yifeng Gao , Difan Zou , Guangnan Ye , Siheng Chen , Xingjun Ma , Yu-Gang Jiang

The interest in federated learning has surged in recent research due to its unique ability to train a global model using privacy-secured information held locally on each client. This paper pays particular attention to the issue of…

Machine Learning · Computer Science 2024-04-16 Kai Yi , Nidham Gazagnadou , Peter Richtárik , Lingjuan Lyu

Federated learning (FL) scenarios inherently generate a large communication overhead by frequently transmitting neural network updates between clients and server. To minimize the communication cost, introducing sparsity in conjunction with…

Machine Learning · Computer Science 2022-04-12 Daniel Becking , Heiner Kirchhoffer , Gerhard Tech , Paul Haase , Karsten Müller , Heiko Schwarz , Wojciech Samek

Graphs are crucial for modeling relational and biological data. As datasets grow larger in real-world scenarios, the risk of exposing sensitive information increases, making privacy-preserving training methods like federated learning (FL)…

Machine Learning · Computer Science 2025-01-24 Emir Ceyani , Han Xie , Baturalp Buyukates , Carl Yang , Salman Avestimehr

Federated Learning (FL) is a distributed learning paradigm that empowers edge devices to collaboratively learn a global model leveraging local data. Simulating FL on GPU is essential to expedite FL algorithm prototyping and evaluations.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-26 Min Zhang , Fuxun Yu , Yongbo Yu , Minjia Zhang , Ang Li , Xiang Chen

Scalability and privacy are two critical concerns for cross-device federated learning (FL) systems. In this work, we identify that synchronous FL - synchronized aggregation of client updates in FL - cannot scale efficiently beyond a few…

Machine Learning · Computer Science 2022-03-08 John Nguyen , Kshitiz Malik , Hongyuan Zhan , Ashkan Yousefpour , Michael Rabbat , Mani Malek , Dzmitry Huba

Personalized federated learning is aimed at allowing numerous clients to train personalized models while participating in collaborative training in a communication-efficient manner without exchanging private data. However, many personalized…

Machine Learning · Computer Science 2022-10-28 Jaehee Jang , Heonseok Ha , Dahuin Jung , Sungroh Yoon

Federated learning (FL) provides a privacy-preserving solution for fine-tuning pre-trained large language models (LLMs) using distributed private datasets, enabling task-specific adaptation while preserving data privacy. However,…

Machine Learning · Computer Science 2025-01-09 Na Yan , Yang Su , Yansha Deng , Robert Schober

Federated learning (FL) research has made progress in developing algorithms for distributed learning of global models, as well as algorithms for local personalization of those common models to the specifics of each client's local data…

Machine Learning · Computer Science 2023-10-05 Royson Lee , Minyoung Kim , Da Li , Xinchi Qiu , Timothy Hospedales , Ferenc Huszár , Nicholas D. Lane

Despite achieving remarkable performance, Federated Learning (FL) encounters two important problems, i.e., low training efficiency and limited computational resources. In this paper, we propose a new FL framework, i.e., FedDUMAP, with three…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-13 Ji Liu , Juncheng Jia , Hong Zhang , Yuhui Yun , Leye Wang , Yang Zhou , Huaiyu Dai , Dejing Dou

We consider the problem of federated learning (FL) with graph-structured data distributed across multiple clients. In particular, we address the prevalent scenario of interconnected subgraphs, where interconnections between clients…

Machine Learning · Computer Science 2025-10-30 Javad Aliakbari , Johan Östman , Ashkan Panahi , Alexandre Graell i Amat

Federated representation learning (FRL) aims to learn personalized federated models with effective feature extraction from local data. FRL algorithms that share the majority of the model parameters face significant challenges with huge…

Machine Learning · Computer Science 2024-10-15 Haolin Yu , Guojun Zhang , Pascal Poupart

Current state-of-the-art deep learning based face recognition (FR) models require a large number of face identities for central training. However, due to the growing privacy awareness, it is prohibited to access the face images on user…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Chih-Ting Liu , Chien-Yi Wang , Shao-Yi Chien , Shang-Hong Lai

Federated learning is a privacy-preserving machine learning technique that learns a shared model across decentralized clients. It can alleviate privacy concerns of personal re-identification, an important computer vision task. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Weiming Zhuang , Yonggang Wen , Xuesen Zhang , Xin Gan , Daiying Yin , Dongzhan Zhou , Shuai Zhang , Shuai Yi

Federated learning (FL) enables distributed learning across edge devices while protecting data privacy. However, the learning accuracy decreases due to the heterogeneity of devices' data, and the computation and communication latency…

Machine Learning · Computer Science 2024-01-17 Xiaonan Liu , Tharmalingam Ratnarajah , Mathini Sellathurai , Yonina C. Eldar

Online intelligent education platforms have generated a vast amount of distributed student learning data. This influx of data presents opportunities for cognitive diagnosis (CD) to assess students' mastery of knowledge concepts while also…

Machine Learning · Computer Science 2025-08-05 Shangshang Yang , Jialin Han , Xiaoshan Yu , Ziwen Wang , Hao Jiang , Haiping Ma , Xingyi Zhang , Geyong Min

The rapid growth of data from edge devices has catalyzed the performance of machine learning algorithms. However, the data generated resides at client devices thus there are majorly two challenge faced by traditional machine learning…

Machine Learning · Computer Science 2024-07-15 Shivam Gupta , Tarushi , Tsering Wangzes , Shweta Jain