English
Related papers

Related papers: Rethinking Federated Graph Foundation Models: A Gr…

200 papers

In the pursuit of refining precise perception models for fully autonomous driving, continual online model training becomes essential. Federated Learning (FL) within vehicular networks offers an efficient mechanism for model training while…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Ahmad Khalil , Tizian Dege , Pegah Golchin , Rostyslav Olshevskyi , Antonio Fernandez Anta , Tobias Meuser

Vision-Language Models (VLMs) have demonstrated remarkable capabilities in cross-modal understanding and generation by integrating visual and textual information. While instruction tuning and parameter-efficient fine-tuning methods have…

Machine Learning · Computer Science 2025-06-12 Weiying Zheng , Ziyue Lin , Pengxin Guo , Yuyin Zhou , Feifei Wang , Liangqiong Qu

Increasing concerns and regulations about data privacy and sparsity necessitate the study of privacy-preserving, decentralized learning methods for natural language processing (NLP) tasks. Federated learning (FL) provides promising…

Transformer-based foundation models (FMs) have recently demonstrated remarkable performance in medical image segmentation. However, scaling these models is challenging due to the limited size of medical image datasets within isolated…

Image and Video Processing · Electrical Eng. & Systems 2025-03-20 Yumin Zhang , Yan Gao , Haoran Duan , Hanqing Guo , Tejal Shah , Rajiv Ranjan , Bo Wei

Knowledge Graph Foundation Models (KGFMs) have shown promise in enabling zero-shot reasoning over unseen graphs by learning transferable patterns. However, most existing KGFMs rely solely on graph structure, overlooking the rich semantic…

Computation and Language · Computer Science 2025-09-22 Arvindh Arun , Sumit Kumar , Mojtaba Nayyeri , Bo Xiong , Ponnurangam Kumaraguru , Antonio Vergari , Steffen Staab

Federated learning~(FL) has recently attracted increasing attention from academia and industry, with the ultimate goal of achieving collaborative training under privacy and communication constraints. Existing iterative model averaging based…

Machine Learning · Computer Science 2022-07-21 Yuanhao Xiong , Ruochen Wang , Minhao Cheng , Felix Yu , Cho-Jui Hsieh

We address the problem of federated domain generalization in an unsupervised setting for the first time. We first theoretically establish a connection between domain shift and alignment of gradients in unsupervised federated learning and…

Machine Learning · Computer Science 2025-01-06 Farhad Pourpanah , Mahdiyar Molahasani , Milad Soltany , Michael Greenspan , Ali Etemad

Federated Learning (FL) deals with learning a central model (i.e. the server) in privacy-constrained scenarios, where data are stored on multiple devices (i.e. the clients). The central model has no direct access to the data, but only to…

Machine Learning · Computer Science 2021-05-03 Debora Caldarola , Massimiliano Mancini , Fabio Galasso , Marco Ciccone , Emanuele Rodolà , Barbara Caputo

Retrieval-augmented generation (RAG) has emerged as a paradigm for grounding large language models in external knowledge, yet most existing RAG systems assume centralized knowledge access and ample computation. These assumptions break down…

Information Retrieval · Computer Science 2026-05-28 Tianhao Gao , Kai Yang , Yiyang Li

Federated Learning is a widely adopted method to train neural networks over distributed data. One main limitation is the performance degradation that occurs when data is heterogeneously distributed. While many works have attempted to…

Machine Learning · Computer Science 2024-06-12 Ha Min Son , Moon Hyun Kim , Tai-Myoung Chung

Federated Learning (FL) enables a group of clients to collaboratively train a model without sharing individual data, but its performance drops when client data are heterogeneous. Clustered FL tackles this by grouping similar clients.…

Machine Learning · Computer Science 2026-03-02 Anik Pramanik , Murat Kantarcioglu , Vincent Oria , Shantanu Sharma

Graph foundation models (GFMs) have recently gained significant attention. However, the unique data processing and evaluation setups employed by different studies hinder a deeper understanding of their progress. Additionally, current…

Federated Learning (FL) aggregates locally trained models from individual clients to construct a global model. While FL enables learning a model with data privacy, it often suffers from significant performance degradation when clients have…

Machine Learning · Computer Science 2024-03-29 Gihun Lee , Minchan Jeong , Sangmook Kim , Jaehoon Oh , Se-Young Yun

While large pre-trained models have achieved impressive performance across AI tasks, their deployment in privacy-sensitive and distributed environments remains challenging. Federated learning (FL) offers a viable solution by enabling…

Machine Learning · Computer Science 2025-08-26 Ruofan Jia , Weiying Xie , Jie Lei , Jitao Ma , Haonan Qin , Leyuan Fang

Federated learning (FL) is a popular privacy-preserving paradigm that enables distributed clients to collaboratively train models with a central server while keeping raw data locally. In practice, distinct model architectures, varying data…

Machine Learning · Computer Science 2024-05-28 Yuting Ma , Lechao Cheng , Yaxiong Wang , Zhun Zhong , Xiaohua Xu , Meng Wang

In this letter, we design a federated contrastive learning (FedCL) framework aimed at supporting personalized semantic communication. Our FedCL enables collaborative training of local semantic encoders across multiple clients and a global…

Signal Processing · Electrical Eng. & Systems 2024-06-14 Yining Wang , Wanli Ni , Wenqiang Yi , Xiaodong Xu , Ping Zhang , Arumugam Nallanathan

Combining multiple knowledge graphs (KGs) across linguistic boundaries is a persistent challenge due to semantic heterogeneity and the complexity of graph environments. We propose a framework for cross-lingual graph fusion, leveraging the…

Computation and Language · Computer Science 2026-03-24 Kaung Myat Kyaw , Khush Agarwal , Jonathan Chan

Federated Learning (FL) enables collaborative model training across multiple clients without sharing their private data. However, data heterogeneity across clients leads to client drift, which degrades the overall generalization performance…

Machine Learning · Computer Science 2026-03-02 Alina Devkota , Jacob Thrasher , Donald Adjeroh , Binod Bhattarai , Prashnna K. Gyawali

Graphs are crucial for modeling relational and biological data. As datasets grow larger in real-world scenarios, the risk of exposing sensitive information increases, making privacy-preserving training methods like federated learning (FL)…

Machine Learning · Computer Science 2025-01-24 Emir Ceyani , Han Xie , Baturalp Buyukates , Carl Yang , Salman Avestimehr

Federated learning (FL) is an emerging machine learning paradigm in which a central server coordinates multiple participants (clients) collaboratively to train on decentralized data. In practice, FL often faces statistical, system, and…

Machine Learning · Computer Science 2024-02-13 Liping Yi , Han Yu , Gang Wang , Xiaoguang Liu , Xiaoxiao Li