English
Related papers

Related papers: FedMAE: Federated Self-Supervised Learning with On…

200 papers

In the realm of medical imaging, leveraging large-scale datasets from various institutions is crucial for developing precise deep learning models, yet privacy concerns frequently impede data sharing. federated learning (FL) emerges as a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Zhengtao Yao , Hong Nguyen , Ajitesh Srivastava , Jose Luis Ambite

Medical image segmentation is clinically important, yet data privacy and the cost of expert annotation limit the availability of labeled data. Federated semi-supervised learning (FSSL) offers a solution but faces two challenges:…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Sahar Nasirihaghighi , Negin Ghamsarian , Yiping Li , Marcel Breeuwer , Raphael Sznitman , Klaus Schoeffmann

Federated learning is proposed as an alternative to centralized machine learning since its client-server structure provides better privacy protection and scalability in real-world applications. In many applications, such as smart homes with…

Machine Learning · Computer Science 2022-02-21 Yuchen Zhao , Payam Barnaghi , Hamed Haddadi

Transformer-based foundation models (FMs) have recently demonstrated remarkable performance in medical image segmentation. However, scaling these models is challenging due to the limited size of medical image datasets within isolated…

Image and Video Processing · Electrical Eng. & Systems 2025-03-20 Yumin Zhang , Yan Gao , Haoran Duan , Hanqing Guo , Tejal Shah , Rajiv Ranjan , Bo Wei

Unsupervised pre-training methods for large vision models have shown to enhance performance on downstream supervised tasks. Developing similar techniques for satellite imagery presents significant opportunities as unlabelled data is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yezhen Cong , Samar Khanna , Chenlin Meng , Patrick Liu , Erik Rozi , Yutong He , Marshall Burke , David B. Lobell , Stefano Ermon

Federated Learning (FL) has emerged as a promising solution for collaborative training of large language models (LLMs). However, the integration of LLMs into FL introduces new challenges, particularly concerning the evaluation of LLMs.…

Artificial Intelligence · Computer Science 2024-04-19 Yuanqin He , Yan Kang , Lixin Fan , Qiang Yang

Federated learning (FL) has obtained tremendous progress in providing collaborative training solutions for distributed data silos with privacy guarantees. However, few existing works explore a more realistic scenario where the clients hold…

Machine Learning · Computer Science 2024-06-18 Liwei Che , Jiaqi Wang , Xinyue Liu , Fenglong Ma

Federated learning (FL) has shown great potential in medical image computing since it provides a decentralized learning paradigm that allows multiple clients to train a model collaboratively without privacy leakage. However, current studies…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Meilu Zhu , Qiushi Yang , Zhifan Gao , Yixuan Yuan , Jun Liu

Self-supervised learning in the federated learning paradigm has been gaining a lot of interest both in industry and research due to the collaborative learning capability on unlabeled yet isolated data. However, self-supervised based…

Machine Learning · Computer Science 2025-02-05 Sunder Ali Khowaja , Kapal Dev , Syed Muhammad Anwar , Marius George Linguraru

Vision-language-action (VLA) models have significantly advanced robotic manipulation by enabling robots to interpret language instructions for task execution. However, training these models often relies on large-scale user-specific data,…

Robotics · Computer Science 2025-08-05 Cui Miao , Tao Chang , Meihan Wu , Hongbin Xu , Chun Li , Ming Li , Xiaodong Wang

Masked autoencoder (MAE) is a promising self-supervised pre-training technique that can improve the representation learning of a neural network without human intervention. However, applying MAE directly to volumetric medical images poses…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Jia-Xin Zhuang , Luyang Luo , Hao Chen

Federated learning enables many local devices to train a deep learning model jointly without sharing the local data. Currently, most of federated training schemes learns a global model by averaging the parameters of local models. However,…

Machine Learning · Computer Science 2021-10-26 Zhenwei Dai , Chen Dun , Yuxin Tang , Anastasios Kyrillidis , Anshumali Shrivastava

Federated Learning (FL) enables decentralized machine learning while preserving data privacy, making it ideal for sensitive applications where data cannot be shared. While FL has been widely studied in supervised contexts, its application…

Machine Learning · Computer Science 2026-01-09 Mirko Nardi , Lorenzo Valerio , Andrea Passarella

Federated Learning (FL) is designed as a decentralized, privacy-preserving machine learning paradigm that enables multiple clients to collaboratively train a model without sharing their data. In real-world scenarios, however, clients often…

Machine Learning · Computer Science 2025-10-17 Maulidi Adi Prasetia , Muhamad Risqi U. Saputra , Guntur Dharma Putra

Previous studies on federated learning (FL) often encounter performance degradation due to data heterogeneity among different clients. In light of the recent advances in multimodal large language models (MLLMs), such as GPT-4v and LLaVA,…

Artificial Intelligence · Computer Science 2024-12-03 Jianyi Zhang , Hao Frank Yang , Ang Li , Xin Guo , Pu Wang , Haiming Wang , Yiran Chen , Hai Li

The primary challenge in Federated Learning (FL) is to model non-IID distributions across clients, whose fine-grained structure is important to improve knowledge sharing. For example, some knowledge is globally shared across all clients,…

Machine Learning · Computer Science 2024-05-28 Shutong Chen , Tianyi Zhou , Guodong Long , Jie Ma , Jing Jiang , Chengqi Zhang

Federated learning (FL) has been proposed to allow collaborative training of machine learning (ML) models among multiple parties where each party can keep its data private. In this paradigm, only model updates, such as model weights or…

Machine Learning · Computer Science 2021-06-18 Runhua Xu , Nathalie Baracaldo , Yi Zhou , Ali Anwar , James Joshi , Heiko Ludwig

Federated Learning (FL) has emerged as a groundbreaking distributed learning paradigm enabling clients to train a global model collaboratively without exchanging data. Despite enhancing privacy and efficiency in information retrieval and…

Machine Learning · Computer Science 2024-10-30 Long Tan Le , Tuan Dung Nguyen , Tung-Anh Nguyen , Choong Seon Hong , Suranga Seneviratne , Wei Bao , Nguyen H. Tran

Federated Learning (FL) facilitates collaborative training of a shared global model without exposing clients' private data. In practical FL systems, clients (e.g., edge servers, smartphones, and wearables) typically have disparate system…

Machine Learning · Computer Science 2025-03-03 Leming Shen , Qiang Yang , Kaiyan Cui , Yuanqing Zheng , Xiao-Yong Wei , Jianwei Liu , Jinsong Han

Federated Learning (FL) is a novel machine learning approach that allows the model trainer to access more data samples, by training the model across multiple decentralized data sources, while data access constraints are in place. Such…

Computation and Language · Computer Science 2022-11-18 Andre Manoel , Mirian Hipolito Garcia , Tal Baumel , Shize Su , Jialei Chen , Dan Miller , Danny Karmon , Robert Sim , Dimitrios Dimitriadis