中文
相关论文

相关论文: FedMAE: Federated Self-Supervised Learning with On…

200 篇论文

Federated Learning (FL) has emerged as a potent framework for training models across distributed data sources while maintaining data privacy. Nevertheless, it faces challenges with limited high-quality labels and non-IID client data,…

计算机视觉与模式识别 · 计算机科学 2024-01-04 Taehyeon Kim , Eric Lin , Junu Lee , Christian Lau , Vaikkunth Mugunthan

Federated learning (FL) is a decentralized collaborative machine learning (ML) technique. It provides a solution to the issues of isolated data islands and data privacy leakage in industrial ML practices. One major challenge in FL is…

机器学习 · 计算机科学 2025-06-26 Yushan Zhao , Jinyuan He , Donglai Chen , Weijie Luo , Chong Xie , Ri Zhang , Yonghong Chen , Yan Xu

Federated Learning (FL) is a promising distributed method for edge-level machine learning, particularly for privacysensitive applications such as those in military and medical domains, where client data cannot be shared or transferred to a…

机器学习 · 计算机科学 2024-06-27 Lucas Grativol Ribeiro , Mathieu Leonardon , Guillaume Muller , Virginie Fresse , Matthieu Arzel

Graph self-supervised learning (SSL), including contrastive and generative approaches, offers great potential to address the fundamental challenge of label scarcity in real-world graph data. Among both sets of graph SSL techniques, the…

机器学习 · 计算机科学 2023-04-12 Zhenyu Hou , Yufei He , Yukuo Cen , Xiao Liu , Yuxiao Dong , Evgeny Kharlamov , Jie Tang

Combining different data modalities enables deep neural networks to tackle complex tasks more effectively, making multimodal learning increasingly popular. To harness multimodal data closer to end users, it is essential to integrate…

机器学习 · 计算机科学 2024-10-22 Ye Lin Tun , Chu Myaet Thwal , Minh N. H. Nguyen , Choong Seon Hong

Federated learning enables the deployment of machine learning to problems for which centralized data collection is impractical. Adding differential privacy guarantees bounds on privacy while data are contributed to a global model. Adding…

机器学习 · 计算机科学 2022-02-22 Andrew Silva , Katherine Metcalf , Nicholas Apostoloff , Barry-John Theobald

We present a novel frequency-based Self-Supervised Learning (SSL) approach that significantly enhances its efficacy for pre-training. Prior work in this direction masks out pre-defined frequencies in the input image and employs a…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Amin Karimi Monsefi , Mengxi Zhou , Nastaran Karimi Monsefi , Ser-Nam Lim , Wei-Lun Chao , Rajiv Ramnath

Self-supervised pre-training for images without labels has recently achieved promising performance in image classification. The success of transformer-based methods, ViT and MAE, draws the community's attention to the design of backbone…

计算机视觉与模式识别 · 计算机科学 2022-05-31 Jiantao Wu , Shentong Mo

The fusion of complementary multimodal information is crucial in computational pathology for accurate diagnostics. However, existing multimodal learning approaches necessitate access to users' raw data, posing substantial privacy risks.…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Yuanzhe Peng , Jieming Bian , Jie Xu

Federated learning (FL) enables edge-devices to collaboratively learn a model without disclosing their private data to a central aggregating server. Most existing FL algorithms require models of identical architecture to be deployed across…

机器学习 · 计算机科学 2022-04-28 Yae Jee Cho , Andre Manoel , Gauri Joshi , Robert Sim , Dimitrios Dimitriadis

Federated Learning (FL) with pre-trained Vision-Language Models (VLMs) has emerged as a promising paradigm for various downstream tasks. By leveraging its strong representations, recent studies improve task adaptation under insufficient…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Yuting Ma , Lechao Cheng , Xiaohua Xu

Federated learning (FL) enables distributed computation of machine learning models over various disparate, remote data sources, without requiring to transfer any individual data to a centralized location. This results in an improved…

Federated Learning (FL) trains machine learning models on edge devices with distributed data. However, the computational and memory limitations of these devices restrict the training of large models using FL. Split Federated Learning (SFL)…

机器学习 · 计算机科学 2025-04-02 Di Wu , Weibo He , Wanglei Feng , Zhenyu Wen , Bin Qian , Blesson Varghese

Federated Learning is a machine learning paradigm where we aim to train machine learning models in a distributed fashion. Many clients/edge devices collaborate with each other to train a single model on the central. Clients do not share…

机器学习 · 计算机科学 2022-11-28 Mann Patel

Self-supervised frameworks for representation learning have recently stirred up interest among the remote sensing community, given their potential to mitigate the high labeling costs associated with curating large satellite image datasets.…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Hugo Chan-To-Hing , Bharadwaj Veeravalli

Personalized Federated Learning (PFL) aims to train customized models for clients with highly heterogeneous data distributions while preserving data privacy. Existing approaches often rely on heuristics like clustering or model…

人工智能 · 计算机科学 2026-03-13 Ping Guo , Tiantian Zhang , Xi Lin , Xiang Li , Zhi-Ri Tang , Qingfu Zhang

Federated Learning (FL) enables collaborative training of autonomous driving (AD) models across distributed vehicles while preserving data privacy. However, FL encounters critical challenges such as poor generalization and slow convergence…

机器人学 · 计算机科学 2025-12-09 Wei-Bin Kou , Guangxu Zhu , Bingyang Cheng , Chen Zhang , Yik-Chung Wu , Jianping Wang

Recent Mixture-of-Experts (MoE)-based large language models (LLMs) such as Qwen-MoE and DeepSeek-MoE are transforming generative AI in natural language processing. However, these models require vast and diverse training data. Federated…

机器学习 · 计算机科学 2026-02-17 Songyuan Li , Jia Hu , Ahmed M. Abdelmoniem , Geyong Min , Haojun Huang , Jiwei Huang

Most existing federated learning methods assume that clients have fully labeled data to train on, while in reality, it is hard for the clients to get task-specific labels due to users' privacy concerns, high labeling costs, or lack of…

机器学习 · 计算机科学 2023-02-24 Nan Yang , Dong Yuan , Charles Z Liu , Yongkun Deng , Wei Bao

The ubiquity of edge devices has led to a growing amount of unlabeled data produced at the edge. Deep learning models deployed on edge devices are required to learn from these unlabeled data to continuously improve accuracy. Self-supervised…

计算机视觉与模式识别 · 计算机科学 2023-05-26 Jiahe Shi , Yawen Wu , Dewen Zeng , Jun Tao , Jingtong Hu , Yiyu Shi