English
Related papers

Related papers: Federated Learning with Label-Masking Distillation

200 papers

Detection models trained by one party (including server) may face severe performance degradation when distributed to other users (clients). Federated learning can enable multi-party collaborative learning without leaking client data. In…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Shangchao Su , Bin Li , Chengzhi Zhang , Mingzhao Yang , Xiangyang Xue

Federated learning (FL) typically faces data heterogeneity, i.e., distribution shifting among clients. Sharing clients' information has shown great potentiality in mitigating data heterogeneity, yet incurs a dilemma in preserving privacy…

Machine Learning · Computer Science 2023-10-12 Zhiqin Yang , Yonggang Zhang , Yu Zheng , Xinmei Tian , Hao Peng , Tongliang Liu , Bo Han

Federated learning (FL) enables multiple clients to collaboratively train a global model while keeping local data decentralized. Data heterogeneity (non-IID) across clients has imposed significant challenges to FL, which makes local models…

Machine Learning · Computer Science 2025-04-22 Yuting He , Yiqiang Chen , XiaoDong Yang , Hanchao Yu , Yi-Hua Huang , Yang Gu

This paper investigates the feasibility of federated representation learning under the constraints of communication cost and privacy protection. Existing works either conduct annotation-guided local training which requires frequent…

Machine Learning · Computer Science 2022-01-19 Haizhou Shi , Youcai Zhang , Zijin Shen , Siliang Tang , Yaqian Li , Yandong Guo , Yueting Zhuang

Federated Learning (FL) is a pioneering approach in distributed machine learning, enabling collaborative model training across multiple clients while retaining data privacy. However, the inherent heterogeneity due to imbalanced resource…

Machine Learning · Computer Science 2024-11-18 Suraj Racha , Shubh Gupta , Humaira Firdowse , Aastik Solanki , Ganesh Ramakrishnan , Kshitij S. Jadhav

Federated Learning (FL) is an emerging machine learning paradigm that enables the collaborative training of a shared global model across distributed clients while keeping the data decentralized. Recent works on designing systems for…

Machine Learning · Computer Science 2024-02-13 Mohak Chadha , Pulkit Khera , Jianfeng Gu , Osama Abboud , Michael Gerndt

Privacy-preserving machine learning has become a key conundrum for multi-party artificial intelligence. Federated learning (FL) and Split Learning (SL) are two frameworks that enable collaborative learning while keeping the data private (on…

Machine Learning · Computer Science 2022-12-15 Frédéric Berdoz , Abhishek Singh , Martin Jaggi , Ramesh Raskar

Federated learning (FL) offers a privacy-preserving framework for distributed machine learning, enabling collaborative model training across diverse clients without centralizing sensitive data. However, statistical heterogeneity,…

Machine Learning · Statistics 2025-04-08 Hengrui Hu , Anai N. Kothari , Anjishnu Banerjee

Personalization in federated learning (FL) functions as a coordinator for clients with high variance in data or behavior. Ensuring the convergence of these clients' models relies on how closely users collaborate with those with similar…

Machine Learning · Computer Science 2023-02-24 Eunjeong Jeong , Marios Kountouris

Federated Learning (FL) seeks to train a model collaboratively without sharing private training data from individual clients. Despite its promise, FL encounters challenges such as high communication costs for large-scale models and the…

Machine Learning · Computer Science 2024-04-15 Lin Li , Jianping Gou , Baosheng Yu , Lan Du , Zhang Yiand Dacheng Tao

Federated Learning (FL) is a novel approach that allows for collaborative machine learning while preserving data privacy by leveraging models trained on decentralized devices. However, FL faces challenges due to non-uniformly distributed…

Machine Learning · Computer Science 2024-04-16 Changlin Song , Divya Saxena , Jiannong Cao , Yuqing Zhao

While Federated Learning (FL) is gaining popularity for training machine learning models in a decentralized fashion, numerous challenges persist, such as asynchronization, computational expenses, data heterogeneity, and gradient and…

Machine Learning · Computer Science 2025-03-13 Chun-Yin Huang , Ruinan Jin , Can Zhao , Daguang Xu , Xiaoxiao Li

Federated Learning (FL) enables multiple machines to collaboratively train a machine learning model without sharing of private training data. Yet, especially for heterogeneous models, a key bottleneck remains the transfer of knowledge…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Sunny Soni , Aaqib Saeed , Yuki M. Asano

Federated learning (FL) aims to collaboratively train a shared model across multiple clients without transmitting their local data. Data heterogeneity is a critical challenge in realistic FL settings, as it causes significant performance…

Machine Learning · Computer Science 2023-11-15 Yuwei Wang , Runhan Li , Hao Tan , Xuefeng Jiang , Sheng Sun , Min Liu , Bo Gao , Zhiyuan Wu

Recently, innovative model aggregation methods based on knowledge distillation (KD) have been proposed for federated learning (FL). These methods not only improved the robustness of model aggregation over heterogeneous learning environment,…

Machine Learning · Computer Science 2023-12-29 Ho Man Kwan , Shenghui Song

Federated Learning (FL) allows edge devices (or clients) to keep data locally while simultaneously training a shared high-quality global model. However, current research is generally based on an assumption that the training data of local…

Machine Learning · Computer Science 2021-10-27 Zhe Zhang , Shiyao Ma , Jiangtian Nie , Yi Wu , Qiang Yan , Xiaoke Xu , Dusit Niyato

Model-Heterogeneous Federated Learning (Hetero-FL) has attracted growing attention for its ability to aggregate knowledge from heterogeneous models while keeping private data locally. To better aggregate knowledge from clients, ensemble…

Machine Learning · Computer Science 2025-10-15 Yichen Li , Xiuying Wang , Wenchao Xu , Haozhao Wang , Yining Qi , Jiahua Dong , Ruixuan Li

Federated learning (FL) is a decentralized privacy-preserving learning technique in which clients learn a joint collaborative model through a central aggregator without sharing their data. In this setting, all clients learn a single common…

Machine Learning · Computer Science 2021-06-01 Siddharth Divi , Habiba Farrukh , Berkay Celik

Knowledge distillation (KD) can enable collaborative learning among distributed clients that have different model architectures and do not share their local data and model parameters with others. Each client updates its local model using…

Machine Learning · Computer Science 2024-06-04 Pengchao Han , Xingyan Shi , Jianwei Huang

The purpose of federated learning is to enable multiple clients to jointly train a machine learning model without sharing data. However, the existing methods for training an image segmentation model have been based on an unrealistic…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Jeffry Wicaksana , Zengqiang Yan , Dong Zhang , Xijie Huang , Huimin Wu , Xin Yang , Kwang-Ting Cheng