English
Related papers

Related papers: Federated Learning on Non-iid Data via Local and G…

200 papers

Federated Learning (FL) has emerged as a means of distributed learning using local data stored at clients with a coordinating server. Recent studies showed that FL can suffer from poor performance and slower convergence when training data…

Machine Learning · Computer Science 2023-08-17 Van Sy Mai , Richard J. La , Tao Zhang

With the growth of machine learning techniques, privacy of data of users has become a major concern. Most of the machine learning algorithms rely heavily on large amount of data which may be collected from various sources. Collecting these…

Machine Learning · Computer Science 2023-11-17 Mahfuzur Rahman Chowdhury , Muhammad Ibrahim

Federated learning is an emerging paradigm for decentralized training of machine learning models on distributed clients, without revealing the data to the central server. Most existing works have focused on horizontal or vertical data…

Machine Learning · Computer Science 2024-04-16 Jaeyeon Jang , Diego Klabjan , Veena Mendiratta , Fanfei Meng

Federated Learning (FL) has emerged as a key approach for distributed machine learning, enhancing online personalization while ensuring user data privacy. Instead of sending private data to a central server as in traditional approaches, FL…

Information Retrieval · Computer Science 2023-09-19 Francesco Fabbri , Xianghang Liu , Jack R. McKenzie , Bartlomiej Twardowski , Tri Kurniawan Wijaya

Existing online knowledge distillation approaches either adopt the student with the best performance or construct an ensemble model for better holistic performance. However, the former strategy ignores other students' information, while the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Shaojie Li , Mingbao Lin , Yan Wang , Yongjian Wu , Yonghong Tian , Ling Shao , Rongrong Ji

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

Federated learning is proposed as an alternative to centralized machine learning since its client-server structure provides better privacy protection and scalability in real-world applications. In many applications, such as smart homes with…

Machine Learning · Computer Science 2022-02-21 Yuchen Zhao , Payam Barnaghi , Hamed Haddadi

Federated learning (FL) is an emerging technique used to collaboratively train a global machine learning model while keeping the data localized on the user devices. The main obstacle to FL's practical implementation is the Non-Independent…

Machine Learning · Computer Science 2022-08-01 Hiep Nguyen , Lam Phan , Harikrishna Warrier , Yogesh Gupta

Federated learning (FL) enables a decentralized machine learning paradigm for multiple clients to collaboratively train a generalized global model without sharing their private data. Most existing works simply propose typical FL systems for…

Machine Learning · Computer Science 2023-11-08 Huy Q. Le , Minh N. H. Nguyen , Chu Myaet Thwal , Yu Qiao , Chaoning Zhang , Choong Seon Hong

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

Machine Learning · Computer Science 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

Federated learning is a paradigm of distributed machine learning in which multiple clients coordinate with a central server to learn a model, without sharing their own training data. Standard federated optimization methods such as Federated…

Machine Learning · Computer Science 2024-05-15 Sohom Mukherjee , Nicolas Loizou , Sebastian U. Stich

Federated learning (FL) has emerged as a promising privacy-preserving distributed machine learning framework recently. It aims at collaboratively learning a shared global model by performing distributed training locally on edge devices and…

Cryptography and Security · Computer Science 2023-04-26 Jingcai Guo , Song Guo , Jie Zhang , Ziming Liu

As a mechanism for devices to update a global model without sharing data, federated learning bridges the tension between the need for data and respect for privacy. However, classic FL methods like Federated Averaging struggle with non-iid…

Machine Learning · Computer Science 2020-06-22 Kavya Kopparapu , Eric Lin

As a promising approach in model compression, knowledge distillation improves the performance of a compact model by transferring the knowledge from a cumbersome one. The kind of knowledge used to guide the training of the student is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Tao Liu , Xi Yang , Chenshu Chen

Machine learning in medical research, by nature, needs careful attention on obeying the regulations of data privacy, making it difficult to train a machine learning model over gathered data from different medical centers. Failure of…

Machine Learning · Computer Science 2021-10-19 Jun Luo , Shandong Wu

Federated learning (FL) is a machine learning methodology that involves the collaborative training of a global model across multiple decentralized clients in a privacy-preserving way. Several FL methods are introduced to tackle…

Machine Learning · Computer Science 2024-12-31 Jordan Slessor , Dezheng Kong , Xiaofen Tang , Zheng En Than , Linglong Kong

This paper investigates the feasibility of federated representation learning under the constraints of communication cost and privacy protection. Existing works either conduct annotation-guided local training which requires frequent…

Machine Learning · Computer Science 2022-01-19 Haizhou Shi , Youcai Zhang , Zijin Shen , Siliang Tang , Yaqian Li , Yandong Guo , Yueting Zhuang

We propose a new optimization formulation for training federated learning models. The standard formulation has the form of an empirical risk minimization problem constructed to find a single global model trained from the private data stored…

Machine Learning · Computer Science 2021-02-15 Filip Hanzely , Peter Richtárik

Federated learning (FL) offers a promising framework for collaborative digital pathology by enabling model training across institutions. However, real-world deployments face heterogeneity arising from diverse multiple instance learning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Luru Jing , Cong Cong , Yanyuan Chen , Yongzhi Cao

Federated Learning is a machine learning paradigm where we aim to train machine learning models in a distributed fashion. Many clients/edge devices collaborate with each other to train a single model on the central. Clients do not share…

Machine Learning · Computer Science 2022-11-28 Mann Patel