English
Related papers

Related papers: Compare Where It Matters: Using Layer-Wise Regular…

200 papers

Federated Learning (FL) is a decentralized machine learning protocol that allows a set of participating agents to collaboratively train a model without sharing their data. This makes FL particularly suitable for settings where data privacy…

Machine Learning · Computer Science 2020-10-30 Mustafa Safa Ozdayi , Murat Kantarcioglu , Rishabh Iyer

Federated learning (FL) addresses data privacy concerns by enabling collaborative training of AI models across distributed data owners. Wide adoption of FL faces the fundamental challenges of data heterogeneity and the large scale of data…

Machine Learning · Computer Science 2023-08-23 Yulan Gao , Zhaoxiang Hou , Chengyi Yang , Zengxiang Li , Han Yu

Federated learning harnesses the power of distributed optimization to train a unified machine learning model across separate clients. However, heterogeneous data distributions and computational workloads can lead to inconsistent updates and…

Machine Learning · Computer Science 2024-10-15 Aayushya Agarwal , Gauri Joshi , Larry Pileggi

Federated learning (FL) has emerged as the predominant approach for collaborative training of neural network models across multiple users, without the need to gather the data at a central location. One of the important challenges in this…

Machine Learning · Computer Science 2021-07-15 Matthias Reisser , Christos Louizos , Efstratios Gavves , Max Welling

With growth in the number of smart devices and advancements in their hardware, in recent years, data-driven machine learning techniques have drawn significant attention. However, due to privacy and communication issues, it is not possible…

Machine Learning · Computer Science 2020-12-10 Mohammad Salehi , Ekram Hossain

Federated Learning (FL) is a prominent framework that enables training a centralized model while securing user privacy by fusing local, decentralized models. In this setting, one major obstacle is data heterogeneity, i.e., each client…

Machine Learning · Computer Science 2022-06-22 Artur Back de Luca , Guojun Zhang , Xi Chen , Yaoliang Yu

Federated Learning (FL) often suffers from severe performance degradation when faced with non-IID data, largely due to local classifier bias. Traditional remedies such as global model regularization or layer freezing either incur high…

Machine Learning · Computer Science 2025-06-11 Sunny Gupta , Nikita Jangid , Amit Sethi

Federated learning is an efficient machine learning tool for dealing with heterogeneous big data and privacy protection. Federated learning methods with regularization can control the level of communications between the central and local…

Machine Learning · Computer Science 2024-11-05 Langming Liu , Dingxuan Zhou

Federated learning is an efficient framework designed to facilitate collaborative model training across multiple distributed devices while preserving user data privacy. A significant challenge of federated learning is data-level…

Machine Learning · Computer Science 2024-08-26 Shunxin Guo , Hongsong Wang , Shuxia Lin , Zhiqiang Kou , Xin Geng

State-of-the-art federated learning methods can perform far worse than their centralized counterparts when clients have dissimilar data distributions. For neural networks, even when centralized SGD easily finds a solution that is…

Machine Learning · Computer Science 2022-10-06 Yaodong Yu , Alexander Wei , Sai Praneeth Karimireddy , Yi Ma , Michael I. Jordan

Data heterogeneity across clients is one of the key challenges in Federated Learning (FL), which may slow down the global model convergence and even weaken global model performance. Most existing approaches tackle the heterogeneity by…

Machine Learning · Computer Science 2023-07-18 Jun Nie , Danyang Xiao , Lei Yang , Weigang Wu

We propose a novel training recipe for federated learning with heterogeneous networks where each device can have different architectures. We introduce training with a side objective to the devices of higher complexities to jointly train…

Machine Learning · Computer Science 2022-07-08 Durmus Alp Emre Acar , Venkatesh Saligrama

Federated learning allows a large number of devices to jointly learn a model without sharing data. In this work, we enable clients with limited computing power to perform action recognition, a computationally heavy task. We first perform…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-27 Pranjal Jain , Shreyas Goenka , Saurabh Bagchi , Biplab Banerjee , Somali Chaterji

Ensuring fairness is critical when applying artificial intelligence to high-stakes domains such as healthcare, where predictive models trained on imbalanced and demographically skewed data risk exacerbating existing disparities. Federated…

Computers and Society · Computer Science 2025-05-15 Qiming Wu , Siqi Li , Doudou Zhou , Nan Liu

Federated learning is a distributed machine learning approach in which a single server and multiple clients collaboratively build machine learning models without sharing datasets on clients. A challenging issue of federated learning is data…

Machine Learning · Computer Science 2022-06-28 Koji Matsuda , Yuya Sasaki , Chuan Xiao , Makoto Onizuka

Federated learning learns from scattered data by fusing collaborative models from local nodes. However, due to chaotic information distribution, the model fusion may suffer from structural misalignment with regard to unmatched parameters.…

Machine Learning · Computer Science 2022-03-22 Fuxun Yu , Weishan Zhang , Zhuwei Qin , Zirui Xu , Di Wang , Chenchen Liu , Zhi Tian , Xiang Chen

Federated learning is a collaborative model training method that iterates model updates by multiple clients and aggregation of the updates by a central server. Device and statistical heterogeneity of participating clients cause significant…

Machine Learning · Computer Science 2023-08-29 Ayano Nakai-Kasai , Tadashi Wadayama

Fairness has emerged as one of the key challenges in federated learning. In horizontal federated settings, data heterogeneity often leads to substantial performance disparities across clients, raising concerns about equitable model…

Machine Learning · Computer Science 2025-07-18 ShanBin Liu

The future of machine learning lies in moving data collection along with training to the edge. Federated Learning, for short FL, has been recently proposed to achieve this goal. The principle of this approach is to aggregate models learned…

Machine Learning · Computer Science 2023-07-13 Adnan Ben Mansour , Gaia Carenini , Alexandre Duplessis

Analyzing the similarity of internal representations has been an important technique for understanding the behavior of deep neural networks. Most existing methods for analyzing the similarity between representations of high dimensions, such…

Artificial Intelligence · Computer Science 2025-05-26 Jiachen Jiang , Jinxin Zhou , Zhihui Zhu