中文
相关论文

相关论文: Weight Divergence Driven Divide-and-Conquer Approa…

200 篇论文

Federated learning (FL) learns a model jointly from a set of participating devices without sharing each other's privately held data. The characteristics of non-i.i.d. data across the network, low device participation, high communication…

机器学习 · 计算机科学 2024-01-02 Zhaonan Qu , Kaixiang Lin , Zhaojian Li , Jiayu Zhou , Zhengyuan Zhou

We propose a simple new aggregation strategy for federated learning that won the MICCAI Federated Tumor Segmentation Challenge 2021 (FETS), the first ever challenge on Federated Learning in the Machine Learning community. Our method…

Federated Learning (FL) is a machine-learning approach enabling collaborative model training across multiple decentralized edge devices that hold local data samples, all without exchanging these samples. This collaborative process occurs…

机器学习 · 计算机科学 2024-01-02 Venkataraman Natarajan Iyer

Efficient deployment of deep neural networks across many devices and resource constraints, particularly on edge devices, is one of the most challenging problems in the presence of data-privacy preservation issues. Conventional approaches…

机器学习 · 计算机科学 2022-10-07 Taehyeon Kim , Se-Young Yun

Federated learning (FL) is a machine learning paradigm where a shared central model is learned across distributed edge devices while the training data remains on these devices. Federated Averaging (FedAvg) is the leading optimization method…

分布式、并行与集群计算 · 计算机科学 2020-10-22 Yujing Chen , Yue Ning , Martin Slawski , Huzefa Rangwala

Current data compression methods, such as sparsification in Federated Averaging (FedAvg), effectively enhance the communication efficiency of Federated Learning (FL). However, these methods encounter challenges such as the straggler problem…

分布式、并行与集群计算 · 计算机科学 2024-08-28 Zichen Tang , Junlin Huang , Rudan Yan , Yuxin Wang , Zhenheng Tang , Shaohuai Shi , Amelie Chi Zhou , Xiaowen Chu

Federated Learning (FL) has emerged as a fundamental learning paradigm to harness massive data scattered at geo-distributed edge devices in a privacy-preserving way. Given the heterogeneous deployment of edge devices, however, their data…

网络与互联网体系结构 · 计算机科学 2024-05-30 Mulei Ma , Chenyu Gong , Liekang Zeng , Yang Yang , Liantao Wu

This paper introduces a new federated learning scheme that leverages over-the-air computation. A novel feature of this scheme is the proposal to employ adaptive weights during aggregation, a facet treated as predefined in other over-the-air…

信息论 · 计算机科学 2024-09-13 Seyed Mohammad Azimi-Abarghouyi , Leandros Tassiulas

This paper presents FedPID, our submission to the Federated Tumor Segmentation Challenge 2024 (FETS24). Inspired by FedCostWAvg and FedPIDAvg, our winning contributions to FETS21 and FETS2022, we propose an improved aggregation strategy for…

In distributed and federated learning, heterogeneity across data sources remains a major obstacle to effective model aggregation and convergence. We focus on feature heterogeneity and introduce energy distance as a sensitive measure for…

机器学习 · 统计学 2025-01-28 Mengchen Fan , Baocheng Geng , Roman Shterenberg , Joseph A. Casey , Zhong Chen , Keren Li

Federated learning enables a large amount of edge computing devices to learn a model without data sharing jointly. As a leading algorithm in this setting, Federated Average FedAvg, which runs Stochastic Gradient Descent (SGD) in parallel on…

机器学习 · 计算机科学 2022-11-04 Xiaoxiao Li , Zhao Song , Runzhou Tao , Guangyi Zhang

By leveraging neural networks, the emerging field of scientific machine learning (SciML) offers novel approaches to address complex problems governed by partial differential equations (PDEs). In practical applications, challenges arise due…

机器学习 · 计算机科学 2024-10-18 Handi Zhang , Langchen Liu , Lu Lu

Federated Learning (FL) is a distributed learning paradigm that enables multiple clients to collaborate on building a machine learning model without sharing their private data. Although FL is considered privacy-preserved by design, recent…

机器学习 · 计算机科学 2026-05-18 Yongcun Song , Ziqi Wang , Enrique Zuazua

Federated learning is a promising paradigm that allows multiple clients to collaboratively train a model without sharing the local data. However, the presence of heterogeneous devices in federated learning, such as mobile phones and IoT…

机器学习 · 计算机科学 2025-09-03 Kai Zhang , Yutong Dai , Hongyi Wang , Eric Xing , Xun Chen , Lichao Sun

The rapid growth of Internet of Things (IoT) devices has generated vast amounts of data, leading to the emergence of federated learning as a novel distributed machine learning paradigm. Federated learning enables model training at the edge,…

信号处理 · 电气工程与系统科学 2023-11-03 Abdelaziz Salama , Achilleas Stergioulis , Syed Ali Zaidi , Des McLernon

Federated Learning (FL) is a distributed learning paradigm that enables a large number of resource-limited nodes to collaboratively train a model without data sharing. The non-independent-and-identically-distributed (non-i.i.d.) data…

机器学习 · 计算机科学 2022-02-04 Hongda Wu , Ping Wang

As a promising distributed machine learning paradigm, Federated Learning (FL) has attracted increasing attention to deal with data silo problems without compromising user privacy. By adopting the classic one-to-multi training scheme (i.e.,…

机器学习 · 计算机科学 2024-07-08 Ming Hu , Peiheng Zhou , Zhihao Yue , Zhiwei Ling , Yihao Huang , Anran Li , Yang Liu , Xiang Lian , Mingsong Chen

In this paper, we investigate Federated Learning (FL), a paradigm of machine learning that allows for decentralized model training on devices without sharing raw data, there by preserving data privacy. In particular, we compare two…

机器学习 · 计算机科学 2023-09-06 Hamza Reguieg , Mohammed El Hanjri , Mohamed El Kamili , Abdellatif Kobbane

Existing theory predicts that data heterogeneity will degrade the performance of the Federated Averaging (FedAvg) algorithm in federated learning. However, in practice, the simple FedAvg algorithm converges very well. This paper explains…

机器学习 · 计算机科学 2022-06-13 Jianyu Wang , Rudrajit Das , Gauri Joshi , Satyen Kale , Zheng Xu , Tong Zhang

Data privacy is a major concern in industries such as healthcare or finance. The requirement to safeguard privacy is essential to prevent data breaches and misuse, which can have severe consequences for individuals and organisations.…

机器学习 · 计算机科学 2024-12-18 Jose L Salmeron , Irina Arévalo