English
Related papers

Related papers: FedDANE: A Federated Newton-Type Method

200 papers

Federated learning allows a large number of devices to jointly learn a model without sharing data. In this work, we enable clients with limited computing power to perform action recognition, a computationally heavy task. We first perform…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-27 Pranjal Jain , Shreyas Goenka , Saurabh Bagchi , Biplab Banerjee , Somali Chaterji

Federated Learning (FL) is a distributed machine learning approach that enables model training in communication efficient and privacy-preserving manner. The standard optimization method in FL is Federated Averaging (FedAvg), which performs…

Machine Learning · Computer Science 2023-09-21 Zeyi Tao , Jindi Wu , Qun Li

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

Machine Learning · Computer Science 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

Federated learning has emerged in the last decade as a distributed optimization paradigm due to the rapidly increasing number of portable devices able to support the heavy computational needs related to the training of machine learning…

Machine Learning · Computer Science 2024-10-10 Emanuel Buttaci , Giuseppe Carlo Calafiore

Federated Learning (FL) has become a popular paradigm for learning from distributed data. To effectively utilize data at different devices without moving them to the cloud, algorithms such as the Federated Averaging (FedAvg) have adopted a…

Machine Learning · Computer Science 2021-11-24 Xinwei Zhang , Mingyi Hong , Sairaj Dhople , Wotao Yin , Yang Liu

Federated learning is a distributed, privacy-aware learning scenario which trains a single model on data belonging to several clients. Each client trains a local model on its data and the local models are then aggregated by a central party.…

Machine Learning · Computer Science 2020-01-01 Hesham Mostafa

Federated Learning (FL) is a variant of distributed learning where edge devices collaborate to learn a model without sharing their data with the central server or each other. We refer to the process of training multiple independent models…

Machine Learning · Computer Science 2022-09-22 Neelkamal Bhuyan , Sharayu Moharir , Gauri Joshi

The statistical heterogeneity of the non-independent and identically distributed (non-IID) data in local clients significantly limits the performance of federated learning. Previous attempts like FedProx, SCAFFOLD, MOON, FedNova and FedDyn…

Machine Learning · Computer Science 2022-12-15 Ziqing Fan , Yanfeng Wang , Jiangchao Yao , Lingjuan Lyu , Ya Zhang , Qi Tian

Federated Learning (FL) enables the multiple participating devices to collaboratively contribute to a global neural network model while keeping the training data locally. Unlike the centralized training setting, the non-IID and imbalanced…

Machine Learning · Computer Science 2024-04-16 Moming Duan , Duo Liu , Xinyuan Ji , Renping Liu , Liang Liang , Xianzhang Chen , Yujuan Tan

Federated Learning (FL) is a distributed machine learning strategy, developed for settings where training data is owned by distributed devices and cannot be shared. FL circumvents this constraint by carrying out model training in…

Machine Learning · Computer Science 2025-01-24 Maria Hartmann , Grégoire Danoy , Pascal Bouvry

Federated learning is a distributed machine learning paradigm, which aims to train a model using the local data of many distributed clients. A key challenge in federated learning is that the data samples across the clients may not be…

Machine Learning · Computer Science 2022-06-27 Farzan Farnia , Amirhossein Reisizadeh , Ramtin Pedarsani , Ali Jadbabaie

Federated learning is a distributed paradigm that allows multiple parties to collaboratively train deep models without exchanging the raw data. However, the data distribution among clients is naturally non-i.i.d., which leads to severe…

Machine Learning · Computer Science 2023-01-31 Tianfei Zhou , Ender Konukoglu

Federated learning is an emerging distributed machine learning framework aiming at protecting data privacy. Data heterogeneity is one of the core challenges in federated learning, which could severely degrade the convergence rate and…

Machine Learning · Statistics 2025-11-27 Feifei Wang , Huiyun Tang , Yang Li

The DANE algorithm is an approximate Newton method popularly used for communication-efficient distributed machine learning. Reasons for the interest in DANE include scalability and versatility. Convergence of DANE, however, can be tricky;…

Machine Learning · Statistics 2019-08-07 Xiao-Tong Yuan , Ping Li

The conventional federated learning (FedL) architecture distributes machine learning (ML) across worker devices by having them train local models that are periodically aggregated by a server. FedL ignores two important characteristics of…

Networking and Internet Architecture · Computer Science 2024-08-21 Su Wang , Roberto Morabito , Seyyedali Hosseinalipour , Mung Chiang , Christopher G. Brinton

Federated learning is a distributed learning framework that allows a set of clients to collaboratively train a model under the orchestration of a central server, without sharing raw data samples. Although in many practical scenarios the…

Machine Learning · Computer Science 2023-10-02 Alessio Maritan , Subhrakanti Dey , Luca Schenato

Federated learning (FL) is a distributed model training paradigm that preserves clients' data privacy. It has gained tremendous attention from both academia and industry. FL hyper-parameters (e.g., the number of selected clients and the…

Machine Learning · Computer Science 2022-11-28 Huanle Zhang , Lei Fu , Mi Zhang , Pengfei Hu , Xiuzhen Cheng , Prasant Mohapatra , Xin Liu

There are situations where data relevant to a machine learning problem are distributed among multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. For example, data present in users'…

Machine Learning · Computer Science 2020-08-27 Dimitris Stripelis , Jose Luis Ambite

Federated learning (FL) is a widely employed distributed paradigm for collaboratively training machine learning models from multiple clients without sharing local data. In practice, FL encounters challenges in dealing with partial client…

Machine Learning · Computer Science 2024-10-30 Xin Liu , Wei li , Dazhi Zhan , Yu Pan , Xin Ma , Yu Ding , Zhisong Pan

There is an increasing interest in a fast-growing machine learning technique called Federated Learning, in which the model training is distributed over mobile user equipments (UEs), exploiting UEs' local computation and training data.…

Machine Learning · Computer Science 2020-12-23 Canh T. Dinh , Nguyen H. Tran , Minh N. H. Nguyen , Choong Seon Hong , Wei Bao , Albert Y. Zomaya , Vincent Gramoli