English
Related papers

Related papers: Federated Asymptotics: a model to compare federate…

200 papers

Federated learning is a distributed and privacy-preserving approach to train a statistical model collaboratively from decentralized data of different parties. However, when datasets of participants are not independent and identically…

Machine Learning · Computer Science 2023-01-24 Li Ju , Tianru Zhang , Salman Toor , Andreas Hellander

Data heterogeneity is one of the most challenging issues in federated learning, which motivates a variety of approaches to learn personalized models for participating clients. One such approach in deep neural networks based tasks is…

Machine Learning · Computer Science 2023-06-22 Jian Xu , Xinyi Tong , Shao-Lun Huang

In a distributed machine learning setting like Federated Learning where there are multiple clients involved which update their individual weights to a single central server, often training on the entire individual client's dataset for each…

Machine Learning · Computer Science 2025-11-04 Prateek Chanda , Shrey Modi , Ganesh Ramakrishnan

Federated learning involves training machine learning models over devices or data silos, such as edge processors or data warehouses, while keeping the data local. Training in heterogeneous and potentially massive networks introduces bias…

Machine Learning · Computer Science 2021-06-18 Zichen Ma , Yu Lu , Zihan Lu , Wenye Li , Jinfeng Yi , Shuguang Cui

Federated Learning (FL) is a distributed learning scheme to train a shared model across clients. One common and fundamental challenge in FL is that the sets of data across clients could be non-identically distributed and have different…

Machine Learning · Computer Science 2023-05-23 Junyi Zhu , Xingchen Ma , Matthew B. Blaschko

The feasibility of federated learning is highly constrained by the server-clients infrastructure in terms of network communication. Most newly launched smartphones and IoT devices are equipped with GPUs or sufficient computing hardware to…

Machine Learning · Computer Science 2020-07-21 Marten van Dijk , Nhuong V. Nguyen , Toan N. Nguyen , Lam M. Nguyen , Quoc Tran-Dinh , Phuong Ha Nguyen

In Federated Learning (FL), the distributed nature and heterogeneity of client data present both opportunities and challenges. While collaboration among clients can significantly enhance the learning process, not all collaborations are…

Machine Learning · Computer Science 2024-07-18 Nazarii Tupitsa , Samuel Horváth , Martin Takáč , Eduard Gorbunov

Federated learning's poor performance in the presence of heterogeneous data remains one of the most pressing issues in the field. Personalized federated learning departs from the conventional paradigm in which all clients employ the same…

Machine Learning · Computer Science 2024-02-27 Mengen Luo , Ercan Engin Kuruoglu

Federated learning (FL) is emerging as a new paradigm to train machine learning models in distributed systems. Rather than sharing, and disclosing, the training dataset with the server, the model parameters (e.g. neural networks weights and…

Signal Processing · Electrical Eng. & Systems 2020-05-27 Stefano Savazzi , Monica Nicoli , Vittorio Rampa

Federated learning, a distributed learning paradigm, utilizes multiple clients to build a robust global model. In real-world applications, local clients often operate within their limited domains, leading to a `domain shift' across clients.…

Machine Learning · Computer Science 2024-07-12 Seunghan Yang , Seokeon Choi , Hyunsin Park , Sungha Choi , Simyung Chang , Sungrack Yun

Machine learning methods allow us to make recommendations to users in applications across fields including entertainment, dating, and commerce, by exploiting similarities in users' interaction patterns. However, in domains that demand…

Information Retrieval · Computer Science 2020-03-03 Mónica Ribero , Jette Henderson , Sinead Williamson , Haris Vikalo

We propose a new optimization formulation for training federated learning models. The standard formulation has the form of an empirical risk minimization problem constructed to find a single global model trained from the private data stored…

Machine Learning · Computer Science 2021-02-15 Filip Hanzely , Peter Richtárik

Federated learning is typically approached as an optimization problem, where the goal is to minimize a global loss function by distributing computation across client devices that possess local data and specify different parts of the global…

Machine Learning · Computer Science 2021-02-02 Maruan Al-Shedivat , Jennifer Gillenwater , Eric Xing , Afshin Rostamizadeh

Federated Learning aims to learn machine learning models from multiple decentralized edge devices (e.g. mobiles) or servers without sacrificing local data privacy. Recent Natural Language Processing techniques rely on deep learning and…

Computation and Language · Computer Science 2021-07-28 Ming Liu , Stella Ho , Mengqi Wang , Longxiang Gao , Yuan Jin , He Zhang

Federated Learning allows for population level models to be trained without centralizing client data by transmitting the global model to clients, calculating gradients locally, then averaging the gradients. Downloading models and uploading…

Machine Learning · Computer Science 2019-09-30 Jack Goetz , Kshitiz Malik , Duc Bui , Seungwhan Moon , Honglei Liu , Anuj Kumar

This work tackles the challenges of data heterogeneity and communication limitations in decentralized federated learning. We focus on creating a collaboration graph that guides each client in selecting suitable collaborators for training…

Machine Learning · Computer Science 2024-06-11 Salma Kharrat , Marco Canini , Samuel Horvath

In Federated Learning (FL), the clients learn a single global model (FedAvg) through a central aggregator. In this setting, the non-IID distribution of the data across clients restricts the global FL model from delivering good performance…

Machine Learning · Computer Science 2021-07-29 Siddharth Divi , Yi-Shan Lin , Habiba Farrukh , Z. Berkay Celik

Recently, federated learning has raised increasing interest in the medical image analysis field due to its ability to aggregate multi-center data with privacy-preserving properties. A large amount of federated training schemes have been…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Matthis Manthe , Stefan Duffner , Carole Lartizien

Federated learning enables training on a massive number of edge devices. To improve flexibility and scalability, we propose a new asynchronous federated optimization algorithm. We prove that the proposed approach has near-linear convergence…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-08 Cong Xie , Sanmi Koyejo , Indranil Gupta

In the context of personalized federated learning (FL), the critical challenge is to balance local model improvement and global model tuning when the personal and global objectives may not be exactly aligned. Inspired by Bayesian…

Machine Learning · Computer Science 2022-04-19 Huili Chen , Jie Ding , Eric Tramel , Shuang Wu , Anit Kumar Sahu , Salman Avestimehr , Tao Zhang