English
Related papers

Related papers: Federated Learning on Adaptively Weighted Nodes by…

200 papers

Standard federated optimization methods successfully apply to stochastic problems with single-level structure. However, many contemporary ML problems -- including adversarial robustness, hyperparameter tuning, and actor-critic -- fall under…

Machine Learning · Computer Science 2022-09-15 Davoud Ataee Tarzanagh , Mingchen Li , Christos Thrampoulidis , Samet Oymak

This paper investigates federated learning in a wireless communication system, where random device selection is employed with non-independent and identically distributed (non-IID) data. The analysis indicates that while training deep…

Signal Processing · Electrical Eng. & Systems 2024-05-28 Kaidi Wang , Zhiguo Ding , Daniel K. C. So , Zhi Ding

Investigation of the degree of personalization in federated learning algorithms has shown that only maximizing the performance of the global model will confine the capacity of the local models to personalize. In this paper, we advocate an…

Machine Learning · Computer Science 2020-11-09 Yuyang Deng , Mohammad Mahdi Kamani , Mehrdad Mahdavi

Federated Learning (FL) is a variant of distributed learning where edge devices collaborate to learn a model without sharing their data with the central server or each other. We refer to the process of training multiple independent models…

Machine Learning · Computer Science 2022-09-22 Neelkamal Bhuyan , Sharayu Moharir , Gauri Joshi

(Stochastic) bilevel optimization is a frequently encountered problem in machine learning with a wide range of applications such as meta-learning, hyper-parameter optimization, and reinforcement learning. Most of the existing studies on…

Machine Learning · Computer Science 2023-03-16 Meng Ding , Mingxi Lei , Yunwen Lei , Di Wang , Jinhui Xu

Optimizing embedded systems, where the optimization of one depends on the state of another, is a formidable computational and algorithmic challenge, that is ubiquitous in real world systems. We study flow networks, where bilevel…

Optimization and Control · Mathematics 2022-11-09 Bo Li , David Saad , Chi Ho Yeung

Federated Learning (FL) is an increasingly popular machine learning paradigm in which multiple nodes try to collaboratively learn under privacy, communication and multiple heterogeneity constraints. A persistent problem in federated…

Machine Learning · Computer Science 2022-02-24 Elnur Gasanov , Ahmed Khaled , Samuel Horváth , Peter Richtárik

In this paper, we propose a novel method for enhancing security in privacy-preserving federated learning using the Vision Transformer. In federated learning, learning is performed by collecting updated information without collecting raw…

Cryptography and Security · Computer Science 2024-10-01 Hiroto Sawada , Shoko Imaizumi , Hitoshi Kiya

While providing machine learning model as a service to process users' inference requests, online applications can periodically upgrade the model utilizing newly collected data. Federated learning (FL) is beneficial for enabling the training…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-22 Pengchao Han , Shiqiang Wang , Yang Jiao , Jianwei Huang

Many machine learning (ML) techniques suffer from the drawback that their output (e.g., a classification decision) is not clearly and intuitively connected to their input (e.g., an image). To cope with this issue, several explainable ML…

Networking and Internet Architecture · Computer Science 2021-07-06 Francesco Malandrino , Carla Fabiana Chiasserini

Federated Learning (FL) is a distributed learning paradigm that enables a large number of resource-limited nodes to collaboratively train a model without data sharing. The non-independent-and-identically-distributed (non-i.i.d.) data…

Machine Learning · Computer Science 2022-02-04 Hongda Wu , Ping Wang

Federated learning is a promising privacy-preserving paradigm for distributed machine learning. In this context, there is sometimes a need for a specialized process called machine unlearning, which is required when the effect of some…

Cryptography and Security · Computer Science 2024-06-19 Heng Xu , Tianqing Zhu , Lefeng Zhang , Wanlei Zhou , Philip S. Yu

We consider a distributed estimation method in a setting with heterogeneous streams of correlated data distributed across nodes in a network. In the considered approach, linear models are estimated locally (i.e., with only local data)…

Machine Learning · Computer Science 2021-02-11 Lingzhou Hong , Alfredo Garcia , Ceyhun Eksin

Bilevel optimization, a hierarchical mathematical framework where one optimization problem is nested within another, has emerged as a powerful tool for modeling complex decision-making processes in various fields such as economics,…

Machine Learning · Computer Science 2024-12-25 Omer Ekmekcioglu , Nursen Aydin , Juergen Branke

Federated learning (FL) aims to train machine learning models in the decentralized system consisting of an enormous amount of smart edge devices. Federated averaging (FedAvg), the fundamental algorithm in FL settings, proposes on-device…

Machine Learning · Computer Science 2020-12-17 Xin Yao , Tianchi Huang , Rui-Xiao Zhang , Ruiyu Li , Lifeng Sun

Federated learning is a form of distributed learning with the key challenge being the non-identically distributed nature of the data in the participating clients. In this paper, we extend federated learning to the setting where multiple…

Machine Learning · Computer Science 2022-07-12 Neelkamal Bhuyan , Sharayu Moharir

Large-scale Internet of Things (IoT) networks enable intelligent services such as smart cities and autonomous driving, but often face resource constraints. Collecting heterogeneous sensory data, especially in small-scale datasets, is…

Machine Learning · Computer Science 2026-04-14 Haihui Xie , Wenkun Wen , Shuwu Chen , Zhaogang Shu , Minghua Xia

Federated learning (FL) enables edge nodes to collaboratively contribute to constructing a global model without sharing their data. This is accomplished by devices computing local, private model updates that are then aggregated by a server.…

Machine Learning · Computer Science 2024-06-13 Sadi Alawadi , Addi Ait-Mlouk , Salman Toor , Andreas Hellander

Federated learning enables many applications benefiting distributed and private datasets of a large number of potential data-holding clients. However, different clients usually have their own particular objectives in terms of the tasks to…

Machine Learning · Computer Science 2022-07-19 Cihat Keçeci , Mohammad Shaqfeh , Hayat Mbayed , Erchin Serpedin

Reinforcement learning techniques achieved human-level performance in several tasks in the last decade. However, in recent years, the need for interpretability emerged: we want to be able to understand how a system works and the reasons…

Machine Learning · Computer Science 2023-01-13 Leonardo Lucio Custode , Giovanni Iacca