English
Related papers

Related papers: Dynamic Regularized Sharpness Aware Minimization i…

200 papers

Privacy is important when dealing with sensitive personal information in machine learning models, which require large data sets for training. In the energy field, access to household prosumer energy data is crucial for energy predictions to…

Machine Learning · Computer Science 2023-09-20 Viorica Chifu , Tudor Cioara , Cristian Anitiei , Cristina Pop , Ionut Anghel

Since reinforcement learning algorithms are notoriously data-intensive, the task of sampling observations from the environment is usually split across multiple agents. However, transferring these observations from the agents to a central…

Machine Learning · Computer Science 2024-10-22 Sajad Khodadadian , Pranay Sharma , Gauri Joshi , Siva Theja Maguluri

Federated learning (FL) is a privacy-preserving distributed learning paradigm that enables clients to jointly train a global model. In real-world FL implementations, client data could have label noise, and different clients could have…

Machine Learning · Computer Science 2022-04-12 Jingyi Xu , Zihan Chen , Tony Q. S. Quek , Kai Fong Ernest Chong

Federated Learning (FL) is a distributed Machine Learning (ML) setup, where a shared model is collaboratively trained by various clients using their local datasets while keeping the data private. Considering resource-constrained devices, FL…

Machine Learning · Computer Science 2025-05-08 Vahideh Hayyolalam , Öznur Özkasap

Federated Learning (FL) on graphs enables collaborative model training to enhance performance without compromising the privacy of each client. However, existing methods often overlook the mutable nature of graph data, which frequently…

Machine Learning · Computer Science 2025-03-07 Sungwon Kim , Yoonho Lee , Yunhak Oh , Namkyeong Lee , Sukwon Yun , Junseok Lee , Sein Kim , Carl Yang , Chanyoung Park

In this work, we explore combining automatic hyperparameter tuning and optimization for federated learning (FL) in an online, one-shot procedure. We apply a principled approach on a method for adaptive client learning rate, number of local…

Machine Learning · Computer Science 2022-11-07 Andrew K Kan

The federated learning (FL) framework trains a machine learning model using decentralized data stored at edge client devices by periodically aggregating locally trained models. Popular optimization algorithms of FL use vanilla (stochastic)…

Machine Learning · Computer Science 2021-06-07 Jianyu Wang , Zheng Xu , Zachary Garrett , Zachary Charles , Luyang Liu , Gauri Joshi

Federated Learning (FL) has been becoming a popular interdisciplinary research area in both applied mathematics and information sciences. Mathematically, FL aims to collaboratively optimize aggregate objective functions over distributed…

Machine Learning · Computer Science 2024-12-03 Shusen Yang , Fangyuan Zhao , Zihao Zhou , Liang Shi , Xuebin Ren , Zongben Xu

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a…

Machine Learning · Computer Science 2016-10-11 Jakub Konečný , H. Brendan McMahan , Daniel Ramage , Peter Richtárik

Federated learning (FL) has emerged as a solution to deal with the risk of privacy leaks in machine learning training. This approach allows a variety of mobile devices to collaboratively train a machine learning model without sharing the…

Machine Learning · Computer Science 2022-12-01 Young Geun Kim , Carole-Jean Wu

Federated learning enables training on a massive number of edge devices. To improve flexibility and scalability, we propose a new asynchronous federated optimization algorithm. We prove that the proposed approach has near-linear convergence…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-08 Cong Xie , Sanmi Koyejo , Indranil Gupta

Federated learning (FL) enables distributed clients to collaboratively train a global model using local private data. Nevertheless, recent studies show that conventional FL algorithms still exhibit deficiencies in privacy protection, and…

Cryptography and Security · Computer Science 2026-03-31 Ruiyang Wang , Rong Pan , Zhengan Yao

Federated Learning (FL) enables collaborative model training across decentralized clients without sharing private data. However, FL suffers from biased global models due to non-IID and long-tail data distributions. We propose…

Machine Learning · Computer Science 2026-01-08 Jingrui Zhang , Yimeng Xu , Shujie Li , Feng Liang , Haihan Duan , Yanjie Dong , Victor C. M. Leung , Xiping Hu

Federated learning is a decentralized and privacy-preserving technique that enables multiple clients to collaborate with a server to learn a global model without exposing their private data. However, the presence of statistical…

Machine Learning · Computer Science 2023-07-06 Shiyu Liu , Shaogao Lv , Dun Zeng , Zenglin Xu , Hui Wang , Yue Yu

Heterogeneity across clients in federated learning (FL) usually hinders the optimization convergence and generalization performance when the aggregation of clients' knowledge occurs in the gradient space. For example, clients may differ in…

Machine Learning · Computer Science 2022-03-08 Yue Tan , Guodong Long , Lu Liu , Tianyi Zhou , Qinghua Lu , Jing Jiang , Chengqi Zhang

Federated learning (FL) is a rapidly growing privacy-preserving collaborative machine learning paradigm. In practical FL applications, local data from each data silo reflect local usage patterns. Therefore, there exists heterogeneity of…

Machine Learning · Computer Science 2022-02-01 Shenglai Zeng , Zonghang Li , Hongfang Yu , Yihong He , Zenglin Xu , Dusit Niyato , Han Yu

In recent years, multi-objective optimization (MOO) emerges as a foundational problem underpinning many multi-agent multi-task learning applications. However, existing algorithms in MOO literature remain limited to centralized learning…

Machine Learning · Computer Science 2024-01-09 Haibo Yang , Zhuqing Liu , Jia Liu , Chaosheng Dong , Michinari Momma

Large-scale deployments of low Earth orbit (LEO) satellites collect massive amount of Earth imageries and sensor data, which can empower machine learning (ML) to address global challenges such as real-time disaster navigation and…

Machine Learning · Computer Science 2022-02-04 Jinhyun So , Kevin Hsieh , Behnaz Arzani , Shadi Noghabi , Salman Avestimehr , Ranveer Chandra

Federated learning (FL), which has gained increasing attention recently, enables distributed devices to train a common machine learning (ML) model for intelligent inference cooperatively without data sharing. However, problems in practical…

Machine Learning · Computer Science 2022-11-01 Yujie Zhou , Zhidu Li , Tong Tang , Ruyan Wang

Federated learning is a distributed learning framework where clients collaboratively train a global model without sharing their raw data. FedAvg is a popular algorithm for federated learning, but it often suffers from slow convergence due…

Machine Learning · Computer Science 2025-05-19 Shokichi Takakura , Seng Pei Liew , Satoshi Hasegawa