English
Related papers

Related papers: FedNL: Making Newton-Type Methods Applicable to Fe…

200 papers

Federated learning (FL) has emerged as an effective technique to co-training machine learning models without actually sharing data and leaking privacy. However, most existing FL methods focus on the supervised setting and ignore the…

Machine Learning · Computer Science 2021-07-06 Zewei Long , Liwei Che , Yaqing Wang , Muchao Ye , Junyu Luo , Jinze Wu , Houping Xiao , Fenglong Ma

Federated learning (FL) aims at training a global model on the server side while the training data are collected and located at the local devices. Hence, the labels in practice are usually annotated by clients of varying expertise or…

Machine Learning · Computer Science 2022-05-23 Zhuowei Wang , Tianyi Zhou , Guodong Long , Bo Han , Jing Jiang

Federated learning (FL) is a distributed machine learning approach that enables multiple local clients and a central server to collaboratively train a model while keeping the data on their own devices. First-order methods, particularly…

Machine Learning · Computer Science 2025-03-17 Xue Feng , M. Paul Laiu , Thomas Strohmer

As a promising distributed machine learning paradigm, Federated Learning (FL) enables all the involved devices to train a global model collaboratively without exposing their local data privacy. However, for non-IID scenarios, the…

Machine Learning · Computer Science 2022-02-28 Ming Hu , Tian Liu , Zhiwei Ling , Zhihao Yue , Mingsong Chen

Neuro-symbolic learning (NSL) models complex symbolic rule patterns into latent variable distributions by neural networks, which reduces rule search space and generates unseen rules to improve downstream task performance. Centralized NSL…

Artificial Intelligence · Computer Science 2024-05-28 Pengwei Xing , Songtao Lu , Han Yu

Federated learning aims to jointly learn statistical models over massively distributed remote devices. In this work, we propose FedDANE, an optimization method that we adapt from DANE, a method for classical distributed optimization, to…

Machine Learning · Computer Science 2020-01-08 Tian Li , Anit Kumar Sahu , Manzil Zaheer , Maziar Sanjabi , Ameet Talwalkar , Virginia Smith

In order to achieve the dual goals of privacy and learning across distributed data, Federated Learning (FL) systems rely on frequent exchanges of large files (model updates) between a set of clients and the server. As such FL systems are…

Machine Learning · Computer Science 2023-01-12 Parikshit Hegde , Gustavo de Veciana , Aryan Mokhtari

Federated learning (FL) collaboratively trains a shared global model depending on multiple local clients, while keeping the training data decentralized in order to preserve data privacy. However, standard FL methods ignore the noisy client…

Machine Learning · Computer Science 2022-12-02 Kahou Tam , Li Li , Bo Han , Chengzhong Xu , Huazhu Fu

Federated Learning (FL) enables the multiple participating devices to collaboratively contribute to a global neural network model while keeping the training data locally. Unlike the centralized training setting, the non-IID and imbalanced…

Machine Learning · Computer Science 2024-04-16 Moming Duan , Duo Liu , Xinyuan Ji , Renping Liu , Liang Liang , Xianzhang Chen , Yujuan Tan

Federated learning (FL) enables multiple devices to collaboratively train a global model while maintaining data on local servers. Each device trains the model on its local server and shares only the model updates (i.e., gradient weights)…

Machine Learning · Computer Science 2024-12-31 Nishant S. Gaikwad , Lucas Heublein , Nisha L. Raichur , Tobias Feigl , Christopher Mutschler , Felix Ott

In contrast to training traditional machine learning (ML) models in data centers, federated learning (FL) trains ML models over local datasets contained on resource-constrained heterogeneous edge devices. Existing FL algorithms aim to learn…

Machine Learning · Computer Science 2022-09-13 El Houcine Bergou , Konstantin Burlachenko , Aritra Dutta , Peter Richtárik

Federated learning enables a population of clients to collaboratively train machine learning models without exchanging their raw data, but standard algorithms such as FedAvg suffer from slow convergence and high communication and memory…

Machine Learning · Computer Science 2026-04-30 Yutong He , Zhengyang Huang , Jiahe Geng

Federated learning (FL) is a recently developed area of machine learning, in which the private data of a large number of distributed clients is used to develop a global model under the coordination of a central server without explicitly…

Machine Learning · Computer Science 2022-07-21 Amit Kumar Kundu , Joseph Jaja

Despite their high computation and communication costs, Newton-type methods remain an appealing option for distributed training due to their robustness against ill-conditioned convex problems. In this work, we study ommunication compression…

Machine Learning · Computer Science 2022-06-09 Rustem Islamov , Xun Qian , Slavomír Hanzely , Mher Safaryan , Peter Richtárik

Federated learning with noisy labels (F-LNL) aims at seeking an optimal server model via collaborative distributed learning by aggregating multiple client models trained with local noisy or clean samples. On the basis of a federated…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Jichang Li , Guanbin Li , Hui Cheng , Zicheng Liao , Yizhou Yu

Vertical federated learning (VFL), a variant of Federated Learning (FL), has recently drawn increasing attention as the VFL matches the enterprises' demands of leveraging more valuable features to achieve better model performance. However,…

Machine Learning · Computer Science 2023-06-09 Yuanqin He , Yan Kang , Xinyuan Zhao , Jiahuan Luo , Lixin Fan , Yuxing Han , Qiang Yang

Federated Learning (FL) is commonly used in systems with distributed and heterogeneous devices with access to varying amounts of data and diverse computing and storage capacities. FL training process enables such devices to update the…

Machine Learning · Computer Science 2024-05-31 Zeyneddin Oz , Ceylan Soygul Oz , Abdollah Malekjafarian , Nima Afraz , Fatemeh Golpayegani

With the promise of federated learning (FL) to allow for geographically-distributed and highly personalized services, the efficient exchange of model updates between clients and servers becomes crucial. FL, though decentralized, often faces…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-25 Grant Wilkins , Sheng Di , Jon C. Calhoun , Zilinghan Li , Kibaek Kim , Robert Underwood , Richard Mortier , Franck Cappello

One underlying assumption of recent federated learning (FL) paradigms is that all local models usually share the same network architecture and size, which becomes impractical for devices with different hardware resources. A scalable…

Machine Learning · Computer Science 2022-05-27 Dezhong Yao , Wanning Pan , Michael J O'Neill , Yutong Dai , Yao Wan , Hai Jin , Lichao Sun

Federated learning (FL) aims to minimize the communication complexity of training a model over heterogeneous data distributed across many clients. A common approach is local methods, where clients take multiple optimization steps over local…

Machine Learning · Computer Science 2023-04-18 Charlie Hou , Kiran K. Thekumparampil , Giulia Fanti , Sewoong Oh