English
Related papers

Related papers: Hierarchical Federated ADMM

200 papers

Alternating Direction Method of Multipliers (ADMM) has recently been proposed as a potential alternative optimizer to the Stochastic Gradient Descent(SGD) for deep learning problems. This is because ADMM can solve gradient vanishing and…

Optimization and Control · Mathematics 2021-06-24 Junxiang Wang , Zheng Chai , Yue Cheng , Liang Zhao

As a well-known optimization framework, the Alternating Direction Method of Multipliers (ADMM) has achieved tremendous success in many classification and regression applications. Recently, it has attracted the attention of deep learning…

Machine Learning · Computer Science 2021-12-23 Junxiang Wang , Hongyi Li , Liang Zhao

Federated learning (FL), which has gained increasing attention recently, enables distributed devices to train a common machine learning (ML) model for intelligent inference cooperatively without data sharing. However, problems in practical…

Machine Learning · Computer Science 2022-11-01 Yujie Zhou , Zhidu Li , Tong Tang , Ruyan Wang

As AI models expand in size, it has become increasingly challenging to deploy federated learning (FL) on resource-constrained edge devices. To tackle this issue, split federated learning (SFL) has emerged as an FL framework with reduced…

Machine Learning · Computer Science 2025-04-22 Zheng Lin , Wei Wei , Zhe Chen , Chan-Tong Lam , Xianhao Chen , Yue Gao , Jun Luo

Federated reinforcement learning (FedRL) enables agents to collaboratively train a global policy without sharing their individual data. However, high communication overhead remains a critical bottleneck, particularly for natural policy…

Machine Learning · Computer Science 2023-11-01 Guangchen Lan , Han Wang , James Anderson , Christopher Brinton , Vaneet Aggarwal

Federated learning (FL), as a distributed collaborative machine learning (ML) framework under privacy-preserving constraints, has garnered increasing research attention in cross-organizational data collaboration scenarios. This paper…

Machine Learning · Computer Science 2025-10-31 Wenyou Guo , Ting Qu , Chunrong Pan , George Q. Huang

Federated learning (FL) enables distributed resource-constrained devices to jointly train shared models while keeping the training data local for privacy purposes. Vertical FL (VFL), which allows each client to collect partial features, has…

Machine Learning · Computer Science 2024-04-09 Chulin Xie , Pin-Yu Chen , Qinbin Li , Arash Nourian , Ce Zhang , Bo Li

In this work, we present a hardware compatible neural network training algorithm in which we used alternating direction method of multipliers (ADMM) and iterative least-square methods. The motive behind this approach was to conduct a method…

Machine Learning · Computer Science 2020-09-08 Seyedeh Niusha Alavi Foumani , Ce Guo , Wayne Luk

Federated learning (FL) is a general framework for learning across an axis of group partitioned data (heterogeneous clients) while preserving data privacy, under the orchestration of a central server. FL methods often compute gradients of…

Machine Learning · Computer Science 2024-11-26 Keith Rush , Zachary Charles , Zachary Garrett

The federated learning (FL) framework enables edge clients to collaboratively learn a shared inference model while keeping privacy of training data on clients. Recently, many heuristics efforts have been made to generalize centralized…

Machine Learning · Computer Science 2022-07-18 Jiayin Jin , Jiaxiang Ren , Yang Zhou , Lingjuan Lyu , Ji Liu , Dejing Dou

This paper investigates the vulnerability of the Alternating Direction Method of Multipliers (ADMM) algorithm to shared data manipulation, with a focus on solving optimal power flow (OPF) problems. Deliberate data manipulation may cause the…

Systems and Control · Electrical Eng. & Systems 2025-11-03 Mohannad Alkhraijah , Rachel Harris , Samuel Litchfield , David Huggins , Daniel K. Molzahn

Federated learning (FL) is an emerging learning paradigm to tackle massively distributed data. In Federated Learning, a set of clients jointly perform a machine learning task under the coordination of a server. The FedAvg algorithm is one…

Machine Learning · Computer Science 2023-02-14 Junyi Li , Feihu Huang , Heng Huang

Federated learning (FL) is a new paradigm for distributed machine learning that allows a global model to be trained across multiple clients without compromising their privacy. Although FL has demonstrated remarkable success in various…

Machine Learning · Computer Science 2023-06-06 Haolin Wang , Xuefeng Liu , Jianwei Niu , Shaojie Tang , Jiaxing Shen

Federated learning (FL) is a privacy-preserving distributed machine learning paradigm that enables collaborative training among geographically distributed and heterogeneous devices without gathering their data. Extending FL beyond the…

Machine Learning · Computer Science 2023-04-04 Jin Wang , Jia Hu , Jed Mills , Geyong Min , Ming Xia

This paper proposes a novel face recognition algorithm based on large-scale supervised hierarchical feature learning. The approach consists of two parts: hierarchical feature learning and large-scale model learning. The hierarchical feature…

Computer Vision and Pattern Recognition · Computer Science 2014-07-08 Jianguo Li , Yurong Chen

Federated Learning (FL) solutions with central Differential Privacy (DP) have seen large improvements in their utility in recent years arising from the matrix mechanism, while FL solutions with distributed (more private) DP have lagged…

Cryptography and Security · Computer Science 2025-06-18 Alexander Bienstock , Ujjwal Kumar , Antigoni Polychroniadou

We study differentially private (DP) machine learning algorithms as instances of noisy fixed-point iterations, in order to derive privacy and utility results from this well-studied framework. We show that this new perspective recovers…

Machine Learning · Computer Science 2023-07-13 Edwige Cyffers , Aurélien Bellet , Debabrota Basu

Matrix completion is fundamental for predicting missing data with a wide range of applications in personalized healthcare, e-commerce, recommendation systems, and social network analysis. Traditional matrix completion approaches typically…

Machine Learning · Computer Science 2025-03-19 Patrick Hytla , Tran T. A. Nghia , Duy Nhat Phan , Andrew Rice

We propose both serial and parallel proximal (linearized) alternating direction method of multipliers (ADMM) algorithms for training residual neural networks. In contrast to backpropagation-based approaches, our methods inherently mitigate…

Machine Learning · Computer Science 2025-04-01 Jintao Xu , Yifei Li , Wenxun Xing

Federated learning has gained popularity as a means of training models distributed across the wireless edge. The paper introduces delay-aware hierarchical federated learning (DFL) to improve the efficiency of distributed machine learning…

Machine Learning · Computer Science 2023-09-29 Frank Po-Chen Lin , Seyyedali Hosseinalipour , Nicolò Michelusi , Christopher Brinton