English
Related papers

Related papers: Distributed Gradient Descent for Functional Learni…

200 papers

To address the communication burden issues associated with federated learning (FL), decentralized federated learning (DFL) discards the central server and establishes a decentralized communication network, where each client communicates…

Machine Learning · Computer Science 2023-08-17 Qinglun Li , Li Shen , Guanghao Li , Quanjun Yin , Dacheng Tao

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

Optimization and Control · Mathematics 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

Decision-focused learning (DFL) is an increasingly popular paradigm for training predictive models whose outputs are used in decision-making tasks. Instead of merely optimizing for predictive accuracy, DFL trains models to directly minimize…

Machine Learning · Computer Science 2026-03-10 Aymeric Capitaine , Maxime Haddouche , Eric Moulines , Michael I. Jordan , Etienne Boursier , Alain Durmus

By selecting different filter functions, spectral algorithms can generate various regularization methods to solve statistical inverse problems within the learning-from-samples framework. This paper combines distributed spectral algorithms…

Machine Learning · Statistics 2025-02-18 Jiading Liu , Lei Shi

The widespread adoption of smartphones and smart wearable devices has led to the widespread use of Centralized Federated Learning (CFL) for training powerful machine learning models while preserving data privacy. However, CFL faces…

Machine Learning · Computer Science 2025-03-18 Chengyan Jiang , Jiamin Fan , Talal Halabi , Israat Haque

Despite the notable success of deep neural networks (DNNs) in solving complex tasks, the training process still remains considerable challenges. A primary obstacle is the substantial time required for training, particularly as high…

Machine Learning · Computer Science 2025-09-09 Viet Hoang Pham , Hyo-Sung Ahn

Federated Learning (FL) is a popular distributed learning paradigm to break down data silo. Traditional FL approaches largely rely on gradient-based updates, facing significant issues about heterogeneity, scalability, convergence, and…

Decision-focused learning (DFL) is an emerging paradigm that integrates machine learning (ML) and constrained optimization to enhance decision quality by training ML models in an end-to-end system. This approach shows significant potential…

Machine Learning · Computer Science 2024-09-05 Jayanta Mandi , James Kotary , Senne Berden , Maxime Mulamba , Victor Bucarey , Tias Guns , Ferdinando Fioretto

Generative Diffusion Models (GDMs), have made significant strides in modeling complex data distributions across diverse domains. Meanwhile, Deep Reinforcement Learning (DRL) has demonstrated substantial improvements in optimizing Wi-Fi…

Networking and Internet Architecture · Computer Science 2025-01-08 Tie Liu , Xuming Fang , Rong He

Vertical Federated Learning (VFL) is an emergent distributed machine learning paradigm for collaborative learning between clients who have disjoint features of common entities. However, standard VFL lacks fault tolerance, with each…

Machine Learning · Computer Science 2024-12-03 Avi Amalanshu , Yash Sirvi , David I. Inouye

Decentralized stochastic gradient descent (SGD) is a driving engine for decentralized federated learning (DFL). The performance of decentralized SGD is jointly influenced by inter-node communications and local updates. In this paper, we…

Machine Learning · Computer Science 2022-02-14 Wei Liu , Li Chen , Wenyi Zhang

Next Generation (NextG) networks are expected to support demanding tactile internet applications such as augmented reality and connected autonomous vehicles. Whereas recent innovations bring the promise of larger link capacity, their…

Machine Learning · Computer Science 2021-12-08 Peyman Tehrani , Francesco Restuccia , Marco Levorato

Federated Learning (FL) facilitates collaborative model training while prioritizing privacy by avoiding direct data sharing. However, most existing articles attempt to address challenges within the model's internal parameters and…

Machine Learning · Computer Science 2025-01-10 Guannan Lai , Yihui Feng , Xin Yang , Xiaoyu Deng , Hao Yu , Shuyin Xia , Guoyin Wang , Tianrui Li

The ongoing deployment of the Internet of Things (IoT)-based smart applications is spurring the adoption of machine learning as a key technology enabler. To overcome the privacy and overhead challenges of centralized machine learning, there…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-21 Latif U. Khan , Walid Saad , Zhu Han , Choong Seon Hong

Federated Learning (FL) is a distributed learning technique that maintains data privacy by providing a decentralized training method for machine learning models using distributed big data. This promising Federated Learning approach has also…

Machine Learning · Computer Science 2024-11-11 Prakash Chourasia , Tamkanat E Ali , Sarwan Ali , Murray Pattersn

Decision-Focused Learning (DFL) is an emerging learning paradigm that tackles the task of training a machine learning (ML) model to predict missing parameters of an incomplete optimization problem, where the missing parameters are…

Machine Learning · Computer Science 2025-06-23 Yehya Farhat

Federated learning (FL) provides a communication-efficient approach to solve machine learning problems concerning distributed data, without sending raw data to a central server. However, existing works on FL only utilize first-order…

Machine Learning · Computer Science 2019-10-10 Wei Liu , Li Chen , Yunfei Chen , Wenyi Zhang

Decentralized federated learning (DFL) enables edge devices to collaboratively train models through local training and fully decentralized device-to-device (D2D) model exchanges. However, these energy-intensive operations often rapidly…

Machine Learning · Computer Science 2026-02-17 Kai Zhang , Xuanyu Cao , Khaled B. Letaief

Federated learning is a distributed machine learning paradigm through centralized model aggregation. However, standard federated learning relies on a centralized server, making it vulnerable to server failures. While existing solutions…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-03 Hongliang Zhang , Fenghua Xu , Zhongyuan Yu , Shanchen Pang , Chunqiang Hu , Jiguo Yu

Federated learning (FL) is a recently proposed distributed machine learning paradigm dealing with distributed and private data sets. Based on the data partition pattern, FL is often categorized into horizontal, vertical, and hybrid…

Machine Learning · Computer Science 2021-02-19 Xinwei Zhang , Wotao Yin , Mingyi Hong , Tianyi Chen