English
Related papers

Related papers: Distributed Machine Learning via Sufficient Factor…

200 papers

Federated learning (FL) is a useful tool in distributed machine learning that utilizes users' local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless environment; however, training models in a…

Machine Learning · Computer Science 2022-05-06 Jake Perazzone , Shiqiang Wang , Mingyue Ji , Kevin Chan

AI accelerator processing capabilities and memory constraints largely dictate the scale in which machine learning workloads (e.g., training and inference) can be executed within a desirable time frame. Training a state of the art,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-12 Michael Benington , Leo Phan , Chris Pierre Paul , Evan Shoemaker , Priyanka Ranade , Torstein Collett , Grant Hodgson Perez , Christopher Krieger

Extreme resource constraints make large-scale machine learning (ML) with distributed clients challenging in wireless networks. On the one hand, large-scale ML requires massive information exchange between clients and server(s). On the other…

Machine Learning · Computer Science 2025-03-10 Md-Ferdous Pervej , Andreas F. Molisch

Federated learning (FL) and split learning (SL) are two effective distributed learning paradigms in wireless networks, enabling collaborative model training across mobile devices without sharing raw data. While FL supports low-latency…

Machine Learning · Computer Science 2025-11-26 Kun Guo , Xuefei Li , Xijun Wang , Howard H. Yang , Wei Feng , Tony Q. S. Quek

If learning methods are to scale to the massive sizes of modern datasets, it is essential for the field of machine learning to embrace parallel and distributed computing. Inspired by the recent development of matrix factorization methods…

Machine Learning · Computer Science 2013-10-29 Lester Mackey , Ameet Talwalkar , Michael I. Jordan

Federated Learning (FL) represents a growing machine learning (ML) paradigm designed for training models across numerous nodes that retain local datasets, all without directly exchanging the underlying private data with the parameter server…

Machine Learning · Computer Science 2023-12-08 Tamir L. S. Gez , Kobi Cohen

Artificial neural network has achieved unprecedented success in a wide variety of domains such as classifying, predicting and recognizing objects. This success depends on the availability of big data since the training process requires…

Machine Learning · Computer Science 2019-10-08 Rulin Shao , Hui Liu , Dianbo Liu

Federated learning has emerged as a promising approach for training machine learning models on decentralized data sources while preserving data privacy. However, challenges such as communication bottlenecks, heterogeneity of client devices,…

Machine Learning · Computer Science 2023-12-27 Anna Vettoruzzo , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson

Federated Learning (FL) is a decentralized machine learning framework that enables learning from data distributed across multiple remote devices, enhancing communication efficiency and data privacy. Due to limited communication resources, a…

Machine Learning · Computer Science 2024-08-02 Alireza Javani , Zhiying Wang

Learning sparse combinations is a frequent theme in machine learning. In this paper, we study its associated optimization problem in the distributed setting where the elements to be combined are not centrally located but spread over a…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-25 Aurélien Bellet , Yingyu Liang , Alireza Bagheri Garakani , Maria-Florina Balcan , Fei Sha

Boolean matrix has been used to represent digital information in many fields, including bank transaction, crime records, natural language processing, protein-protein interaction, etc. Boolean matrix factorization (BMF) aims to find an…

Machine Learning · Computer Science 2020-02-12 Changlin Wan , Wennan Chang , Tong Zhao , Mengya Li , Sha Cao , Chi Zhang

Machine learning (ML) applications to time series energy utilization forecasting problems are a challenging assignment due to a variety of factors. Chief among these is the non-homogeneity of the energy utilization datasets and the…

Machine Learning · Computer Science 2023-09-06 Jiacong Xu , Riley Kilfoyle , Zixiang Xiong , Ligang Lu

Federated learning is a distributed learning paradigm in which multiple mobile clients train a global model while keeping data local. These mobile clients can have various available memory and network bandwidth. However, to achieve the best…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-16 Dixi Yao

This work presents a new method for enhancing communication efficiency in stochastic Federated Learning that trains over-parameterized random networks. In this setting, a binary mask is optimized instead of the model weights, which are kept…

Machine Learning · Computer Science 2024-03-01 Mohamad Mestoukirdi , Omid Esrafilian , David Gesbert , Qianrui Li , Nicolas Gresset

In this work, we propose Salient Sparse Federated Learning (SSFL), a streamlined approach for sparse federated learning with efficient communication. SSFL identifies a sparse subnetwork prior to training, leveraging parameter saliency…

Machine Learning · Computer Science 2026-01-16 Riyasat Ohib , Bishal Thapaliya , Gintare Karolina Dziugaite , Jingyu Liu , Vince Calhoun , Sergey Plis

Multiresolution Matrix Factorization (MMF) is unusual amongst fast matrix factorization algorithms in that it does not make a low rank assumption. This makes MMF especially well suited to modeling certain types of graphs with complex…

Machine Learning · Computer Science 2021-11-04 Truong Son Hy , Risi Kondor

Under dynamic traffic, service function chain (SFC) migration is considered as an effective way to improve resource utilization. However, the lack of future network information leads to non-optimal solutions, which motivates us to study…

Networking and Internet Architecture · Computer Science 2019-11-14 Ruoyun Chen , Hancheng Lu , Yujiao Lu , Jinxue Liu

Split federated learning (SFL) is a compute-efficient paradigm in distributed machine learning (ML), where components of large ML models are outsourced to remote servers. A significant challenge in SFL, particularly when deployed over…

Machine Learning · Computer Science 2025-10-28 Aladin Djuhera , Vlad C. Andrei , Xinyang Li , Ullrich J. Mönich , Holger Boche , Walid Saad

As a promising paradigm federated Learning (FL) is widely used in privacy-preserving machine learning, which allows distributed devices to collaboratively train a model while avoiding data transmission among clients. Despite its immense…

Machine Learning · Computer Science 2023-08-29 Jinglong Shen , Xiucheng Wang , Nan Cheng , Longfei Ma , Conghao Zhou , Yuan Zhang

Federated learning has emerged recently as a promising solution for distributing machine learning tasks through modern networks of mobile devices. Recent studies have obtained lower bounds on the expected decrease in model loss that is…