English
Related papers

Related papers: Cooperative Gradient Coding

200 papers

Consider the \emph{simultaneous relay channel} (SRC) which consists of a set of relay channels where the source wishes to transmit common and private information to each of the destinations. This problem is recognized as being equivalent to…

Information Theory · Computer Science 2015-03-19 Arash Behboodi , Pablo Piantanida

Communication overhead is the key challenge for distributed training. Gradient compression is a widely used approach to reduce communication traffic. When combining with parallel communication mechanism method like pipeline, gradient…

Machine Learning · Computer Science 2021-09-08 Enda Yu , Dezun Dong , Yemao Xu , Shuo Ouyang , Xiangke Liao

Federated learning (FL) is an emerging technique for training machine learning models using geographically dispersed data collected by local entities. It includes local computation and synchronization steps. To reduce the communication…

Machine Learning · Computer Science 2020-03-23 Pengchao Han , Shiqiang Wang , Kin K. Leung

Graph Convolution Network (GCN) has attracted significant attention and become the most popular method for learning graph representations. In recent years, many efforts have been focused on integrating GCN into the recommender tasks and…

Machine Learning · Computer Science 2020-07-14 Kang Liu , Feng Xue , Richang Hong

Distributed optimization increasingly plays a central role in economical and sustainable operation of cyber-physical systems. Nevertheless, the complete potential of the technology has not yet been fully exploited in practice due to…

Optimization and Control · Mathematics 2017-10-24 Sindri Magnusson , Chinwendu Enyioha , Na Li , Carlo Fischione , Vahid Tarokh

To reduce the long training time of large deep neural network (DNN) models, distributed synchronous stochastic gradient descent (S-SGD) is commonly used on a cluster of workers. However, the speedup brought by multiple workers is limited by…

Machine Learning · Computer Science 2020-03-03 Shaohuai Shi , Zhenheng Tang , Qiang Wang , Kaiyong Zhao , Xiaowen Chu

Modeling and predicting the performance of students in collaborative learning paradigms is an important task. Most of the research presented in literature regarding collaborative learning focuses on the discussion forums and social learning…

Computers and Society · Computer Science 2023-08-07 Tianhao Peng , Yu Liang , Wenjun Wu , Jian Ren , Zhao Pengrui , Yanjun Pu

Federated learning effectively addresses issues such as data privacy by collaborating across participating devices to train global models. However, factors such as network topology and device computing power can affect its training or…

Machine Learning · Computer Science 2023-11-29 Yizhuo Cai , Bo Lei , Qianying Zhao , Jing Peng , Min Wei , Yushun Zhang , Xing Zhang

Federated Graph Learning (FGL) has emerged as a powerful paradigm for decentralized training of graph neural networks while preserving data privacy. However, existing FGL methods are predominantly designed for static graphs and rely on…

Machine Learning · Computer Science 2026-04-01 Yuxuan Liu , Wenchao Xu , Haozhao Wang , Zhiming He , Zhaofeng Shi , Chongyang Xu , Peichao Wang , Boyuan Zhang

Collaborative Filtering (CF) signals are crucial for a Recommender System~(RS) model to learn user and item embeddings. High-order information can alleviate the cold-start issue of CF-based methods, which is modelled through propagating the…

Information Retrieval · Computer Science 2021-06-01 Zhiwei Liu , Lin Meng , Fei Jiang , Jiawei Zhang , Philip S. Yu

This paper proposes a generalization of the conjugate gradient (CG) method used to solve the equation $Ax=b$ for a symmetric positive definite matrix $A$ of large size $n$. The generalization consists of permitting the scalar control…

Numerical Analysis · Mathematics 2016-11-17 Amit Bhaya , Pierre-Alexandre Bliman , Guilherme Niedu , Fernando Pazos

Linear solvers are key components in any software platform for scientific and engineering computing. The solution of large and sparse linear systems lies at the core of physics-driven numerical simulations relying on partial differential…

Numerical Analysis · Mathematics 2026-04-16 Massimo Bernaschi , Mauro G. Carrozzo , Alessandro Celestini , Giacomo Piperno , Pasqua D'Ambra

Decentralized optimization is a promising parallel computation paradigm for large-scale data analytics and machine learning problems defined over a network of nodes. This paper is concerned with decentralized non-convex composite problems…

Optimization and Control · Mathematics 2021-10-05 Ran Xin , Subhro Das , Usman A. Khan , Soummya Kar

The privacy-sensitive nature of decentralized datasets and the robustness of eXtreme Gradient Boosting (XGBoost) on tabular data raise the needs to train XGBoost in the context of federated learning (FL). Existing works on federated XGBoost…

Machine Learning · Computer Science 2024-03-26 Chenyang Ma , Xinchi Qiu , Daniel J. Beutel , Nicholas D. Lane

The observed and expected continued growth in the number of nodes in large-scale parallel computers gives rise to two major challenges: global communication operations are becoming major bottlenecks due to their limited scalability, and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-03 Markus Levonyak , Christina Pacher , Wilfried N. Gansterer

Existing approaches in Federated Learning (FL) mainly focus on sending model parameters or gradients from clients to a server. However, these methods are plagued by significant inefficiency, privacy, and security concerns. Thanks to the…

Machine Learning · Computer Science 2024-06-04 Jie Zhang , Xiaohua Qi , Bo Zhao

The fundamental success of large language models hinges upon the efficacious implementation of large-scale distributed training techniques. Nevertheless, building a vast, high-performance cluster featuring high-speed communication…

Computation and Language · Computer Science 2024-01-30 Weigao Sun , Zhen Qin , Weixuan Sun , Shidi Li , Dong Li , Xuyang Shen , Yu Qiao , Yiran Zhong

In distributed training of deep neural networks, people usually run Stochastic Gradient Descent (SGD) or its variants on each machine and communicate with other machines periodically. However, SGD might converge slowly in training some deep…

Machine Learning · Computer Science 2022-10-14 Mingrui Liu , Zhenxun Zhuang , Yunwei Lei , Chunyang Liao

This paper presents NCOTA-DGD, a Decentralized Gradient Descent (DGD) algorithm that combines local gradient descent with a novel Non-Coherent Over-The-Air (NCOTA) consensus scheme to solve distributed machine-learning problems over…

Information Theory · Computer Science 2023-02-06 Nicolò Michelusi

Federated Learning (FL) enables collaborative optimization of machine learning models across decentralized data by aggregating model parameters. Our approach extends this concept by aggregating "knowledge" derived from models, instead of…

Machine Learning · Computer Science 2024-02-28 Abhishek Singh , Gauri Gupta , Ritvik Kapila , Yichuan Shi , Alex Dang , Sheshank Shankar , Mohammed Ehab , Ramesh Raskar