English
Related papers

Related papers: Fundamental Limits of Distributed Linearly Separab…

200 papers

Codes are widely used in many engineering applications to offer robustness against noise. In large-scale systems there are several types of noise that can affect the performance of distributed machine learning algorithms -- straggler nodes,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-30 Kangwook Lee , Maximilian Lam , Ramtin Pedarsani , Dimitris Papailiopoulos , Kannan Ramchandran

Today, various machine learning (ML) applications offer continuous data processing and real-time data analytics at the edge of a wireless network. Distributed real-time ML solutions are highly sensitive to the so-called straggler effect…

Machine Learning · Computer Science 2024-10-28 Nikita Zeulin , Olga Galinina , Nageen Himayat , Sergey Andreev , Robert W. Heath

In distributed computing systems slow working nodes, known as stragglers, can greatly extend finishing times. Coded computing is a technique that enables straggler-resistant computation. Most coded computing techniques presented to date…

Information Theory · Computer Science 2021-02-02 Shahrzad Kiani , Nuwan Ferdinand , Stark C. Draper

With the dissemination of affordable parallel and distributed hardware, parallel and distributed constraint solving has lately been the focus of some attention. To effectually apply the power of distributed computational systems, there must…

Programming Languages · Computer Science 2010-09-21 Vasco Pedro , Salvador Abreu

We propose a novel, efficient approach for distributed sparse learning in high-dimensions, where observations are randomly partitioned across machines. Computationally, at each round our method only requires the master machine to solve a…

Machine Learning · Statistics 2016-05-26 Jialei Wang , Mladen Kolar , Nathan Srebro , Tong Zhang

From natural language processing to genome sequencing, large-scale machine learning models are bringing advances to a broad range of fields. Many of these models are too large to be trained on a single machine, and instead must be…

Machine Learning · Computer Science 2023-02-01 Christopher W. F. Parsonson , Zacharaya Shabka , Alessandro Ottino , Georgios Zervas

This paper addresses a distributed optimization problem in a communication network where nodes are active sporadically. Each active node applies some learning method to control its action to maximize the global utility function, which is…

Optimization and Control · Mathematics 2021-04-20 Wenjie Li , Mohamad Assaad , Shiqi Zheng

Existing approaches to distributed matrix computations involve allocating coded combinations of submatrices to worker nodes, to build resilience to stragglers and/or enhance privacy. In this study, we consider the challenge of preserving…

Information Theory · Computer Science 2023-08-09 Anindya Bijoy Das , Aditya Ramamoorthy , David J. Love , Christopher G. Brinton

One of the most basic techniques in algorithm design consists of breaking a problem into subproblems and then proceeding recursively. In the case of graph algorithms, one way to implement this approach is through separator sets. Given a…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-13 Benjamin Jauregui , Pedro Montealegre , Ivan Rapaport

Linear computation broadcast (LCBC) refers to a setting with $d$ dimensional data stored at a central server, where $K$ users, each with some prior linear side-information, wish to retrieve various linear combinations of the data. For each…

Information Theory · Computer Science 2025-08-18 Yuhang Yao , Syed A. Jafar

In this paper we address the complexity of solving linear programming problems with a set of differential equations that converge to a fixed point that represents the optimal solution. Assuming a probabilistic model, where the inputs are…

Computational Complexity · Computer Science 2007-05-23 Asa Ben-Hur , Joshua Feinberg , Shmuel Fishman , Hava T. Siegelmann

The emerging paradigm of distributed quantum computing promises a potential solution to scaling quantum computing to currently unfeasible dimensions. While this approach itself is still in its infancy, and many obstacles must still be…

Quantum Physics · Physics 2026-01-26 Leo Sünkel , Jonas Stein , Maximilian Zorn , Thomas Gabor , Claudia Linnhoff-Popien

Distributed matrix computations -- matrix-matrix or matrix-vector multiplications -- are well-recognized to suffer from the problem of stragglers (slow or failed worker nodes). Much of prior work in this area is (i) either sub-optimal in…

Information Theory · Computer Science 2020-06-03 Anindya B. Das , Aditya Ramamoorthy , Namrata Vaswani

Classical list scheduling is a very popular and efficient technique for scheduling jobs in parallel and distributed platforms. It is inherently centralized. However, with the increasing number of processors, the cost for managing a single…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-07-20 Marc Tchiboukdjian , Nicolas Gast , Denis Trystram

Gradient coding schemes effectively mitigate full stragglers in distributed learning by introducing identical redundancy in coded local partial derivatives corresponding to all model parameters. However, they are no longer effective for…

Information Theory · Computer Science 2023-04-26 Qi Wang , Ying Cui , Chenglin Li , Junni Zou , Hongkai Xiong

Network function computation is an active topic in network coding, with much recent progress for linear (over a finite field) computations over broadcast (LCBC) and multiple access (LCMAC) channels. Over a quantum multiple access channel…

Information Theory · Computer Science 2025-10-22 Yuhang Yao , Syed A. Jafar

Gradient-based distributed learning in Parameter Server (PS) computing architectures is subject to random delays due to straggling worker nodes, as well as to possible communication bottlenecks between PS and workers. Solutions have been…

Information Theory · Computer Science 2020-04-09 Jingjing Zhang , Osvaldo Simeone

Coded computing is a method for mitigating straggling workers in a centralized computing network, by using erasure-coding techniques. Federated learning is a decentralized model for training data distributed across client devices. In this…

Information Theory · Computer Science 2023-09-06 Neophytos Charalambides , Mert Pilanci , Alfred Hero

This study develops an algorithm for distributed computing of linear programming problems of huge-scales. Global consensus with single common variable, multiblocks, and augmented Lagrangian are adopted. The consensus is used to partition…

Optimization and Control · Mathematics 2025-08-07 Luoyi Tao

In multi-task remote inference systems, an intelligent receiver (e.g., command center) performs multiple inference tasks (e.g., target detection) using data features received from several remote sources (e.g., edge devices). Key challenges…

Information Theory · Computer Science 2025-08-25 Md Kamran Chowdhury Shisher , Adam Piaseczny , Yin Sun , Christopher G. Brinton