English
Related papers

Related papers: Distributed Computing with Heterogeneous Communica…

200 papers

Distributed processing across a networked environment suffers from unpredictable behavior of speedup due to heterogeneous nature of the hardware and software in the remote machines. It is challenging to get a better performance from a…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-03-31 M. Shahriar Hossain , M. Muztaba Fuad , Debzani Deb , Kazi Muhammad Najmul Hasan Khan , Md. Mahbubul Alam Joarder

Distributed optimization concerns the optimization of a common function in a distributed network, which finds a wide range of applications ranging from machine learning to vehicle platooning. Its key operation is to aggregate all local…

Information Theory · Computer Science 2022-04-15 Zhenyi Lin , Yi Gong , Kaibin Huang

The distributed linearly separable computation problem finds extensive applications across domains such as distributed gradient coding, distributed linear transform, real-time rendering, etc. In this paper, we investigate this problem in a…

Information Theory · Computer Science 2024-01-30 Haoning Chen , Minquan Cheng , Zhenhao Huang , Youlong Wu

Clustering large datasets is a fundamental problem with a number of applications in machine learning. Data is often collected on different sites and clustering needs to be performed in a distributed manner with low communication. We would…

Data Structures and Algorithms · Computer Science 2017-02-02 Jiecao Chen , He Sun , David P. Woodruff , Qin Zhang

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a…

Machine Learning · Computer Science 2016-10-11 Jakub Konečný , H. Brendan McMahan , Daniel Ramage , Peter Richtárik

In modern machine learning, users often have to collaborate to learn the distribution of the data. Communication can be a significant bottleneck. Prior work has studied homogeneous users -- i.e., whose data follow the same discrete…

Machine Learning · Statistics 2022-10-12 Xinmeng Huang , Donghwan Lee , Edgar Dobriban , Hamed Hassani

Simulation is a fundamental research tool in the computer architecture field. These kinds of tools enable the exploration and evaluation of architectural proposals capturing the most relevant aspects of the highly complex systems under…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-11 Adrian Colaso , Pablo Prieto , Jose-Angel Herrero , Pablo Abad , Valentin Puente , Jose-Angel Gregorio

Most of the prior work in massively parallel data processing assumes homogeneity, i.e., every computing unit has the same computational capability, and can communicate with every other unit with the same latency and bandwidth. However, this…

Databases · Computer Science 2020-09-25 Xiao Hu , Paraschos Koutris , Spyros Blanas

MapReduce has proven to be one of the most useful paradigms in the revolution of distributed computing, where cloud services and cluster computing become the standard venue for computing. The federation of cloud and big data activities is…

Databases · Computer Science 2016-07-29 Foto Afrati , Shlomi Dolev , Shantanu Sharma , Jeffrey D. Ullman

Several network communication problems are highly related such as coded caching and distributed computation. The centralized coded caching focuses on reducing the network burden in peak times in a wireless network system and the coded…

Information Theory · Computer Science 2022-09-13 Min Xu , Zixiang Xu , Gennian Ge , Min-Qian Liu

The paper presents an improved upper bound (achievability result) on the optimal tradeoff between Normalized Delivery Time (NDT) and computation load for distributed computing MapReduce systems in certain ranges of the parameters. The upper…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Yue Bi , Michèle Wigger

In distributed learning, the goal is to perform a learning task over data distributed across multiple nodes with minimal (expensive) communication. Prior work (Daume III et al., 2012) proposes a general model that bounds the communication…

Machine Learning · Computer Science 2012-04-17 Hal Daume , Jeff M. Phillips , Avishek Saha , Suresh Venkatasubramanian

We consider a mobile edge computing scenario where users want to perform a linear inference operation $\boldsymbol{W} \boldsymbol{x}$ on local data $\boldsymbol{x}$ for some network-side matrix $\boldsymbol{W}$. The inference is performed…

Information Theory · Computer Science 2021-08-18 Anton Frigård , Siddhartha Kumar , Eirik Rosnes , Alexandre Graell i Amat

We consider a generalization of the gradient coding framework where a dataset is divided across $n$ workers and each worker transmits to a master node one or more linear combinations of the gradients over its assigned data subsets. Unlike…

Information Theory · Computer Science 2022-05-03 Sahasrajit Sarmasarkar , V. Lalitha , Nikhil Karamchandani

Driven by great demands on low-latency services of the edge devices (EDs), mobile edge computing (MEC) has been proposed to enable the computing capacities at the edge of the radio access network. However, conventional MEC servers suffer…

Signal Processing · Electrical Eng. & Systems 2019-01-29 Pengfei Wang , Zijie Zheng , Boya Di , Lingyang Song

Recent studies on cloud-radio access networks assume either signal-level or scheduling-level coordination. This paper considers a hybrid coordinated scheme as a means to benefit from both policies. Consider the downlink of a multi-cloud…

Information Theory · Computer Science 2016-10-14 Ahmed Douik , Hayssam Dahrouj , Tareq Y. Al-Naffouri , Mohamed-Slim Alouini

We consider a parallel system of $m$ identical machines prone to unpredictable crashes and restarts, trying to cope with the continuous arrival of tasks to be executed. Tasks have different computational requirements (i.e., processing time…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-21 Elli Zavou , Antonio Fernández Anta

We study the problem of finding and monitoring fixed-size subgraphs in a continually changing large-scale graph. We present the first approach that (i) performs worst-case optimal computation and communication, (ii) maintains a total memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-13 Khaled Ammar , Frank McSherry , Semih Salihoglu , Manas Joglekar

Emerging edge computing paradigms enable heterogeneous devices to collaborate on complex computation applications. However, for congestible links and computing units, delay-optimal forwarding and offloading for service chain tasks (e.g.,…

Networking and Internet Architecture · Computer Science 2024-03-26 Jinkun Zhang , Yuezhou Liu , Edmund Yeh

This paper introduces REDC, a comprehensive strategy for offloading computational tasks within mobile Edge Networks (EN) to Distributed Computing (DC) after Rateless Encoding (RE). Despite the efficiency, reliability, and scalability…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-24 Zhongfu Guo , Xinsheng Ji , Wei You , Yu Zhao , Bai Yi , Lingwei Wang