中文
相关论文

相关论文: Coded Distributed Computing with Pre-set Assignmen…

200 篇论文

This article introduces a novel communication scheme, termed coded compressed sensing, for unsourced multiple-access communication. The proposed divide-and-conquer approach leverages recent advances in compressed sensing and forward error…

信号处理 · 电气工程与系统科学 2019-06-26 Vamsi K. Amalladinne , Jean-Francois Chamberland , Krishna R. Narayanan

A central issue of distributed computing systems is how to optimally allocate computing and storage resources and design data shuffling strategies such that the total execution time for computing and data shuffling is minimized. This is…

信息论 · 计算机科学 2021-02-03 Shu-Jie Cao , Lihui Yi , Haoning Chen , Youlong Wu

Distributed learning platforms for processing large scale data-sets are becoming increasingly prevalent. In typical distributed implementations, a centralized master node breaks the data-set into smaller batches for parallel processing…

信息论 · 计算机科学 2016-10-03 Mohamed Attia , Ravi Tandon

A coded distributed computing (CDC) system aims to reduce the communication load in the MapReduce framework. Such a system has $K$ nodes, $N$ input files, and $Q$ Reduce functions. Each input file is mapped by $r$ nodes and each Reduce…

信息论 · 计算机科学 2023-09-11 Yingjie Cheng , Gaojun Luo , Xiwang Cao , Martianus Frederic Ezerman , San Ling

Coded distributed computing can alleviate the communication load by leveraging the redundant storage and computation resources with coding techniques in distributed computing. In this paper, we study a MapReduce-type distributed computing…

信息论 · 计算机科学 2023-01-11 Qifa Yan , Xiaohu Tang , Meixia Tao , Qin Huang

Coded caching scheme provides us an effective framework to realize additional coded multicasting gain by exploiting coding into multiple transmitted signals. The goal of coded caching design is to jointly optimize the placement and delivery…

信息论 · 计算机科学 2019-06-21 Qiaoling Zhang , Lei Zheng , Minquan Cheng , Qingchun Chen

This paper studies the computation-communication tradeoff in a heterogeneous MapReduce computing system where each distributed node is equipped with different computation capability. We first obtain an achievable communication load for any…

信息论 · 计算机科学 2019-08-20 Fan Xu , Meixia Tao

Today's data centers have an abundance of computing resources, hosting server clusters consisting of as many as tens or hundreds of thousands of machines. To execute a complex computing task over a data center, it is natural to distribute…

信息论 · 计算机科学 2017-02-24 Qian Yu , Songze Li , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

We consider replication-based distributed storage systems in which each node stores the same quantum of data and each data bit stored has the same replication factor across the nodes. Such systems are referred to as balanced distributed…

信息论 · 计算机科学 2024-12-13 Abhinav Vaishya , Athreya Chandramouli , Srikar Kale , Prasad Krishnan

Coded computing has proved to be useful in distributed computing. We have observed that almost all coded computing systems studied so far consider a setup of one master and some workers. However, recently emerging technologies such as…

分布式、并行与集群计算 · 计算机科学 2023-04-13 Nastaran Abadi Khooshemehr , Mohammad Ali Maddah-Ali

We consider a coded distributed computing problem in a ring-based communication network, where $N$ computing nodes are arranged in a ring topology and each node can only communicate with its neighbors within a constant distance $d$. To…

信息论 · 计算机科学 2026-03-06 Zhenhao Huang , Minquan Cheng , Kai Wan , Qifu Tyler Sun , Youlong Wu

Coded distributed computing (CDC) is a new technique proposed with the purpose of decreasing the intense data exchange required for parallelizing distributed computing systems. Under the famous MapReduce paradigm, this coded approach has…

信息论 · 计算机科学 2022-06-28 Federico Brunero , Petros Elia

Distributed computing, in which a resource-intensive task is divided into subtasks and distributed among different machines, plays a key role in solving large-scale problems. Coded computing is a recently emerging paradigm where redundancy…

信息论 · 计算机科学 2023-03-15 Hoang Dau , Ryan Gabrys , Yu-Chih Huang , Chen Feng , Quang-Hung Luu , Eidah Alzahrani , Zahir Tari

Unsourced random access is a novel communication paradigm designed for handling a large number of uncoordinated users that sporadically transmit very short messages. Under this model, coded compressed sensing (CCS) has emerged as a…

Today, modern unmanned aerial vehicles (UAVs) are equipped with increasingly advanced capabilities that can run applications enabled by machine learning techniques, which require computationally intensive operations such as matrix…

计算机科学与博弈论 · 计算机科学 2021-10-29 Wei Chong Ng , Wei Yang Bryan Lim , Jer Shyuan Ng , Suttinee Sawadsitang , Zehui Xiong , Dusit Niyato

In a large-scale distributed machine learning system, coded computing has attracted wide-spread attention since it can effectively alleviate the impact of stragglers. However, several emerging problems greatly limit the performance of coded…

分布式、并行与集群计算 · 计算机科学 2024-06-10 Houming Qiu , Kun Zhu , Nguyen Cong Luong , Dusit Niyato

The emerging large-scale and data-hungry algorithms require the computations to be delegated from a central server to several worker nodes. One major challenge in the distributed computations is to tackle delays and failures caused by the…

信息论 · 计算机科学 2021-03-03 Alejandro Cohen , Guillaume Thiran , Homa Esfahanizadeh , Muriel Médard

Large scale clusters leveraging distributed computing frameworks such as MapReduce routinely process data that are on the orders of petabytes or more. The sheer size of the data precludes the processing of the data on a single computer. The…

信息论 · 计算机科学 2018-02-12 Konstantinos Konstantinidis , Aditya Ramamoorthy

Deploying Convolutional Neural Networks (CNNs) on resource-constrained devices necessitates efficient management of computational resources, often via distributed environments susceptible to latency from straggler nodes. This paper…

分布式、并行与集群计算 · 计算机科学 2025-09-09 Shuo Tan , Rui Liu , Xuesong Han , XianLei Long , Kai Wan , Linqi Song , Yong Li

Building on recent development by Padakandla and Pradhan, and by Lim, Feng, Pastore, Nazer, and Gastpar, this paper studies the potential of structured nested coset coding as a complete replacement for random coding in network information…

信息论 · 计算机科学 2018-01-24 Pinar Sen , Young-Han Kim