中文
相关论文

相关论文: Timely Distributed Computation with Stragglers

200 篇论文

In large scale distributed linear transform problems, coded computation plays an important role to effectively deal with "stragglers" (distributed computations that may get delayed due to few slow or faulty processors). We propose a coded…

信息论 · 计算机科学 2018-04-27 Sinong Wang , Jiashang Liu , Ness Shroff , Pengyu Yang

Peer-to-peer distributed storage systems provide reliable access to data through redundancy spread over nodes across the Internet. A key goal is to minimize the amount of bandwidth used to maintain that redundancy. Storing a file using an…

In our work, we study the age of information ($\AoI$) in a multi-source system where $K$ sources transmit updates of their time-varying processes via a common-aggregator node to a destination node through a channel with packet delivery…

信息论 · 计算机科学 2023-04-25 Shubhransh Singhvi , Praful D. Mankar

In this paper, we present a coded computation (CC) scheme for distributed computation of the inference phase of machine learning (ML) tasks, specifically, the task of image classification. Building upon Agrawal et al.~2022, the proposed…

分布式、并行与集群计算 · 计算机科学 2023-07-12 Jiepeng Tang , Navneet Agrawal , Slawomir Stanczak , Jingge Zhu

Future real-time applications like smart cities will use complex Machine Learning (ML) models for a variety of tasks. Timely status information is required for these applications to be reliable. Offloading computation to a mobile edge cloud…

系统与控制 · 电气工程与系统科学 2024-05-14 Nitya Sathyavageeswaran , Roy D. Yates , Anand D. Sarwate , Narayan Mandayam

Placement delivery arrays for distributed computing (Comp-PDAs) have recently been proposed as a framework to construct universal computing schemes for MapReduce-like systems. In this work, we extend this concept to systems with straggling…

信息论 · 计算机科学 2020-04-28 Qifa Yan , Michèle Wigger , Sheng Yang , Xiaohu Tang

We consider distributed gradient descent in the presence of stragglers. Recent work on \em gradient coding \em and \em approximate gradient coding \em have shown how to add redundancy in distributed gradient descent to guarantee convergence…

信息论 · 计算机科学 2019-05-15 Rawad Bitar , Mary Wootters , Salim El Rouayheb

We consider the setting where a master wants to run a distributed stochastic gradient descent (SGD) algorithm on $n$ workers each having a subset of the data. Distributed SGD may suffer from the effect of stragglers, i.e., slow or…

机器学习 · 计算机科学 2023-10-18 Serge Kas Hanna , Rawad Bitar , Parimal Parag , Venkat Dasari , Salim El Rouayheb

This paper introduces REDC, a comprehensive strategy for offloading computational tasks within mobile Edge Networks (EN) to Distributed Computing (DC) after Rateless Encoding (RE). Despite the efficiency, reliability, and scalability…

分布式、并行与集群计算 · 计算机科学 2024-09-24 Zhongfu Guo , Xinsheng Ji , Wei You , Yu Zhao , Bai Yi , Lingwei Wang

Distributed optimization is vital in solving large-scale machine learning problems. A widely-shared feature of distributed optimization techniques is the requirement that all nodes complete their assigned tasks in each computational epoch…

机器学习 · 计算机科学 2020-06-11 Nuwan Ferdinand , Haider Al-Lawati , Stark C. Draper , Matthew Nokleby

Existing gradient coding schemes introduce identical redundancy across the coordinates of gradients and hence cannot fully utilize the computation results from partial stragglers. This motivates the introduction of diverse redundancies…

分布式、并行与集群计算 · 计算机科学 2021-09-21 Qi Wang , Ying Cui , Chenglin Li , Junni Zou , Hongkai Xiong

In this paper, we examine a status updating system where updates generated by the source are sent to the monitor through an erasure channel. We assume each update consists of $k$ symbols and the symbol erasure in each time slot follows an…

信息论 · 计算机科学 2019-05-01 Songtao Feng , Jing Yang

The proliferation of mobile devices and real-time status updating applications has motivated the optimization of data freshness in the context of age of information (AoI). Meanwhile, increasing computational demands have inspired research…

信息论 · 计算机科学 2025-05-21 Mengqiu Zhou , Meng Zhang , Howard H. Yang , Roy D. Yates

Coded computing has emerged as a promising framework for tackling significant challenges in large-scale distributed computing, including the presence of slow, faulty, or compromised servers. In this approach, each worker node processes a…

机器学习 · 计算机科学 2026-03-26 Parsa Moradi , Behrooz Tahmasebi , Mohammad Ali Maddah-Ali

We consider a communication system in which status updates arrive at a source node, and should be transmitted through a network to the intended destination node. The status updates are samples of a random process under observation,…

信息论 · 计算机科学 2015-06-30 Maice Costa , Marian Codreanu , Anthony Ephremides

Distributed multi-task learning (DMTL) effectively improves model generalization performance through the collaborative training of multiple related models. However, in large-scale learning scenarios, communication bottlenecks severely limit…

信息论 · 计算机科学 2025-07-25 Minquan Cheng , Yongkang Wang , Lingyu Zhang , Youlong Wu

The widespread adoption of distributed learning to train a global model from local data has been hindered by the challenge posed by stragglers. Recent attempts to mitigate this issue through gradient coding have proved difficult due to the…

网络与互联网体系结构 · 计算机科学 2023-07-26 Tingting Yang , Xinghan Wang , Jiahong Ning , Yang Yang

An information source generates independent and identically distributed status update messages from an observed random phenomenon which takes $n$ distinct values based on a given pmf. These update packets are encoded at the transmitter node…

信息论 · 计算机科学 2020-04-14 Melih Bastopcu , Baturalp Buyukates , Sennur Ulukus

Age of information is a new network performance metric that captures the freshness of information at end-users. This paper studies the age of information from a scheduling perspective. To that end, we consider a wireless broadcast network…

最优化与控制 · 数学 2018-09-18 Yu-Pin Hsu , Eytan Modiano , Lingjie Duan

We consider a scenario where a monitor is interested in being up to date with respect to the status of some system which is not directly accessible to this monitor. However, we assume a source node has access to the status and can send…

信息论 · 计算机科学 2016-04-06 Elie Najm , Rajai Nasser