English
Related papers

Related papers: Straggler Resilient Serverless Computing Based on …

200 papers

Polar codes are an exciting new class of error correcting codes that achieve the symmetric capacity of memoryless channels. Many decoding algorithms were developed and implemented, addressing various application requirements: from…

In a distributed computing system for the master-worker framework, an erasure code can mitigate the effects of slow workers, also called stragglers. The distributed computing system combined with coding is referred to as coded computation.…

Information Theory · Computer Science 2018-12-05 Minchul Kim , Heecheol Yang , Jungwoo Lee

In large scale distributed linear transform problems, coded computation plays an important role to effectively deal with "stragglers" (distributed computations that may get delayed due to few slow or faulty processors). We propose a coded…

Information Theory · Computer Science 2018-04-27 Sinong Wang , Jiashang Liu , Ness Shroff , Pengyu Yang

Data is found everywhere, from health and human infrastructure to the surge of sensors and the proliferation of internet-connected devices. To meet this challenge, the data engineering field has expanded significantly in recent years in…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-06 Mills Staylor , Arup Kumar Sarker , Gregor von Laszewski , Geoffrey Fox , Yue Cheng , Judy Fox

In a large-scale and distributed matrix multiplication problem $C=A^{\intercal}B$, where $C\in\mathbb{R}^{r\times t}$, the coded computation plays an important role to effectively deal with "stragglers" (distributed computations that may…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-19 Sinong Wang , Jiashang Liu , Ness Shroff

Recent trends in Web development demonstrate an increased interest in serverless applications, i.e. applications that utilize computational resources provided by cloud services on demand instead of requiring traditional server management.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-31 Vladislav Tankov , Yaroslav Golubev , Timofey Bryksin

One of the major challenges in using distributed learning to train complicated models with large data sets is to deal with stragglers effect. As a solution, coded computation has been recently proposed to efficiently add redundancy to the…

Information Theory · Computer Science 2021-11-02 Tayyebeh Jahani-Nezhad , Mohammad Ali Maddah-Ali

Machine learning algorithms are typically run on large scale, distributed compute infrastructure that routinely face a number of unavailabilities such as failures and temporary slowdowns. Adding redundant computations using coding-theoretic…

Machine Learning · Computer Science 2018-06-05 Jack Kosaian , K. V. Rashmi , Shivaram Venkataraman

We propose a novel coupling technique for the design of polar codes of length N, making them decodable through a sliding window of size M < N. This feature allows to reduce the computational complexity of the decoder, an important…

Information Theory · Computer Science 2021-05-06 Valerio Bioglio , Carlo Condo , Ingmar Land

Coded polynomial aggregation (CPA) in distributed computing systems enables the master to directly recover a weighted aggregation of polynomial computations without individually decoding each term, thereby reducing the number of required…

Information Theory · Computer Science 2026-02-04 Xi Zhong , Jörg Kliewer , Mingyue Ji

The widespread deployment of large-scale, compute-intensive applications such as high-performance computing, artificial intelligence, and big data is leading to convergence between cloud and high-performance computing infrastructures. Cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-15 Valerio Besozzi , Matteo Della Bartola , Patrizio Dazzi , Marco Danelutto

Next generation technologies such as smart healthcare, self-driving cars, and smart cities require new approaches to deal with the network traffic generated by the Internet of Things (IoT) devices, as well as efficient programming models to…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-20 Quoc Lap Trieu , Bahman Javadi , Jim Basilakis , Adel N. Toosi

The rise of LLMs has driven demand for private serverless deployments, characterized by moderate-sized models and infrequent requests. While existing serverless solutions follow exclusive GPU allocation, we take a step back to explore…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-16 Chuhao Xu , Zijun Li , Quan Chen , Han Zhao , Xueyan Tang , Minyi Guo

A capacity-achieving scheme based on polar codes is proposed for reliable communication over multi-channels which can be directly applied to bit-interleaved coded modulation schemes. We start by reviewing the ground-breaking work of polar…

Information Theory · Computer Science 2013-02-04 Hessam Mahdavifar , Mostafa El-Khamy , Jungwon Lee , Inyup Kang

The distributed linearly separable computation problem finds extensive applications across domains such as distributed gradient coding, distributed linear transform, real-time rendering, etc. In this paper, we investigate this problem in a…

Information Theory · Computer Science 2024-01-30 Haoning Chen , Minquan Cheng , Zhenhao Huang , Youlong Wu

The recently-discovered polar codes are seen as a major breakthrough in coding theory; they provably achieve the theoretical capacity of discrete memoryless channels using the low complexity successive cancellation (SC) decoding algorithm.…

Hardware Architecture · Computer Science 2015-03-19 Camille Leroux , Alexandre J. Raymond , Gabi Sarkis , Ido Tal , Alexander Vardy , Warren J. Gross

In this paper, we propose a new polar coding scheme for the unsourced, uncoordinated Gaussian random access channel. Our scheme is based on sparse spreading, treat interference as noise and successive interference cancellation (SIC). On the…

Information Theory · Computer Science 2020-07-14 Mengfan Zheng , Yongpeng Wu , Wenjun Zhang

Distributed computing is known as an emerging and efficient technique to support various intelligent services, such as large-scale machine learning. However, privacy leakage and random delays from straggling servers pose significant…

Information Theory · Computer Science 2023-10-31 Qicheng Zeng , Zhaojun Nan , Sheng Zhou

In this paper, we introduce stitched polar codes, a novel generalization of Ar{\i}kan's regular polar codes. Our core methodology reconfigures the fundamental polarization process by stitching additional structures to enhance the…

Information Theory · Computer Science 2025-11-25 Yuan Li , Zicheng Ye , Huazi Zhang , Jun Wang , Wen Tong , Guiying Yan , Zhiming Ma

Operating a modern power grid reliably in case of SCADA/EMS failure or amid difficult times like COVID-19 pandemic is a challenging task for grid operators. In [11], a PMU-based emergency generation dispatch scheme has been proposed to help…

Physics and Society · Physics 2021-08-03 Song Zhang , Xiaochuan Luo , Eugene Litvinov