English
Related papers

Related papers: Computational Polarization: An Information-theoret…

200 papers

Coded distributed computing has been considered as a promising technique which makes large-scale systems robust to the "straggler" workers. Yet, practical system models for distributed computing have not been available that reflect the…

Information Theory · Computer Science 2019-01-17 Muah Kim , Jy-yong Sohn , Jaekyun Moon

We consider the problem of coded distributed computing using polar codes. The average execution time of a coded computing system is related to the error probability for transmission over the binary erasure channel in recent work by…

Information Theory · Computer Science 2022-02-02 Dorsa Fathollahi , Marco Mondelli

Polar codes are the first error-correcting codes to provably achieve the channel capacity but with infinite codelengths. For finite codelengths the existing decoder architectures are limited in working frequency by the partial sums…

Hardware Architecture · Computer Science 2015-01-12 Guillaume Berhault , Camille Leroux , Christophe Jego , Dominique Dallet

We propose a realization of quantum computing using polarized photons. The information is coded in two polarization directions of the photons and two-qubit operations are done using conditional Faraday effect. We investigate the performance…

Quantum Physics · Physics 2007-05-23 P. Torma , S. Stenholm

We present POLAR, a polynomial arithmetic-based framework for efficient bounded-time reachability analysis of neural-network controlled systems (NNCSs). Existing approaches that leverage the standard Taylor Model (TM) arithmetic for…

Systems and Control · Electrical Eng. & Systems 2022-12-27 Chao Huang , Jiameng Fan , Zhilu Wang , Yixuan Wang , Weichao Zhou , Jiajun Li , Xin Chen , Wenchao Li , Qi Zhu

We propose a unified coded framework for distributed computing with straggling servers, by introducing a tradeoff between "latency of computation" and "load of communication" for some linear computation tasks. We show that the coded scheme…

Information Theory · Computer Science 2016-10-26 Songze Li , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

Coded computation techniques provide robustness against straggling servers in distributed computing, with the following limitations: First, they increase decoding complexity. Second, they ignore computations carried out by straggling…

Machine Learning · Computer Science 2018-11-29 Emre Ozfatura , Sennur Ulukus , Deniz Gunduz

We prove that, for all binary-input symmetric memoryless channels, polar codes enable reliable communication at rates within $\epsilon > 0$ of the Shannon capacity with a block length, construction complexity, and decoding complexity all…

Information Theory · Computer Science 2013-11-19 Venkatesan Guruswami , Patrick Xia

The aim of this paper is to present a first evaluation of the potential of an asynchronous distributed computation associated to the recently proposed approach, D-iteration: the D-iteration is a fluid diffusion based iterative method, which…

Numerical Analysis · Mathematics 2012-02-29 Dohy Hong

A long-standing vision of backscatter communications is to provide long-range connectivity and high-speed transmissions for batteryless Internet-of-Things (IoT). Recent years have seen major innovations in designing backscatters toward this…

Networking and Internet Architecture · Computer Science 2019-12-19 Guochao Song , Hang Yang , Wei Wang , Tao Jiang

A numerical framework based on network partition and operator splitting is developed to solve nonlinear differential equations of large-scale dynamic processes encountered in physics, chemistry and biology. Under the assumption that those…

Computational Physics · Physics 2018-01-22 Shucheng Pan , Jianhang Wang , Xiangyu Hu , Nikolaus A. Adams

Polar codes are introduced for discrete memoryless broadcast channels. For $m$-user deterministic broadcast channels, polarization is applied to map uniformly random message bits from $m$ independent messages to one codeword while…

Information Theory · Computer Science 2015-04-15 Naveen Goela , Emmanuel Abbe , Michael Gastpar

While performing distributed computations in today's cloud-based platforms, execution speed variations among compute nodes can significantly reduce the performance and create bottlenecks like stragglers. Coded computation techniques…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-04 Krishna Giri Narra , Zhifeng Lin , Mehrdad Kiamari , Salman Avestimehr , Murali Annavaram

The training complexity of deep learning-based channel decoders scales exponentially with the codebook size and therefore with the number of information bits. Thus, neural network decoding (NND) is currently only feasible for very short…

Information Theory · Computer Science 2017-02-23 Sebastian Cammerer , Tobias Gruber , Jakob Hoydis , Stephan ten Brink

Polar coding is a recently proposed coding technique that can provably achieve the channel capacity. The polar code structure, which is based on the original 2x2 generator matrix, polarises the channels, i.e., a portion of the channel…

Information Theory · Computer Science 2019-01-08 Berksan Serbetci , Ali Emre Pusane

Distributed computing enables large-scale computation tasks to be processed over multiple workers in parallel. However, the randomness of communication and computation delays across workers causes the straggler effect, which may degrade the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-20 Yuxuan Sun , Fan Zhang , Junlin Zhao , Sheng Zhou , Zhisheng Niu , Deniz Gündüz

The information-theoretic unconditional security offered by quantum key distribution has spurred the development of larger quantum communication networks. However, as these networks grow so does the strong need to reduce complexity and…

The distributed linearly separable computation problem finds extensive applications across domains such as distributed gradient coding, distributed linear transform, real-time rendering, etc. In this paper, we investigate this problem in a…

Information Theory · Computer Science 2024-01-30 Haoning Chen , Minquan Cheng , Zhenhao Huang , Youlong Wu

A pruned variant of polar coding is proposed for binary erasure channels. For sufficiently small $\varepsilon>0$, we construct a series of capacity achieving codes with block length $N=\varepsilon^{-5}$, code rate…

Information Theory · Computer Science 2020-12-14 Hsin-Po Wang , Iwan Duursma

Polar codes are a new family of error correction codes for which efficient hardware architectures have to be defined for the encoder and the decoder. Polar codes are decoded using the successive cancellation decoding algorithm that includes…

Hardware Architecture · Computer Science 2015-01-12 Guillaume Berhault , Camille Leroux , Christophe Jego , Dominique Dallet