English
Related papers

Related papers: Uniquely-Decodable Coding for Zero-Error Network F…

200 papers

Connectivity (or equivalently, unweighted maximum flow) is an important measure in graph theory and combinatorial optimization. Given a graph $G$ with vertices $s$ and $t$, the connectivity $\lambda(s,t)$ from $s$ to $t$ is defined to be…

Data Structures and Algorithms · Computer Science 2024-12-25 Shyan Akmal

One of the important unsolved problems in information theory is the conjecture that network coding has no rate benefit over routing in undirected unicast networks. Three known bounds on the symmetric rate in undirected unicast information…

Information Theory · Computer Science 2020-10-27 Mohammad Ishtiyaq Qureshi , Satyajit Thakor

The classical problem of reliable point-to-point digital communication is to achieve a low probability of error while keeping the rate high and the total power consumption small. Traditional information-theoretic analysis uses `waterfall'…

Information Theory · Computer Science 2008-01-03 Anant Sahai , Pulkit Grover

Graph clustering is a fundamental task in unsupervised learning with broad real-world applications. While spectral clustering methods for undirected graphs are well-established and guided by a minimum cut optimization consensus, their…

Machine Learning · Statistics 2025-06-04 Ning Zhang , Xiaowen Dong , Mihai Cucuringu

Random linear network codes can be designed and implemented in a distributed manner, with low computational complexity. However, these codes are classically implemented over finite fields whose size depends on some global network parameters…

Information Theory · Computer Science 2010-08-04 Tracey Ho , Sidharth Jaggi , Svitlana Vyetrenko , Lingxiao Xia

We propose a unified coded framework for distributed computing with straggling servers, by introducing a tradeoff between "latency of computation" and "load of communication" for some linear computation tasks. We show that the coded scheme…

Information Theory · Computer Science 2016-10-26 Songze Li , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

Deep neural networks have shown incredible performance for inference tasks in a variety of domains. Unfortunately, most current deep networks are enormous cloud-based structures that require significant storage space, which limits scaling…

Information Theory · Computer Science 2020-03-10 Sourya Basu , Lav R. Varshney

In a single hop broadcast packet erasure network, we demonstrate that it is possible to provide multirate packet delivery outside of what is given by the network min-cut. This is achieved by using a deterministic non-block-based network…

Information Theory · Computer Science 2014-01-06 Amy Fu , Parastoo Sadeghi , Muriel Medard

In this paper, we put forward the model of zero-error distributed function compression system of two binary memoryless sources X and Y, where there are two encoders En1 and En2 and one decoder De, connected by two channels (En1, De) and…

Information Theory · Computer Science 2023-05-12 Xuan Guang , Ruze Zhang

Consider a memoryless degraded broadcast channel (DBC) in which the channel output is a single-letter function of the channel input and the channel noise. As examples, for the Gaussian broadcast channel (BC) this single-letter function is…

Information Theory · Computer Science 2011-10-25 Bike Xie , Thomas Courtade , Richard D. Wesel

We consider the zero-error capacity of deletion channels. Specifically, we consider the setting where we choose a codebook ${\cal C}$ consisting of strings of $n$ bits, and our model of the channel corresponds to an adversary who may delete…

Information Theory · Computer Science 2011-02-02 Ian A. Kash , Michael Mitzenmacher , Justin Thaler , Jonathan Ullman

In this paper we define critical graphs as minimal graphs that support a given set of rates for the index coding problem, and study them for both the one-shot and asymptotic setups. For the case of equal rates, we find the critical graph…

Information Theory · Computer Science 2014-04-15 Mehrdad Tahmasbi , Amirbehshad Shahrasbi , Amin Gohari

Training with backpropagation (BP) in standard deep learning consists of two main steps: a forward pass that maps a data point to its prediction, and a backward pass that propagates the error of this prediction back through the network.…

Machine Learning · Computer Science 2022-10-13 Tommaso Salvatori , Luca Pinchetti , Beren Millidge , Yuhang Song , Tianyi Bao , Rafal Bogacz , Thomas Lukasiewicz

We consider in-network computation of an arbitrary function over an arbitrary communication network. A network with capacity constraints on the links is given. Some nodes in the network generate data, e.g., like sensor nodes in a sensor…

Networking and Internet Architecture · Computer Science 2010-10-01 Virag Shah , Bikash Kumar Dey , D. Manjunath

We consider communication over a noisy network under randomized linear network coding. Possible error mechanism include node- or link- failures, Byzantine behavior of nodes, or an over-estimate of the network min-cut. Building on the work…

Information Theory · Computer Science 2007-11-27 Andrea Montanari , Ruediger Urbanke

In this paper, we aim to identify the strategies that can maximize and monotonically increase the density of the coding opportunities in instantly decodable network coding (IDNC).Using the well-known graph representation of IDNC, first…

Information Theory · Computer Science 2013-04-22 Sameh Sorour , Shahrokh Valaee

Coding theoretic approached have been developed to significantly reduce the communication load in modern distributed computing system. In particular, coded distributed computing (CDC) introduced by Li et al. can efficiently trade…

Information Theory · Computer Science 2020-08-04 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji

Index Coding has received considerable attention recently motivated in part by real-world applications and in part by its connection to Network Coding. The basic setting of Index Coding encodes the problem input as an undirected graph and…

Information Theory · Computer Science 2011-07-14 Anna Blasiak , Robert Kleinberg , Eyal Lubetzky

Batched network coding is a variation of random linear network coding which has low computational and storage costs. In order to adapt to random fluctuations in the number of erasures in individual batches, it is not optimal to recode and…

Information Theory · Computer Science 2021-09-16 Hoover H. F. Yin , Bin Tang , Ka Hei Ng , Shenghao Yang , Xishi Wang , Qiaoqiao Zhou

The uplink of a cloud radio access network architecture is studied in which decoding at the cloud takes place via network function virtualization on commercial off-the-shelf servers. In order to mitigate the impact of straggling decoders in…

Information Theory · Computer Science 2018-08-29 Malihe Aliasgari , Jörg Kliewer , Osvaldo Simeone