English
Related papers

Related papers: The Capacity of Random Linear Coding Networks as S…

200 papers

Multiple Description Coding (MDC) is a promising error-resilient source coding method that is particularly suitable for dynamic networks with multiple (yet noisy and unreliable) paths. However, conventional MDC video codecs suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Xinyue Hu , Wei Ye , Jiaxiang Tang , Eman Ramadan , Zhi-Li Zhang

Multiple description coding (MDC) is able to stably transmit the signal in the un-reliable and non-prioritized networks, which has been broadly studied for several decades. However, the traditional MDC doesn't well leverage image's context…

Multimedia · Computer Science 2019-03-01 Lijun Zhao , Huihui Bai , Anhong Wang , Yao Zhao

By concatenating a polar transform with a convolutional transform, polarization-adjusted convolutional (PAC) codes can reach the dispersion approximation bound in certain rate cases. However, the sequential decoding nature of traditional…

Information Theory · Computer Science 2024-09-24 Jingxin Dai , Hang Yin , Yansong Lv , Yuhuan Wang , Rui Lv

We present a new Deep Dictionary Learning and Coding Network (DDLCN) for image recognition tasks with limited data. The proposed DDLCN has most of the standard deep learning layers (e.g., input/output, pooling, fully connected, etc.), but…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Hao Tang , Hong Liu , Wei Xiao , Nicu Sebe

Classically, communication systems are designed assuming perfect channel state information at the receiver and/or transmitter. However, in many practical situations, only an estimate of the channel is available that differs from the true…

Information Theory · Computer Science 2007-07-13 Pablo Piantanida , Gerald Matz , Pierre Duhamel

This paper underscores the conjecture that intrinsic computation is maximal in systems at the "edge of chaos." We study the relationship between dynamics and computational capability in Random Boolean Networks (RBN) for Reservoir Computing…

Adaptation and Self-Organizing Systems · Physics 2013-04-23 David Snyder , Alireza Goudarzi , Christof Teuscher

In this work, we analyze the capabilities and practical limitations of neural networks (NNs) for sequence-based signal processing which can be seen as an omnipresent property in almost any modern communication systems. In particular, we…

Information Theory · Computer Science 2019-11-22 Daniel Tandler , Sebastian Dörner , Sebastian Cammerer , Stephan ten Brink

The question whether RM codes are capacity-achieving is a long-standing open problem in coding theory that was recently answered in the affirmative for transmission over erasure channels [1], [2]. Remarkably, the proof does not rely on…

Information Theory · Computer Science 2016-07-12 Shrinivas Kudekar , Santhosh Kumar , Marco Mondelli , Henry D. Pfister , Rüdiger Urbanke

In this paper, we study the coding delay and the average coding delay of random linear network codes (dense codes) over line networks with deterministic regular and Poisson transmission schedules. We consider both lossless networks and…

Information Theory · Computer Science 2012-02-03 Anoosheh Heidarzadeh , Amir H. Banihashemi

In this paper, we study a wireless packet broadcast system that uses linear network coding (LNC) to help receivers recover data packets that are missing due to packet erasures. We study two intertwined performance metrics, namely throughput…

Information Theory · Computer Science 2017-01-18 Mingchao Yu , Parastoo Sadeghi

While random linear network coding is a powerful tool for disseminating information in communication networks, it is highly susceptible to errors caused by various sources. Due to error propagation, errors greatly deteriorate the throughput…

Information Theory · Computer Science 2016-11-15 Ning Chen , Zhiyuan Yan , Maximilien Gadouleau , Ying Wang , Bruce W. Suter

Deep neural networks (DNN) with a huge number of adjustable parameters remain largely black boxes. To shed light on the hidden layers of DNN, we study supervised learning by a DNN of width $N$ and depth $L$ consisting of $NL$ perceptrons…

Disordered Systems and Neural Networks · Physics 2023-08-01 Hajime Yoshino

Some Deep Neural Networks (DNN) have what we call lanes, or they can be reorganized as such. Lanes are paths in the network which are data-independent and typically learn different features or add resilience to the network. Given their…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Vanderson M. do Rosario , Mauricio Breternitz , Edson Borin

Recurrent Neural Cascades (RNCs) are the recurrent neural networks with no cyclic dependencies among recurrent neurons. This class of recurrent networks has received a lot of attention in practice. Besides training methods for a fixed…

Machine Learning · Computer Science 2024-09-09 Nadezda Alexandrovna Knorozova , Alessandro Ronca

We study the problem of strong coordination of the actions of two nodes $X$ and $Y$ that communicate over a discrete memoryless channel (DMC) such that the actions follow a prescribed joint probability distribution. We propose two novel…

Information Theory · Computer Science 2021-06-29 Sarah A. Obead , Badri N. Vellambi , Jörg Kliewer

A key attribute that drives the unprecedented success of modern Recurrent Neural Networks (RNNs) on learning tasks which involve sequential data, is their ability to model intricate long-term temporal dependencies. However, a well…

Machine Learning · Computer Science 2018-06-07 Yoav Levine , Or Sharir , Alon Ziv , Amnon Shashua

With the demand of high data rate and low latency in fifth generation (5G), deep neural network decoder (NND) has become a promising candidate due to its capability of one-shot decoding and parallel computing. In this paper, three types of…

Signal Processing · Electrical Eng. & Systems 2018-02-01 Wei Lyu , Zhaoyang Zhang , Chunxu Jiao , Kangjian Qin , Huazi Zhang

We propose a novel adaptive and causal random linear network coding (AC-RLNC) algorithm with forward error correction (FEC) for a point-to-point communication channel with delayed feedback. AC-RLNC is adaptive to the channel condition, that…

Information Theory · Computer Science 2019-09-30 Alejandro Cohen , Derya Malak , Vered Bar Bracha , Muriel Medard

Physical-layer Network Coding (PNC) can significantly improve the throughput of two-way relay channels. An interesting variant of PNC is Analog Network Coding (ANC). Almost all ANC schemes proposed to date, however, operate in a symbol by…

Information Theory · Computer Science 2011-10-17 Shengli Zhang , Soung-Chang Liew , Qingfeng Zhou , Lu Lu , Hui Wang

We recently showed in [1] the superiority of certain structured coding matrices ensembles (such as partial row-orthogonal) for sparse superposition codes when compared with purely random matrices with i.i.d. entries, both…

Information Theory · Computer Science 2022-07-12 YuHao Liu , Teng Fu , Jean Barbier , TianQi Hou