English
Related papers

Related papers: Algorithmic Polarization for Hidden Markov Models

200 papers

We propose a learned-structured unfolding neural network for the problem of compressive sparse multichannel blind-deconvolution. In this problem, each channel's measurements are given as convolution of a common source signal and sparse…

Signal Processing · Electrical Eng. & Systems 2021-02-15 Bahareh Tolooshams , Satish Mulleti , Demba Ba , Yonina C. Eldar

Ar{\i}kan's polar coding, is by now a well studied technique that allows achieving the symmetric capacity of binary input memoryless channels with low complexity encoding and decoding, provided that the polar decoding architecture is used…

Information Theory · Computer Science 2018-05-08 Mine Alsan

We describe a slightly sub-exponential time algorithm for learning parity functions in the presence of random classification noise. This results in a polynomial-time algorithm for the case of parity functions that depend on only the first…

Machine Learning · Computer Science 2007-05-23 Avrim Blum , Adam Kalai , Hal Wasserman

In this paper, we demonstrate some applications of compressive sensing over networks. We make a connection between compressive sensing and traditional information theoretic techniques in source coding and channel coding. Our results provide…

Information Theory · Computer Science 2010-12-07 Soheil Feizi , Muriel Medard , Michelle Effros

Channel polarization is a method of constructing capacity achieving codes for symmetric binary-input discrete memoryless channels (B-DMCs) [1]. In the original paper, the construction complexity is exponential in the blocklength. In this…

Information Theory · Computer Science 2009-05-23 Ryuhei Mori , Toshiyuki Tanaka

Stochastic encoders for channel coding and lossy source coding are introduced with a rate close to the fundamental limits, where the only restriction is that the channel input alphabet and the reproduction alphabet of the lossy source code…

Information Theory · Computer Science 2016-11-15 Jun Muramatsu

This paper introduces an objective function that seeks to minimise the average total number of bits required to encode the joint state of all of the layers of a Markov source. This type of encoder may be applied to the problem of optimising…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Stephen Luttrell

A pruned variant of polar coding is proposed for binary erasure channels. For sufficiently small $\varepsilon>0$, we construct a series of capacity achieving codes with block length $N=\varepsilon^{-5}$, code rate…

Information Theory · Computer Science 2020-12-14 Hsin-Po Wang , Iwan Duursma

Reed Muller (RM) codes are known for their good minimum distance. One can use their structure to construct polar-like codes with good distance properties by choosing the information set as the rows of the polarization matrix with the…

Information Theory · Computer Science 2022-04-15 Samet Gelincik , Philippe Mary , Anne Savard , Jean-Yves Baudais

We present a rate-compatible polar coding scheme that achieves the capacity of any family of channels. Our solution generalizes the previous results [1], [2] that provide capacity-achieving rate-compatible polar codes for a degraded family…

Information Theory · Computer Science 2017-01-24 Marco Mondelli , S. Hamed Hassani , Ivana Marić , Dennis Hui , Song-Nam Hong

The signal demixing problem seeks to separate a superposition of multiple signals into its constituent components. This paper studies a two-stage approach that first decompresses and subsequently deconvolves the noisy and undersampled…

Information Retrieval · Computer Science 2022-05-25 Zhenan Fan , Halyun Jeong , Babhru Joshi , Michael P. Friedlander

The min-sum approximation is widely used in the decoding of polar codes. Although it is a numerical approximation, hardly any penalties are incurred in practice. We give a theoretical justification for this. We consider the common case of a…

Information Theory · Computer Science 2025-03-04 Nir Chisnevski , Ido Tal , Shlomo Shamai

It is known that polar codes can be efficiently constructed for binary-input channels. At the same time, existing algorithms for general input alphabets are less practical because of high complexity. We address the construction problem for…

Information Theory · Computer Science 2017-10-03 Talha Cihad Gulcu , Min Ye , Alexander Barg

Polar codes have been gaining a lot of interest due to it being the first coding scheme to provably achieve the symmetric capacity of a binary memoryless channel with an explicit construction. However, the main drawback of polar codes is…

Information Theory · Computer Science 2019-11-11 Heshani Gamage , Vismika Ranasinghe , Nandana Rajatheva , Matti Latva-aho

In this paper, we introduce a novel class of pre-transformed polar codes, termed as deep polar codes. We first present a deep polar encoder that harnesses a series of multi-layered polar transformations with varying sizes. Our approach to…

Information Theory · Computer Science 2023-08-08 Geon Choi , Namyoon Lee

We consider the problem of compressing memoryless binary data with or without side information at the decoder. We review the parity- and the syndrome-based approaches and discuss their theoretical limits, assuming that there exists a…

Information Theory · Computer Science 2010-08-03 Lorenzo Cappellari , Andrea De Giusti

Channel polarization is a phenomenon in which a particular recursive encoding induces a set of synthesized channels from many instances of a memoryless channel, such that a fraction of the synthesized channels becomes near perfect for data…

Quantum Physics · Physics 2013-06-20 Mark M. Wilde , Saikat Guha

We exploit the redundancy of the language-based source to help polar decoding. By judging the validity of decoded words in the decoded sequence with the help of a dictionary, the polar list decoder constantly detects erroneous paths after…

Information Theory · Computer Science 2020-07-24 Ying Wang , Minghai Qin , Krishna R. Narayanan , Anxiao Jiang , Zvonimir Bandic

It is well-known in the field of lossless data compression that probabilistic next-symbol prediction can be used to compress sequences of symbols. Deep neural networks are able to capture rich dependencies in data, offering a powerful means…

Information Theory · Computer Science 2026-03-10 Aviv Adler , Jennifer Tang

This paper presents a polarization-driven (PD) shortening technique for the design of rate-compatible polar codes. The proposed shortening strategy consists of reducing the generator matrix by relating its row index with the channel…

Information Theory · Computer Science 2018-08-02 R. M. Oliveira , R. C. de Lamare