English
Related papers

Related papers: Universal Polarization for Processes with Memory

200 papers

Each memoryless binary-input channel (BIC) can be uniquely described by its Blackwell measure, which is a probability distribution on the unit interval $[0,1]$ with mean $1/2$. Conversely, any such probability distribution defines a BIC.…

Information Theory · Computer Science 2020-09-28 Naveen Goela , Maxim Raginsky

Entanglement subject to noise can not be shielded against decaying. But, in case of many noisy channels, the degradation can be partially prevented by using local unitary operations. We consider the effect of local noise on shared quantum…

Quantum Physics · Physics 2025-02-05 Priya Ghosh , Kornikar Sen , Ujjwal Sen

We establish two strong senses of universality of logarithmic loss as a distortion criterion in lossy compression: For any fixed length lossy compression problem under an arbitrary distortion criterion, we show that there is an equivalent…

Information Theory · Computer Science 2017-09-04 Albert No , Tsachy Weissman

Irreversibility, crucial in both thermodynamics and information theory, is naturally studied by comparing the evolution -- the (forward) channel -- with an associated reverse -- the reverse channel. There are two natural ways to define this…

Quantum Physics · Physics 2024-02-28 Clive Cenxin Aw , Lin Htoo Zaw , Maria Balanzó-Juandó , Valerio Scarani

An oblivious computation is one that is free of direct and indirect information leaks, e.g., due to observable differences in timing and memory access patterns. This paper presents Lambda Obliv, a core language whose type system enforces…

Programming Languages · Computer Science 2019-11-14 David Darais , Ian Sweet , Chang Liu , Michael Hicks

We prove that, for all binary-input symmetric memoryless channels, polar codes enable reliable communication at rates within $\epsilon > 0$ of the Shannon capacity with a block length, construction complexity, and decoding complexity all…

Information Theory · Computer Science 2013-11-19 Venkatesan Guruswami , Patrick Xia

A method of channel polarization, proposed by Arikan, allows us to construct efficient capacity-achieving channel codes. In the original work, binary input discrete memoryless channels are considered. A special case of $q$-ary channel…

Information Theory · Computer Science 2010-07-22 Ryuhei Mori , Toshiyuki Tanaka

Monotone chain polar codes generalize classical polar codes to multivariate settings, offering a flexible approach for achieving the entire admissible rate region in the distributed lossless coding problem. However, this flexibility also…

Information Theory · Computer Science 2025-09-04 Zichang Ren , Chunhang Zheng , Dou Li , Yuping Zhao

A polar coding scheme for fading channels is proposed in this paper. More specifically, the focus is Gaussian fading channel with a BPSK modulation technique, where the equivalent channel could be modeled as a binary symmetric channel with…

Information Theory · Computer Science 2013-04-16 Hongbo Si , O. Ozan Koyluoglu , Sriram Vishwanath

A major challenge in quantum communication is addressing the negative effects of noise on channel capacity, especially for completely depolarizing channels, where information transmission is inherently impossible. The concept of indefinite…

Neural networks often learn simple explanations that fit the majority of the data while memorizing exceptions that deviate from these explanations.This behavior leads to poor generalization when the learned explanations rely on spurious…

Machine Learning · Computer Science 2024-12-11 Reza Bayat , Mohammad Pezeshki , Elvis Dohmatob , David Lopez-Paz , Pascal Vincent

Memoryless and finite-memory policies offer a practical alternative for solving partially observable Markov decision processes (POMDPs), as they operate directly in the output space rather than in the high-dimensional belief space. However,…

Machine Learning · Computer Science 2025-12-15 Roy van Zuijlen , Duarte Antunes

We analyze successive cancellation (SC) decoder by using two random functions. The first function is related to the likelihoods of 0 and 1 in each code position, while the second gives the difference between their posterior probabilities.…

Information Theory · Computer Science 2020-05-26 Ilya Dumer

Coherent information quantifies the achievable rate of the reliable quantum information transmission through a communication channel. Use of the correlated quantum states instead of the factorized ones may result in an increase in the…

Quantum Physics · Physics 2022-06-28 Sergey N. Filippov

Quantum reading provides a general framework where to formulate the statistical discrimination of quantum channels. Several paths have been taken for such a problem. However, there is much to be done in the avenue of optimizing channel…

Information Theory · Computer Science 2022-06-22 Francisco Revson F. Pereira , Stefano Mancini

We introduce synchronizing objectives for Markov decision processes (MDP). Intuitively, a synchronizing objective requires that eventually, at every step there is a state which concentrates almost all the probability mass. In particular, it…

Logic in Computer Science · Computer Science 2011-02-22 Laurent Doyen , Thierry Massart , Mahsa Shirmohammadi

A generalization of the polar coding scheme called mixed-kernels is introduced. This generalization exploits several homogeneous kernels over alphabets of different sizes. An asymptotic analysis of the proposed scheme shows that its…

Information Theory · Computer Science 2015-03-25 Noam Presman , Ofer Shapira , Simon Litsyn

Particularly motivated by DNA storage channels, we consider channels with synchronization errors modeled as insertions and deletions, along with substitutions. We focus on the case where the synchronization error process has memory and…

Information Theory · Computer Science 2026-04-14 Ruslan Morozov , Tolga M. Duman

We show that the amount of coherent quantum information that can be reliably transmitted down a dephasing channel with memory is maximized by separable input states. In particular, we model the channel as a Markov chain or a multimode…

Quantum Physics · Physics 2007-09-09 Antonio D'Arrigo , Giuliano Benenti , Giuseppe Falci

A fundamental challenge in developing general learning algorithms is their tendency to forget past knowledge when adapting to new data. Addressing this problem requires a principled understanding of forgetting; yet, despite decades of…

Machine Learning · Computer Science 2026-02-03 Ben Sanati , Thomas L. Lee , Trevor McInroe , Aidan Scannell , Nikolay Malkin , David Abel , Amos Storkey