English
Related papers

Related papers: Maximum likelihood decoding for multilevel channel…

200 papers

We formulate maximum likelihood (ML) channel decoding as a quadratic unconstraint binary optimization (QUBO) and simulate the decoding by the current commercial quantum annealing machine, D-Wave 2000Q. We prepared two implementations with…

Information Theory · Computer Science 2020-10-06 Naoki Ide , Tetsuya Asayama , Hiroshi Ueno , Masayuki Ohzeki

We consider the reverse problem to the distinguishability of two quantum channels, which we call the disguising problem. Given two quantum channels, the goal here is to make the two channels identical by mixing with some other channels with…

Quantum Physics · Physics 2014-02-25 Chi-Hang Fred Fung , H. F. Chau

We are motivated by problems that arise in a number of applications such as Online Marketing and Explosives detection, where the observations are usually modeled using Poisson statistics. We model each observation as a Poisson random…

Machine Learning · Statistics 2016-06-29 Mohammad H. Rohban , Delaram Motamedvaziri , Venkatesh Saligrama

We study the channel coding problem when errors and uncertainty occur in the encoding process. For simplicity we assume the channel between the encoder and the decoder is perfect. Focusing on linear block codes, we model the encoding…

Information Theory · Computer Science 2013-05-17 Jad Hachem , I-Hsiang Wang , Christina Fragouli , Suhas Diggavi

We consider the problem of error control in a coded, multicast network, focusing on the scenario where the errors can occur only on a proper subset of the network edges. We model this problem via an adversarial noise, presenting a formal…

Information Theory · Computer Science 2022-05-31 Allison Beemer , Altan Berdan Kilic , Alberto Ravagnani

In this work we explore possibilities for coding and decoding tailor-made for mean squared error evaluation of error in contexts such as image transmission. To do so, we introduce a loss function that expresses the overall performance of a…

Information Theory · Computer Science 2014-11-06 Marcelo Firer , Luciano Panek , Jerry Anderson Pinheiro

The problem of computing a linear combination of sources over a multiple access channel is studied. Inner and outer bounds on the optimal tradeoff between the communication rates are established when encoding is restricted to random…

Information Theory · Computer Science 2018-10-30 Pinar Sen , Sung Hoon Lim , Young-Han Kim

This manuscript investigates channel capacity under mismatched stochastic likelihood decoding. We derive Feinstein- and Verd\'u-Han-style bounds on the error probability coded communication. These are used to obtain a general…

Information Theory · Computer Science 2026-04-21 Francesc Molina , Albert Guillen i Fabregas

This paper derives fundamental limits associated with compressive classification of Gaussian mixture source models. In particular, we offer an asymptotic characterization of the behavior of the (upper bound to the) misclassification…

Information Theory · Computer Science 2019-08-15 Hugo Reboredo , Francesco Renna , Robert Calderbank , Miguel R. D. Rodrigues

We study the problem of characterizing when two memoryless binary asymmetric channels, described by their transition probabilities $(p,q)$ and $(p',q')$, are equivalent from the point of view of maximum likelihood decoding (MLD) when…

Information Theory · Computer Science 2018-03-20 Claudio Qureshi , Sueli I. R. Costa , Christiane B. Rodrigues , Marcelo Firer

In this paper we consider a channel model that is often used to describe the mobile wireless scenario: multiple-antenna additive white Gaussian noise channels subject to random (fading) gain with full channel state information at the…

Information Theory · Computer Science 2018-06-28 Austin Collins , Yury Polyanskiy

The problem of maximum likelihood decoding with a neural decoder for error-correcting code is considered. It is shown that the neural decoder can be improved with two novel loss terms on the node's activations. The first loss term imposes a…

Information Theory · Computer Science 2022-08-12 Eliya Nachmani , Yair Be'ery

An erasure channel with a fixed alphabet size $q$, where $q \gg 1$, is studied. It is proved that over any erasure channel (with or without memory), Maximum Distance Separable (MDS) codes achieve the minimum probability of error (assuming…

Information Theory · Computer Science 2008-06-06 Shervan Fashandi , Shahab Oveis Gharan , Amir K. Khandani

Top-$k$ decoding is a widely used method for sampling from LLMs: at each token, only the largest $k$ next-token-probabilities are kept, and the next token is sampled after re-normalizing them to sum to unity. Top-$k$ and other sampling…

Artificial Intelligence · Computer Science 2026-02-24 Georgy Noarov , Soham Mallick , Tao Wang , Sunay Joshi , Yan Sun , Yangxinyu Xie , Mengxin Yu , Edgar Dobriban

This paper studies the mismatched decoding problem for binary-input discrete memoryless channels. An example is provided for which an achievable rate based on superposition coding exceeds the LM rate (Hui, 1983; Csisz\'ar-K\"orner, 1981),…

Information Theory · Computer Science 2015-08-11 Jonathan Scarlett , Anelia Somekh-Baruch , Alfonso Martinez , Albert Guillén i Fàbregas

Over discrete memoryless channels (DMC), linear decoders (maximizing additive metrics) afford several nice properties. In particular, if suitable encoders are employed, the use of decoding algorithm with manageable complexities is…

Information Theory · Computer Science 2008-10-01 Emmanuel Abbe , Lizhong Zheng

Maximum Likelihood (ML) algorithms, for the joint estimation of synchronization impairments and channel in Multiple Input Multiple Output-Orthogonal Frequency Division Multiplexing (MIMO-OFDM) system, are investigated in this work. A system…

Information Theory · Computer Science 2012-10-30 Renu Jose , K. V. S. Hari

In this letter, we analyse the properties of a maximum likelihood channel estimator based on the syndrome of a linear code. For the two examples of a binary symmetric channel and a binary input additive white Gaussian noise channel, we…

Information Theory · Computer Science 2013-12-12 Gottfried Lechner , Christoph Pacher

We consider communication over memoryless channels using low-density parity-check code ensembles above the iterative (belief propagation) threshold. What is the computational complexity of decoding (i.e., of reconstructing all the typical…

Information Theory · Computer Science 2007-07-13 Cyril Measson , Andrea Montanari , Tom Richardson , Rudiger Urbanke

We propose to use the concept of the Hamming bound to derive the optimal criteria for learning hash codes with a deep network. In particular, when the number of binary hash codes (typically the number of image categories) and code length…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Xiang Xu , Xiaofang Wang , Kris M. Kitani