English
Related papers

Related papers: Statistical Mechanics and Capacity-Approaching Err…

200 papers

The statistical mechanics of simple glass forming systems in 2 dimensions is worked out. The glass disorder is encoded via a Voronoi tessellation, and the statistical mechanics is performed directly in this encoding. The theory provides,…

Statistical Mechanics · Physics 2007-05-23 H. G. E. Hentschel , Valery Ilyin , Nataliya Makedonska , Itamar Procaccia , Nurith Schupper

Low rank approximation is an important tool used in many applications of signal processing and machine learning. Recently, randomized sketching algorithms were proposed to effectively construct low rank approximations and obtain approximate…

Information Theory · Computer Science 2018-09-11 Shashanka Ubaru , Arya Mazumdar , Yousef Saad

Neural networks can efficiently encode the probability distribution of errors in an error correcting code. Moreover, these distributions can be conditioned on the syndromes of the corresponding errors. This paves a path forward for a…

Quantum Physics · Physics 2017-09-12 Stefan Krastanov , Liang Jiang

The gauge theory of spin glasses and statistical-mechanical formulation of error-correcting codes are reviewed with an emphasis on their similarities. For the gauge theory, we explain the functional identities on dynamical autocorrelation…

Disordered Systems and Neural Networks · Physics 2009-11-07 Hidetoshi Nishimori

Ordered statistics decoding has been instrumental in addressing decoding failures that persist after normalized min-sum decoding in short low-density parity-check codes. Despite its benefits, the high computational complexity of effective…

Information Theory · Computer Science 2025-06-23 Guangwen Li , Xiao Yu

The development and use of large-scale quantum computers relies on integrating quantum error-correcting (QEC) schemes into the quantum computing pipeline. A fundamental part of the QEC protocol is the decoding of the syndrome to identify a…

The problem of computing a linear combination of sources over a multiple access channel is studied. Inner and outer bounds on the optimal tradeoff between the communication rates are established when encoding is restricted to random…

Information Theory · Computer Science 2018-10-30 Pinar Sen , Sung Hoon Lim , Young-Han Kim

We work out a theory of approximate quantum error correction that allows us to derive a general lower bound for the entanglement fidelity of a quantum code. The lower bound is given in terms of Kraus operators of the quantum noise. This…

Quantum Physics · Physics 2009-11-13 Rochus Klesse

We investigate an encoding scheme for lossy compression of a binary symmetric source based on simple spatially coupled Low-Density Generator-Matrix codes. The degree of the check nodes is regular and the one of code-bits is Poisson…

Information Theory · Computer Science 2015-06-12 Vahid Aref , Nicolas Macris , Marc Vuffray

Quantum error correction is an essential technique for constructing a scalable quantum computer. In order to implement quantum error correction with near-term quantum devices, a fast and near-optimal decoding method is demanded. A decoder…

Quantum Physics · Physics 2020-09-16 Amarsanaa Davaasuren , Yasunari Suzuki , Keisuke Fujii , Masato Koashi

The performance of ``typical set (pairs) decoding'' for ensembles of Gallager's linear code is investigated using statistical physics. In this decoding, error happens when the information transmission is corrupted by an untypical noise or…

Disordered Systems and Neural Networks · Physics 2009-11-07 Yoshiyuki Kabashima , Kazutaka Nakamura , Jort van Mourik

We introduce the concept of an \ff-maximal error-detecting block code, for some parameter \ff{} between 0 and 1, in order to formalize the situation where a block code is close to maximal with respect to being error-detecting. Our…

Information Theory · Computer Science 2016-08-01 Stavros Konstantinidis , Nelma Moreira , Rogerio Reis

Reliability in terms of functional properties from the safety-liveness spectrum is an indispensable requirement of low-level operating-system (OS) code. However, with evermore complex and thus less predictable hardware, quantitative and…

We present a framework that can exploit the tradeoff between the undetected error rate (UER) and block error rate (BLER) of polar-like codes. It is compatible with all successive cancellation (SC)-based decoding methods and relies on a…

Information Theory · Computer Science 2024-05-03 Peihong Yuan , Ken R. Duffy , Muriel Médard

For a number of quantum channels of interest, phase-flip errors occur far more frequently than bit-flip errors. When transmitting across these asymmetric channels, the decoding error rate can be reduced by tailoring the code used to the…

Quantum Physics · Physics 2020-03-25 Alex Rigby , JC Olivier , Peter Jarvis

This paper studies a large random matrix system (LRMS) model involving an arbitrary signal distribution and forward error control (FEC) coding. We establish an area property based on the so-called Turbo approximate message passing…

Information Theory · Computer Science 2021-06-04 Lei Liu , Chulong Liang , Junjie Ma , Li Ping

This paper considers the average complexity of maximum likelihood (ML) decoding of convolutional codes. ML decoding can be modeled as finding the most probable path taken through a Markov graph. Integrated with the Viterbi algorithm (VA),…

Information Theory · Computer Science 2016-11-17 Jie Luo

Error Span Detection (ESD) extends automatic machine translation (MT) evaluation by localizing translation errors and labeling their severity. Current generative ESD methods typically use Maximum a Posteriori (MAP) decoding, assuming that…

Computation and Language · Computer Science 2026-01-01 Boxuan Lyu , Haiyue Song , Hidetaka Kamigaito , Chenchen Ding , Hideki Tanaka , Masao Utiyama , Kotaro Funakoshi , Manabu Okumura

The process of dynamic state estimation (filtering) based on point process observations is in general intractable. Numerical sampling techniques are often practically useful, but lead to limited conceptual insight about optimal…

Machine Learning · Statistics 2016-09-13 Yuval Harel , Ron Meir , Manfred Opper

In this paper we consider regular low-density parity-check codes over a binary-symmetric channel in the decoding regime. We prove that up to a certain noise threshold the bit-error probability of the bit-sampling decoder converges in mean…

Information Theory · Computer Science 2015-09-21 Marc Vuffray , Theodor Misiakiewicz