English
Related papers

Related papers: Statistical Mechanics and error-correction Codes

200 papers

In the Minimum Description Length (MDL) principle, learning from the data is equivalent to an optimal coding problem. We show that the codes that achieve optimal compression in MDL are critical in a very precise sense. First, when they are…

Methodology · Statistics 2018-10-03 Ryan John Cubero , Matteo Marsili , Yasser Roudi

Statistical modeling often involves identifying an optimal estimate to some underlying probability distribution known to satisfy some given constraints. I show here that choosing as estimate the centroid, or center of mass, of the set…

Methodology · Statistics 2013-10-11 Jonathan Landy

Statistical solutions are time-parameterized probability measures on spaces of integrable functions, that have been proposed recently as a framework for global solutions and uncertainty quantification for multi-dimensional hyperbolic system…

Numerical Analysis · Mathematics 2024-09-23 Ulrik Skre Fjordholm , Kjetil Lye , Siddhartha Mishra , Franziska Weber

Starting from a Cluster Variational Method, and inspired by the correctness of the paramagnetic Ansatz (at high temperatures in general, and at any temperature in the 2D Edwards-Anderson model) we propose a novel message passing algorithm…

Disordered Systems and Neural Networks · Physics 2011-12-26 Alejandro Lage-Castellanos , Roberto Mulet , Federico Ricci-Tersenghi , Tommaso Rizzo

The performance of convolutional codes decoding by the Viterbi algorithm should not depend on the particular distribution of zeros and ones in the input messages, as they are linear. However, it was identified that specific implementations…

Information Theory · Computer Science 2015-10-06 Alexey Shapin , Denis Kleyko , Nikita Lyamin , Evgeny Osipov , Oleg Melentyev

We present a new model for LT codes which simplifies the analysis of the error probability of decoding by belief propagation. For any given degree distribution, we provide the first rigorous expression for the limiting error probability as…

Information Theory · Computer Science 2007-07-13 Elitza N. Maneva , Amin Shokrollahi

The construction of Maximum Distance Profile (MDP) convolutional codes in general requires the use of very large finite fields. In contrast convolutional codes with optimal column distances maximize the column distances for a given…

Information Theory · Computer Science 2026-01-29 Julia Lieb , Michael Schaller

In this paper, soft-decision (SD) decoders of permutation trellis code (PTC) with $M$-ary frequency shift keying are designed using three optimization algorithms and presented in four decoding schemes. In a concatenated code such as PTC,…

Signal Processing · Electrical Eng. & Systems 2020-11-12 Oluwafemi Kolade , Mulundumina Shimaponda-Nawa , Daniel J. J. Versfeld , Ling Cheng

In this paper we consider a Metzner-Kapturowski-like decoding algorithm for high-order interleaved sum-rank-metric codes, offering a novel perspective on the decoding process through the concept of an error code. The error code, defined as…

Information Theory · Computer Science 2024-09-30 Thomas Jerkovits , Felicitas Hörmann , Hannes Bartz

This paper investigates the error probability of several decoding methods for a source code with decoder side information, where the decoding methods are: 1) symbol-wise maximum a posteriori decoding, 2) successive-cancellation decoding,…

Information Theory · Computer Science 2019-04-11 Jun Muramatsu

Low rank approximation is an important tool used in many applications of signal processing and machine learning. Recently, randomized sketching algorithms were proposed to effectively construct low rank approximations and obtain approximate…

Information Theory · Computer Science 2018-09-11 Shashanka Ubaru , Arya Mazumdar , Yousef Saad

Using tools developed in a recent work by Shen and the second author, in this paper we carry out an in-depth study on the average decoding error probability of the random matrix ensemble over the erasure channel under three decoding…

Information Theory · Computer Science 2024-04-23 Chin Hei Chan , Fang-Wei Fu , Maosheng Xiong

This work constructs codes that are efficiently decodable from a constant fraction of \emph{worst-case} insertion and deletion errors in three parameter settings: (i) Binary codes with rate approaching 1; (ii) Codes with constant rate for…

Information Theory · Computer Science 2016-05-17 Venkatesan Guruswami , Ray Li

Quantum error correction offers a promising path for performing quantum computations with low errors. Although a fully fault-tolerant execution of a quantum algorithm remains unrealized, recent experimental developments, along with…

We revisit the error correction scheme of real-valued signals when the codeword is corrupted by gross errors on a fraction of entries and a small noise on all the entries. Combining the recent developments of approximate message passing and…

Information Theory · Computer Science 2014-02-04 Jean Barbier , Florent Krzakala , Lenka Zdeborová , Pan Zhang

We devise a deterministic algorithm to efficiently sample high-quality solutions of certain spin-glass systems that encode hard optimization problems. We employ tensor networks to represent the Gibbs distribution of all possible…

Statistical Mechanics · Physics 2021-09-07 Marek M. Rams , Masoud Mohseni , Daniel Eppens , Konrad Jałowiecki , Bartłomiej Gardas

Spin glass systems as lattices of disordered magnets with random interactions have important implications within the theory of magnetization and applications to a wide-range of hard combinatorial optimization problems. Nevertheless, despite…

Disordered Systems and Neural Networks · Physics 2025-10-28 Fredrik Hasselgren , Max O. Al-Hasso , Amy Searle , Joseph Tindall , Marko von der Leyen

It is a typical standard assumption in the density deconvolution problem that the characteristic function of the measurement error distribution is non-zero on the real line. While this condition is assumed in the majority of existing works…

Statistics Theory · Mathematics 2021-01-08 Alexander Goldenshluger , Taeho Kim

flip is an extremely simple and maximally local classical decoder which has been used to great effect in certain classes of classical codes. When applied to quantum codes there exist constant-weight errors (such as half of a stabiliser)…

Quantum Physics · Physics 2023-08-30 T. R. Scruby , K. Nemoto

It is shown that some well-known and some new cyclic codes with orthogonal parity-check equations can be constructed in the finite-field transform domain. It is also shown that, for some binary linear cyclic codes, the performance of the…

Information Theory · Computer Science 2007-07-13 C. Tjhai , M. Tomlinson , R. Horan , M. Ambroze , M. Ahmed