English
Related papers

Related papers: Outlaw distributions and locally decodable codes

200 papers

Many proofs in discrete mathematics and theoretical computer science are based on the probabilistic method. To prove the existence of a good object, we pick a random object and show that it is bad with low probability. This method is…

Information Theory · Computer Science 2017-08-01 Pat Morin , Wolfgang Mulzer , Tommy Reddad

Locally repairable codes (LRCs) are a class of codes designed for the local correction of erasures. They have received considerable attention in recent years due to their applications in distributed storage. Most existing results on LRCs do…

Information Theory · Computer Science 2015-11-24 Pengfei Huang , Eitan Yaakobi , Hironori Uchikawa , Paul H. Siegel

In the search for highly efficient decoders for short LDPC codes approaching maximum likelihood performance, a relayed decoding strategy, specifically activating the ordered statistics decoding process upon failure of a neural min-sum…

Information Theory · Computer Science 2024-03-26 Guangwen Li , Xiao Yu

We study ensembles of codes on graphs (generalized low-density parity-check, or LDPC codes) constructed from random graphs and fixed local constrained codes, and their extension to codes on hypergraphs. It is known that the average minimum…

Information Theory · Computer Science 2011-02-22 Alexander Barg , Arya Mazumdar

In this paper, we analyze the coding delay and the average coding delay of random linear network codes (a.k.a. dense codes) and chunked codes (CC), which are an attractive alternative to dense codes due to their lower complexity, over line…

Information Theory · Computer Science 2012-07-26 Anoosheh Heidarzadeh , Amir H. Banihashemi

Most low-density parity-check (LDPC) code constructions are considered over finite fields. In this work, we focus on regular LDPC codes over integer residue rings and analyze their performance with respect to the Lee metric. Their…

Information Theory · Computer Science 2024-08-01 Jessica Bariffi , Hannes Bartz , Gianluigi Liva , Joachim Rosenthal

Say that we are given samples from a distribution $\psi$ over an $n$-dimensional space. We expect or desire $\psi$ to behave like a product distribution (or a $k$-wise independent distribution over its marginals for small $k$). We propose…

Data Structures and Algorithms · Computer Science 2020-11-16 Parikshit Gopalan , Roie Levin , Udi Wieder

The performance of maximum-likelihood (ML) decoding on the binary erasure channel for finite-length low-density parity-check (LDPC) codes from two random ensembles is studied. The theoretical average spectrum of the Gallager ensemble is…

Information Theory · Computer Science 2018-11-21 Irina E. Bocharova , Boris D. Kudryashov , Vitaly Skachek , Eirik Rosnes , Øyvind Ytrehus

Existence of quantum low-density parity-check (LDPC) codes whose minimal distance scales linearly with the number of qubits is a major open problem in quantum information. Its practical interest stems from the need to protect information in…

Quantum Physics · Physics 2021-05-14 Lior Eldar , Maris Ozols , Kevin F. Thompson

Several applications in communication, control, and learning require approximating target distributions to within small informational divergence (I-divergence). The additional requirement of invertibility usually leads to using encoders…

Information Theory · Computer Science 2020-10-22 Patrick Schulte , Rana Ali Amjad , Thomas Wiegart , Gerhard Kramer

Detecting outliers which are grossly different from or inconsistent with the remaining dataset is a major challenge in real-world KDD applications. Existing outlier detection methods are ineffective on scattered real-world datasets due to…

Machine Learning · Computer Science 2009-12-30 Ke Zhang , Marcus Hutter , Huidong Jin

This paper is concerned with the ordered statistic decoding with local constraints (LC-OSD) of binary linear block codes, which is a near maximum-likelihood decoding algorithm. Compared with the conventional OSD, the LC-OSD significantly…

Information Theory · Computer Science 2024-01-31 Jifan Liang , Xiao Ma

We define the error exponent of the typical random code as the long-block limit of the negative normalized expectation of the logarithm of the error probability of the random code, as opposed to the traditional random coding error exponent,…

Information Theory · Computer Science 2017-08-25 Neri Merhav

In this paper, an expression for the asymptotic growth rate of the number of small linear-weight codewords of irregular doubly-generalized LDPC (D-GLDPC) codes is derived. The expression is compact and generalizes existing results for LDPC…

Information Theory · Computer Science 2010-05-05 Mark F. Flanagan , Enrico Paolini , Marco Chiani , Marc Fossorier

We address the problem of performing message-passing-based decoding of quantum LDPC codes under hardware latency limitations. We propose a novel way to do layered decoding that suits quantum constraints and outperforms flooded scheduling,…

Quantum Physics · Physics 2023-08-28 Julien Du Crest , Francisco Garcia-Herrero , Mehdi Mhalla , Valentin Savin , Javier Valls

Locally repairable codes (LRCs) are error correcting codes used in distributed data storage. Besides a global level, they enable errors to be corrected locally, reducing the need for communication between storage nodes. There is a close…

Information Theory · Computer Science 2016-05-24 Antti Pöllänen , Thomas Westerbäck , Ragnar Freij-Hollanti , Camilla Hollanti

Locally repairable codes (LRCs) were originally introduced to enable efficient recovery from erasures in distributed storage systems by accessing only a small number of other symbols. While their structural properties-such as bounds and…

Information Theory · Computer Science 2026-02-23 Hoang Ly , Emina Soljanin , Philip Whiting

Large Language Models (LLMs) have recently been successfully applied to regression tasks -- such as time series forecasting and tabular prediction -- by leveraging their in-context learning abilities. However, their autoregressive decoding…

Machine Learning · Computer Science 2026-03-04 Julianna Piskorz , Katarzyna Kobalczyk , Mihaela van der Schaar

The problem of designing good Space-Time Block Codes (STBCs) with low maximum-likelihood (ML) decoding complexity has gathered much attention in the literature. All the known low ML decoding complexity techniques utilize the same approach…

Information Theory · Computer Science 2015-03-19 Lakshmi Prasad Natarajan , B. Sundar Rajan

Network coding is known to improve the throughput and the resilience to losses in most network scenarios. In a practical network scenario, however, the accurate modeling of the traffic is often too complex and/or infeasible. The goal is…

Information Theory · Computer Science 2009-08-25 Anoosheh Heidarzadeh , Amir H. Banihashemi