English
Related papers

Related papers: Outlaw distributions and locally decodable codes

200 papers

Aiming at bridging the gap between the maximum likelihood decoding (MLD) and the suboptimal iterative decodings for short or medium length LDPC codes, we present a generalized ordered statistic decoding (OSD) in the form of syndrome…

Information Theory · Computer Science 2008-05-16 Guangwen Li , Guangzeng Feng

We study the problem of bounding the posterior distribution of discrete probabilistic programs with unbounded support, loops, and conditioning. Loops pose the main difficulty in this setting: even if exact Bayesian inference is possible,…

Programming Languages · Computer Science 2024-12-06 Fabian Zaiser , Andrzej S. Murawski , C. -H. Luke Ong

Legal literature on machine learning (ML) tends to focus on harms, and thus tends to reason about individual model outcomes and summary error rates. This focus has masked important aspects of ML that are rooted in its reliance on randomness…

Computers and Society · Computer Science 2024-08-15 A. Feder Cooper , Jonathan Frankle , Christopher De Sa

In this paper, we propose an efficient decoding algorithm for short low-density parity check (LDPC) codes by carefully combining the belief propagation (BP) decoding and order statistic decoding (OSD) algorithms. Specifically, a modified BP…

Information Theory · Computer Science 2023-09-06 Weiyang Zhang , Chentao Yue , Yonghui Li , Branka Vucetic

An index code is said to be locally decodable if each receiver can decode its demand using its side information and by querying only a subset of the transmitted codeword symbols instead of observing the entire codeword. Local decodability…

Information Theory · Computer Science 2019-01-18 Lakshmi Natarajan , Hoang Dau , Prasad Krishnan , V. Lalitha

Langevin Monte Carlo (LMC) is an iterative algorithm used to generate samples from a distribution that is known only up to a normalizing constant. The nonasymptotic dependence of its mixing time on the dimension and target accuracy is…

Machine Learning · Statistics 2020-02-26 Niladri S. Chatterji , Jelena Diakonikolas , Michael I. Jordan , Peter L. Bartlett

A distribution matcher (DM) encodes a binary input data sequence into a sequence of symbols (codeword) with desired target probability distribution. The set of the output codewords constitutes a codebook (or code) of a DM.…

Information Theory · Computer Science 2019-05-06 Marcin Pikus , Wen Xu

The error correction performance of low-density parity-check (LDPC) codes under iterative message-passing decoding is degraded by the presence of certain harmful objects existing in their Tanner graph representation. Depending on the…

Information Theory · Computer Science 2019-04-16 Massimo Battaglioni , Franco Chiaraluce , Marco Baldi , David Mitchell

Product LDPC codes take advantage of LDPC decoding algorithms and the high minimum distance of product codes. We propose to add suitable interleavers to improve the waterfall performance of LDPC decoding. Interleaving also reduces the…

Information Theory · Computer Science 2012-12-21 Marco Baldi , Giovanni Cancellieri , Franco Chiaraluce

We show a nearly optimal lower bound on the length of linear relaxed locally decodable codes (RLDCs). Specifically, we prove that any $q$-query linear RLDC $C\colon \{0,1\}^k \to \{0,1\}^n$ must satisfy $n = k^{1+\Omega(1/q)}$. This bound…

Computational Complexity · Computer Science 2025-11-27 Guy Goldberg , Tom Gur , Sidhant Saraogi

Linear codes have been an interesting subject of study for many years, as linear codes with few weights have applications in secrete sharing, authentication codes, association schemes, and strongly regular graphs. In this paper, a class of…

Information Theory · Computer Science 2016-01-27 Can Xiang , Chunming Tang , Keqin Feng

Large language models (LLMs) have shown their potential in long-context understanding and mathematical reasoning. In this paper, we study the problem of using LLMs to detect tabular anomalies and show that pre-trained LLMs are zero-shot…

Machine Learning · Computer Science 2024-06-25 Aodong Li , Yunhan Zhao , Chen Qiu , Marius Kloft , Padhraic Smyth , Maja Rudolph , Stephan Mandt

The concept of the smoothing parameter plays a crucial role in both lattice-based and code-based cryptography, primarily due to its effectiveness in achieving nearly uniform distributions through the addition of noise. Recent research by…

Information Theory · Computer Science 2024-05-17 Hao Yan , Cong Ling

Large Language Models (LLMs) have demonstrated strong potential for many mathematical problems. However, their performance on graph algorithmic tasks is still unsatisfying, since graphs are naturally more complex in topology and often…

Artificial Intelligence · Computer Science 2026-05-11 Wenjin Li , Jiaming Cui

We propose an approach for optimizing nonbinary (NB) quasi-cyclic (QC) LDPC codes. This approach combines constructing of base parity-check matrices by simulated annealing and labeling the obtained base matrices aimed at maximizing the…

Information Theory · Computer Science 2020-10-23 Irina E. Bocharova , Boris D. Kudryashov , Evgenii P. Ovsyannikov , Vitaly Skachek , Tähvend Uustalu

In this paper a new message passing algorithm, which takes advantage of both tree-based re-parameterization and the knowledge of short cycles, is introduced for the purpose of decoding LDPC codes with short block lengths. The proposed…

Information Theory · Computer Science 2014-03-25 J. Li , R. C. de Lamare

We consider the problem of block-coded communication, where in each block, the channel law belongs to one of two disjoint sets. The decoder is aimed to decode only messages that have undergone a channel from one of the sets, and thus has to…

Information Theory · Computer Science 2015-09-08 Nir Weinberger , Neri Merhav

Let $(X_k)_{k\geq 1}$ and $(Y_k)_{k\geq 1}$ be two independent sequences of i.i.d. random variables, with values in a finite and totally ordered alphabet $\mathcal{A}_m:=\{1,\dots,m\}$, and having respective probability mass function…

Probability · Mathematics 2021-04-13 Clément Deslandes , Christian Houdré

A low-density parity-check (LDPC) code is a linear block code described by a sparse parity-check matrix, which can be efficiently represented by a bipartite Tanner graph. The standard iterative decoding algorithm, known as belief…

Information Theory · Computer Science 2016-05-17 Sachini Jayasooriya , Sarah J. Johnson , Lawrence Ong , Regina Berretta

Detection limits (DLs), where a variable is unable to be measured outside of a certain range, are common in research. Most approaches to handle DLs in the response variable implicitly make parametric assumptions on the distribution of data…

Methodology · Statistics 2022-07-07 Yuqi Tian , Chun Li , Shengxin Tu , Nathan T. James , Frank E. Harrell , Bryan E. Shepherd