English
Related papers

Related papers: Large Deviations Behavior of the Logarithmic Error…

200 papers

This paper establishes the exact strong converse exponent of the soft covering problem in the classical setting. This exponent characterizes the slowest achievable convergence speed of the total variation to one when a code of rate below…

Information Theory · Computer Science 2026-04-01 Xingyi He , S. Sandeep Pradhan , Andreas Winter

In this work, we prove new results concerning the combinatorial properties of random linear codes. Firstly, we prove a lower bound on the list-size required for random linear codes over $\mathbb F_q$ $\varepsilon$-close to capacity to…

Information Theory · Computer Science 2022-05-04 Nicolas Resch , Chen Yuan

Detecting Large Language Model (LLM)-generated code is a growing challenge with implications for security, intellectual property, and academic integrity. We investigate the role of conditional probability distributions in improving…

Computation and Language · Computer Science 2025-06-09 Maor Ashkenazi , Ofir Brenner , Tal Furman Shohet , Eran Treister

In this paper, we analyze the tradeoff between coding rate and asymptotic performance of a class of generalized low-density parity-check (GLDPC) codes constructed by including a certain fraction of generalized constraint (GC) nodes in the…

Information Theory · Computer Science 2019-10-16 Yanfang Liu , Pablo M. Olmos , Tobias Koch

The likelihood decoder is a stochastic decoder that selects the decoded message at random, using the posterior distribution of the true underlying message given the channel output. In this work, we study a generalized version of this…

Information Theory · Computer Science 2016-11-17 Neri Merhav

In this work, a new upper bound for average error probability of a two-user discrete memoryless (DM) multiple-access channel (MAC) is derived. This bound can be universally obtained for all discrete memoryless MACs with given input and…

Information Theory · Computer Science 2009-01-09 Ali Nazari , Achilleas Anastasopoulos , S. Sandeep Pradhan

This article proposes a convenient tool for decoding the output of neural networks trained by Connectionist Temporal Classification (CTC) for handwritten text recognition. We use regular expressions to describe the complex structures…

Neural and Evolutionary Computing · Computer Science 2016-03-31 Tobias Strauß , Gundram Leifert , Tobias Grüning , Roger Labahn

A fundamental challenge in probabilistic modeling is to balance expressivity and inference efficiency. Tractable probabilistic models (TPMs) aim to directly address this tradeoff by imposing constraints that guarantee efficient inference of…

Artificial Intelligence · Computer Science 2025-10-28 John Leland , YooJung Choi

This paper applies error-exponent and dispersion-style analyses to derive finite-blocklength achievability bounds for low-density parity-check (LDPC) codes over the point-to-point channel (PPC) and multiple access channel (MAC). The…

Information Theory · Computer Science 2020-05-14 Yuxin Liu , Michelle Effros

We present an analytical technique to compute the probability of rare events in which the largest eigenvalue of a random matrix is atypically large (i.e.\ the right tail of its large deviations). The results also transfer to the left tail…

Statistical Mechanics · Physics 2021-05-26 Antoine Maillard

This paper investigates the error probability of a stochastic decision and the way in which it differs from the error probability of an optimal decision, i.e., the maximum a posteriori decision. This paper calls attention to the fact that…

Information Theory · Computer Science 2017-05-01 Jun Muramatsu , Shigeki Miyake

In this paper, we consider a concatenated coding based class of DNA storage codes in which the selected molecules are constrained to be taken from an ``inner'' codebook associated with the sequencing channel. This codebook is used in a…

Information Theory · Computer Science 2025-06-19 Yan Hao Ling , Jonathan Scarlett

We analyze the trade-off between the undetected error probability (i.e., the probability that the channel decoder outputs an erroneous message without detecting the error) and the total error probability in the short blocklength regime. We…

Information Theory · Computer Science 2025-03-05 Alexander Sauter , A. Oguz Kislal , Giuseppe Durisi , Gianluigi Liva , Balazs Matuz , Erik G. Ström

We examine regular and irregular repeat-accumulate (RA) codes with repetition degrees which are all even. For these codes and with a particular choice of an interleaver, we give an upper bound on the decoding error probability of a…

Information Theory · Computer Science 2010-02-22 Idan Goldenberg , David Burshtein

In this paper upper and lower bounds on the probability of decoding failure under maximum likelihood decoding are derived for different (nonbinary) Raptor code constructions. In particular four different constructions are considered; (i)…

Information Theory · Computer Science 2021-01-08 Francisco Lázaro , Gianluigi Liva , Gerhard Bauch , Enrico Paolini

Much work in the study of large deviations for random graph models is focused on the dense regime where the theory of graphons has emerged as a principal tool. These tools do not give a good approach to large deviation problems for random…

Probability · Mathematics 2020-07-07 Shankar Bhamidi , Amarjit Budhiraja , Paul Dupuis , Ruoyu Wu

The main theme of this paper is error analysis for approximations derived from two variants of dimensional decomposition of a multivariate function: the referential dimensional decomposition (RDD) and analysis-of-variance dimensional…

Numerical Analysis · Mathematics 2013-10-28 Sharif Rahman

This paper investigates the problem of variable-length lossy source coding allowing a positive excess distortion probability and an overflow probability of codeword lengths. Novel one-shot achievability and converse bounds of the optimal…

Information Theory · Computer Science 2018-12-17 Shota Saito , Hideki Yagi , Toshiyasu Matsushima

Decoding stabilizer codes such as the surface and toric codes involves evaluating free-energy differences in a disordered statistical mechanics model, in which the randomness comes from the observed pattern of error syndromes. We study the…

Statistical Mechanics · Physics 2026-05-20 Hongkun Chen , Daohong Xu , Grace M. Sommers , David A. Huse , Jeff D. Thompson , Sarang Gopalakrishnan

The trapping redundancy of a linear code is the number of rows of a smallest parity-check matrix such that no submatrix forms an $(a,b)$-trapping set. This concept was first introduced in the context of low-density parity-check (LDPC) codes…

Information Theory · Computer Science 2016-11-15 Yu Tsunoda , Yuichiro Fujiwara