English
Related papers

Related papers: The Random Subsequence Model and Uniform Codes for…

200 papers

We study the amount of reliable information that can be stored in a DNA-based storage system with noisy sequencing, where each codeword is composed of short DNA molecules. We analyze a concatenated coding scheme, where the outer code is…

Information Theory · Computer Science 2026-05-19 Ran Tamir , Nir Weinberger , Albert Guillén i Fàbregas

We consider rate R = k/n causal linear codes that map a sequence of k-dimensional binary vectors {b_t} to a sequence of n-dimensional binary vectors {c_t}, such that each c_t is a function of {b_1,b_2,...,b_t}. Such a code is called anytime…

Information Theory · Computer Science 2011-06-02 Ravi Teja Sukhavasi , Babak Hassibi

This paper studies the problem of reconstructing a word given several of its noisy copies. This setup is motivated by several applications, among them is reconstructing strands in DNA-based storage systems. Under this paradigm, a word is…

Information Theory · Computer Science 2020-01-17 Omer Sabary , Eitan Yaakobi , Alexander Yucovich

We define a model for random (abstract) cell complexes (CCs), similiar to the well-known Erd\H{o}s-R\'enyi model for graphs and its extensions for simplicial complexes. To build a random cell complex, we first draw from an Erd\H{o}s-R\'enyi…

Data Structures and Algorithms · Computer Science 2025-11-21 Josef Hoppe , Michael T. Schaub

The deletion channel is the simplest point-to-point communication channel that models lack of synchronization. Input bits are deleted independently with probability d, and when they are not deleted, they are not affected by the channel.…

Information Theory · Computer Science 2011-05-02 Yashodhan Kanoria , Andrea Montanari

We develop a systematic approach, based on convex programming and real analysis, for obtaining upper bounds on the capacity of the binary deletion channel and, more generally, channels with i.i.d. insertions and deletions. Other than the…

Information Theory · Computer Science 2018-06-12 Mahdi Cheraghchi

We propose a new class of efficient decoding algorithms for Reed-Muller (RM) codes over binary-input memoryless channels. The algorithms are based on projecting the code on its cosets, recursively decoding the projected codes (which are…

Information Theory · Computer Science 2020-02-27 Min Ye , Emmanuel Abbe

The mode of a collection of values (i.e., the most frequent value in the collection) is a key summary statistic. Finding the mode in a given range of an array of values is thus of great importance, and constructing a data structure to solve…

Data Structures and Algorithms · Computer Science 2026-01-23 Jialong Zhou , Ben Bals , Matei Tinca , Ai Guan , Panagiotis Charalampopoulos , Grigorios Loukides , Solon P. Pissis

We study near optimal error correction codes for real-time communication. In our setup the encoder must operate on an incoming source stream in a sequential manner, and the decoder must reconstruct each source packet within a fixed playback…

Information Theory · Computer Science 2013-05-16 Ahmed Badr , Ashish Khisti , Wai-Tian Tan , John Apostolopoulos

We develop upper bounds on code size for an independent and identically distributed deletion and insertion channels for a given code length and target frame error probability. The bounds are obtained as a variation of a general converse…

Information Theory · Computer Science 2026-04-14 Ruslan Morozov , Tolga Mete Duman

Two of the most common models for channels with synchronisation errors are the Binary Deletion Channel with parameter $p$ ($\text{BDC}_p$) -- a channel where every bit of the codeword is deleted i.i.d with probability $p$, and the Poisson…

Information Theory · Computer Science 2022-06-20 Ittai Rubinstein

The problem of designing codes for deletion-correction and synchronization has received renewed interest due to applications in DNA-based data storage systems that use nanopore sequencers as readout platforms. In almost all instances,…

Information Theory · Computer Science 2026-05-26 Yuan-Pon Chen , Olgica Milenkovic , João Ribeiro , Jin Sima

We demonstrate that there is an intimate relationship between the magnetic properties of Derrida's random energy model (REM) of spin glasses and the problem of joint source--channel coding in Information Theory. In particular, typical…

Statistical Mechanics · Physics 2009-11-13 Neri Merhav

We propose two types of universal codes that are suited to two asymptotic regimes when the output alphabet is possibly continuous. The first class has the property that the error probability decays exponentially fast and we identify an…

Information Theory · Computer Science 2024-09-10 Masahito Hayashi

Conditional density estimation (CDE) is the task of estimating the probability of an event conditioned on some inputs. A neural network (NN) can also be used to compute the output distribution for continuous-domain, which can be viewed as…

Machine Learning · Computer Science 2021-12-30 Bing Chen , Mazharul Islam , Jisuo Gao , Lin Wang

Channels with synchronization errors, exhibiting deletion and insertion errors, find practical applications in DNA storage, data reconstruction, and various other domains. Presence of insertions and deletions render the channel with memory,…

Information Theory · Computer Science 2025-12-19 Busra Tegin , Tolga M Duman

Spin-glass systems are universal models for representing many-body phenomena in statistical physics and computer science. High quality solutions of NP-hard combinatorial optimization problems can be encoded into low energy states of…

Disordered Systems and Neural Networks · Physics 2020-01-14 Gavin S. Hartnett , Masoud Mohseni

A repetition free Longest Common Subsequence (LCS) of two sequences x and y is an LCS of x and y where each symbol may appear at most once. Let R denote the length of a repetition free LCS of two sequences of n symbols each one chosen…

Combinatorics · Mathematics 2013-05-22 Marcos Kiwi , Cristina G. Fernandes

The paper considers coding schemes derived from Reed-Muller (RM) codes, for transmission over input-constrained memoryless channels. Our focus is on the $(d,\infty)$-runlength limited (RLL) constraint, which mandates that any pair of…

Information Theory · Computer Science 2023-05-23 V. Arvind Rameshwar , Navin Kashyap

Consider communication over a binary-input memoryless output-symmetric channel with low density parity check (LDPC) codes and maximum a posteriori (MAP) decoding. The replica method of spin glass theory allows to conjecture an analytic…

Information Theory · Computer Science 2016-11-17 Shrinivas Kudekar , Nicolas Macris