English
Related papers

Related papers: On Unique Decoding from Insertions and Deletions

200 papers

We consider the problem of correcting insertion and deletion errors in the $d$-dimensional space. This problem is well understood for vectors (one-dimensional space) and was recently studied for arrays (two-dimensional space). For vectors…

Information Theory · Computer Science 2022-08-11 Evagoras Stylianou , Lorenz Welter , Rawad Bitar , Antonia Wachter-Zeh , Eitan Yaakobi

The code that combines channel estimation and error protection has received general attention recently, and has been considered a promising methodology to compensate multi-path fading effect. It has been shown by simulations that such code…

Information Theory · Computer Science 2007-12-18 Chia-Lung Wu , Po-Ning Chen , Yunghsiang S. Han , Ming-Hsin Kuo

Understanding brain function, constructing computational models and engineering neural prosthetics require assessing two problems, namely encoding and decoding, but their relation remains controversial. For decades, the encoding problem has…

Neurons and Cognition · Quantitative Biology 2017-01-16 Hugo Gabriel Eyherabide

The synthesis of DNA strands remains the most costly part of the DNA storage system. Thus, to make DNA storage system more practical, the time and materials used in the synthesis process have to be optimized. We consider the most common…

Information Theory · Computer Science 2023-05-15 Johan Chrisnata , Han Mao Kiah , Van Long Phuoc Pham

We study universal decoding over unknown discrete additive channels determined by a finite-state (unifilar) random process. Aiming at low-complexity decoders, we study variants of noise-guessing decoders that use estimators for the…

Information Theory · Computer Science 2025-07-24 Henrique K. Miyamoto , Sheng Yang

Recent efforts in coding theory have focused on building codes for insertions and deletions, called insdel codes, with optimal trade-offs between their redundancy and their error-correction capabilities, as well as efficient encoding and…

Information Theory · Computer Science 2020-12-08 Alexander R. Block , Jeremiah Blocki , Elena Grigorescu , Shubhang Kulkarni , Minshen Zhu

We consider the problem of constructing codes that can correct $\delta$ deletions occurring in an arbitrary binary string of length $n$ bits. Varshamov-Tenengolts (VT) codes, dating back to 1965, are zero-error single deletion $(\delta=1)$…

Information Theory · Computer Science 2018-05-25 Serge Kas Hanna , Salim El Rouayheb

We consider the problem of universal decoding for arbitrary unknown channels in the random coding regime. For a given random coding distribution and a given class of metric decoders, we propose a generic universal decoder whose average…

Information Theory · Computer Science 2016-11-17 Neri Merhav

We consider upper bounds on the error probability in channel coding. We derive an improved maximum-likelihood union bound, which takes into account events where the likelihood of the correct codeword is tied with that of some competitors.…

Information Theory · Computer Science 2013-02-12 Eli Haim , Yuval Kochman , Uri Erez

We study the combination of two recent coding approaches, in the context of DNA based data storage. Composite DNA alphabets leverage properties of the DNA synthesis and sequencing process. A composite symbol does not represent a single…

Information Theory · Computer Science 2026-05-20 Tomer Cohen , Eitan Yaakobi , Zohar Yakhini

In the literature there exists analytical expressions for the probability of a receiver decoding a transmitted source message that has been encoded using random linear network coding. In this work, we look into the probability that the…

Information Theory · Computer Science 2022-03-08 Jessica Claridge , Ioannis Chatzigeorgiou

We consider error-correcting coding for DNA-based storage. We model the DNA storage channel as a multi-draw IDS channel where the input data is chunked into $M$ short DNA strands, which are copied a random number of times, and the channel…

Information Theory · Computer Science 2023-06-22 Lorenz Welter , Issam Maarouf , Andreas Lenz , Antonia Wachter-Zeh , Eirik Rosnes , Alexandre Graell i Amat

The ability to store data in the DNA of a living organism has applications in a variety of areas including synthetic biology and watermarking of patented genetically-modified organisms. Data stored in this medium is subject to errors…

Information Theory · Computer Science 2016-11-17 Siddharth Jain , Farzad Farnoud , Moshe Schwartz , Jehoshua Bruck

To make DNA a suitable medium for archival data storage, it is essential to consider the decay process of the strands observed in DNA storage systems. This paper studies the decay process as a probabilistic noisy torn paper channel (TPC),…

Information Theory · Computer Science 2026-01-19 Frederik Walter , Maria Abu-Sini , Nils Weinhardt , Antonia Wachter-Zeh

In this paper, we investigate the output token probability information in the output embedding of language models. We find an approximate common log-linear encoding of output token probabilities within the output embedding vectors and…

Computation and Language · Computer Science 2024-12-12 Hakaze Cho , Yoshihiro Sakai , Kenshiro Tanaka , Mariko Kato , Naoya Inoue

DNA storage is now being considered as a new archival storage method for its durability and high information density, but still facing some challenges like high costs and low throughput. By reducing sequencing sample size for decoding…

Information Theory · Computer Science 2025-04-22 Ruiying Cao , Xin Chen

"Independent and identically distributed" errors do not accurately capture the noisy behavior of real-world data storage and information transmission technologies. Motivated by this, we study channels with input-correlated synchronization…

Information Theory · Computer Science 2026-05-14 Roni Con , João Ribeiro

The problem of correcting deletions has received significant attention, partly because of the prevalence of these errors in DNA data storage. In this paper, we study the problem of correcting a consecutive burst of at most $t$ deletions in…

Information Theory · Computer Science 2022-10-24 Shuche Wang , Yuanyuan Tang , Jin Sima , Ryan Gabrys , Farzad Farnoud

In general coding theory, we often assume that error is observed in transferring or storing encoded symbols, while the process of encoding itself is error-free. Motivated by recent applications of coding theory, in this paper, we consider…

Information Theory · Computer Science 2021-03-02 Nastaran Abadi Khooshemehr , Mohammad Ali Maddah-Ali

A product code with single parity-check component codes can be described via the tools of a multi-kernel polar code, where the rows of the generator matrix are chosen according to the constraints imposed by the product code construction.…

Information Theory · Computer Science 2021-07-27 Mustafa Cemil Coşkun , Gianluigi Liva , Alexandre Graell i Amat , Michael Lentmaier , Henry D. Pfister