English
Related papers

Related papers: Multilayer Codes for Synchronization from Deletion…

200 papers

We present a construction of subspace codes along with an efficient algorithm for list decoding from both insertions and deletions, handling an information-theoretically maximum fraction of these with polynomially small rate. Our…

Information Theory · Computer Science 2012-02-03 Venkatesan Guruswami , Srivatsan Narayanan , Carol Wang

We consider a simple network, where a source and destination node are connected with a line of erasure channels. It is well known that in order to achieve the min-cut capacity, the intermediate nodes are required to process the information.…

Information Theory · Computer Science 2016-11-17 Payam Pakzad , Christina Fragouli , Amin Shokrollahi

Suppose that there are $n$ Senders and $n$ Receivers. Our goal is to send long messages from Sender $i$ to Receiver $i$ such that no other receiver can retrieve the message intended for Receiver $i$. The task can easily be completed using…

Computational Complexity · Computer Science 2007-05-23 Vince Grolmusz

Despite having impressive vision-language (VL) pretraining with BERT-based encoder for VL understanding, the pretraining of a universal encoder-decoder for both VL understanding and generation remains challenging. The difficulty originates…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Yehao Li , Yingwei Pan , Ting Yao , Jingwen Chen , Tao Mei

In the paper, the Levenshtein's sequence reconstruction problem is considered in the case where at most $t$ substitution errors occur in each of the $N$ channels and the decoder outputs a list of length $\mathcal{L}$. Moreover, it is…

Information Theory · Computer Science 2022-11-17 Ville Junnila , Tero Laihonen , Tuomo Lehtilä

We present adaptive on-line schemes for lossy encoding of individual sequences under the conditions of the Wyner-Ziv (WZ) problem. In the first part of this article, a set of fixed-rate scalar source codes with zero delay is presented. We…

Information Theory · Computer Science 2009-08-12 Avraham Reani , Neri Merhav

This paper studies the problem of reconstructing a word given several of its noisy copies. This setup is motivated by several applications, among them is reconstructing strands in DNA-based storage systems. Under this paradigm, a word is…

Information Theory · Computer Science 2020-01-17 Omer Sabary , Eitan Yaakobi , Alexander Yucovich

We propose a two-layer coding architecture for communication of multiple users over a shared slotted medium enabling joint collision resolution and decoding. Each user first encodes its information bits with an outer code for reliability,…

Information Theory · Computer Science 2020-08-18 MohammadReza Ebrahimi , Farshad Lahouti , Victoria Kostina

The problem of correcting deletions and insertions has recently received significantly increased attention due to the DNA-based data storage technology, which suffers from deletions and insertions with extremely high probability. In this…

Information Theory · Computer Science 2023-11-09 Tuan Thanh Nguyen , Kui Cai , Paul H. Siegel

Due to the ability to provide superior error-correction performance, the successive cancellation list (SCL) algorithm is widely regarded as one of the most promising decoding algorithms for polar codes with short-to-moderate code lengths.…

Information Theory · Computer Science 2023-11-15 Yang Lu , Ming-Min Zhao , Ming Lei , Min-Jian Zhao

In this paper, we introduce a new way of constructing and decoding multipermutation codes. Multipermutations are permutations of a multiset that generally consist of duplicate entries. We first introduce a class of binary matrices called…

Information Theory · Computer Science 2015-07-29 Xishuo Liu , Stark C. Draper

We study a one-shot joint source-channel coding setting where the source is encoded once and broadcast to $K$ decoders through independent channels. Success is predicated on at least one decoder recovering the source within a maximum…

Information Theory · Computer Science 2026-04-17 Joseph Rowan , Buu Phan , Ashish Khisti

We propose and evaluate a novel procedure for training multiple Transformers with tied parameters which compresses multiple models into one enabling the dynamic choice of the number of encoder and decoder layers during decoding. In…

Computation and Language · Computer Science 2020-02-21 Raj Dabre , Raphael Rubino , Atsushi Fujita

In this paper, a novel decoding algorithm for low-density parity-check (LDPC) codes based on convex optimization is presented. The decoding algorithm, called interior point decoding, is designed for linear vector channels. The linear vector…

Information Theory · Computer Science 2009-11-13 Tadashi Wadayama

We propose a new class of error correction codes for low-delay streaming communication. We consider an online setup where a source packet arrives at the encoder every $M$ channel uses, and needs to be decoded with a maximum delay of $T$…

Information Theory · Computer Science 2016-11-17 Ahmed Badr , Pratik Patil , Ashish Khisti , Wai-Tian Tan , John Apostolopoulos

We introduce harmonization, an ensembling method that combines several "noisy" decoders to generate highly accurate decoding predictions. Harmonized ensembles of MWPM-based decoders achieve lower logical error rates than their individual…

Quantum Physics · Physics 2024-03-18 Noah Shutty , Michael Newman , Benjamin Villalonga

We demonstrate a decoding scheme for nested lattice codes which is able to decode a list of a particular size which contains the transmitted codeword with high probability. This list decoder is analogous to that used in random coding…

Information Theory · Computer Science 2010-10-04 Yiwei Song , Natasha Devroye

We present many new results related to reliable (interactive) communication over insertion-deletion channels. Synchronization errors, such as insertions and deletions, strictly generalize the usual symbol corruption errors and are much…

Information Theory · Computer Science 2018-03-22 Bernhard Haeupler , Amirbehshad Shahrasbi , Ellen Vitercik

This paper investigates linear-time decoding algorithms for two classes of error-correcting codes. One of the classes is monotone codes which are known as single deletion codes. The other is azinv codes which are known as single balanced…

Information Theory · Computer Science 2020-04-16 Hokuto Takahashi , Manabu Hagiwara

Long polar codes can achieve the capacity of arbitrary binary-input discrete memoryless channels under a low complexity successive cancelation (SC) decoding algorithm. But for polar codes with short and moderate code length, the decoding…

Information Theory · Computer Science 2016-11-18 Jun Lin , Chenrong Xiong , Zhiyuan Yan