English
Related papers

Related papers: Redundancy Estimates for Word-Based Encoding of Se…

200 papers

In this paper, we study the coding delay and the average coding delay of random linear network codes (dense codes) over line networks with deterministic regular and Poisson transmission schedules. We consider both lossless networks and…

Information Theory · Computer Science 2012-02-03 Anoosheh Heidarzadeh , Amir H. Banihashemi

A new method for constructing minimum-redundancy binary prefix codes is described. Our method does not explicitly build a Huffman tree; instead it uses a property of optimal prefix codes to compute the codeword lengths corresponding to the…

Data Structures and Algorithms · Computer Science 2016-09-30 Ahmed Belal , Amr Elmasry

Random Linear Network Coding (RLNC) provides a theoretically efficient method for coding. Some of its practical drawbacks are the complexity of decoding and the overhead due to the coding vectors. For computationally weak and battery-driven…

Networking and Internet Architecture · Computer Science 2015-09-16 Janus Heide , Morten V. Pedersen , Frank H. P. Fitzek , Muriel M edard

Consider two or more strings $\mathbf{x}^1,\mathbf{x}^2,\ldots,$ that are concatenated to form $\mathbf{x}=\langle \mathbf{x}^1,\mathbf{x}^2,\ldots \rangle$. Suppose that up to $\delta$ deletions occur in each of the concatenated strings.…

Information Theory · Computer Science 2023-04-20 Serge Kas Hanna

In this paper, we propose a methodology to compute the optimal finite-length coding rate for random linear network coding schemes over a line network. To do so, we first model the encoding, reencoding, and decoding process of different…

Networking and Internet Architecture · Computer Science 2018-05-16 Tan Do-Duy , M. Ángeles Vázquez-Castro

The analysis of the decoding failure rate of the bit-flipping algorithm has received increasing attention. For a binary linear code we consider the minimum number of rows in a parity-check matrix such that the bit-flipping algorithm is able…

Information Theory · Computer Science 2024-02-05 Jens Zumbrägel

While code large language models have demonstrated remarkable progress in code generation, the generated code often exhibits poor runtime efficiency, limiting its practical application in performance-sensitive scenarios. To address this…

Software Engineering · Computer Science 2025-08-29 Yunlong Feng , Yang Xu , Xiao Xu , Binyuan Hui , Junyang Lin

Designing channel codes under low-latency constraints is one of the most demanding requirements in 5G standards. However, a sharp characterization of the performance of traditional codes is available only in the large block-length limit.…

Signal Processing · Electrical Eng. & Systems 2020-07-27 Yihan Jiang , Hyeji Kim , Himanshu Asnani , Sreeram Kannan , Sewoong Oh , Pramod Viswanath

We propose a list-decoding scheme for reconstruction codes in the context of uniform-tandem-duplication noise, which can be viewed as an application of the associative memory model to this setting. We find the uncertainty associated with…

Information Theory · Computer Science 2021-06-30 Yonatan Yehezkeally , Moshe Schwartz

As sensing and instrumentation play an increasingly important role in systems controlled over wired and wireless networks, the need to better understand delay-sensitive communication becomes a prime issue. Along these lines, this article…

Information Theory · Computer Science 2021-03-26 Anoosheh Heidarzadeh , Jean-Francois Chamberland , Parimal Parag , Richard D. Wesel

As techniques for fault-tolerant quantum computation keep improving, it is natural to ask: what is the fundamental lower bound on redundancy? In this paper, we obtain a lower bound on the redundancy required for $\epsilon$-accurate…

Quantum Physics · Physics 2023-08-23 Uthirakalyani G , Anuj K. Nayak , Avhishek Chatterjee

Recent years have seen the remarkable capabilities of large language models (LLMs) for code generation. Different from existing work that evaluate the correctness of the code generated by LLMs, we propose to further evaluate its efficiency.…

Software Engineering · Computer Science 2024-04-10 Changan Niu , Ting Zhang , Chuanyi Li , Bin Luo , Vincent Ng

The trapping redundancy of a linear code is the number of rows of a smallest parity-check matrix such that no submatrix forms an $(a,b)$-trapping set. This concept was first introduced in the context of low-density parity-check (LDPC) codes…

Information Theory · Computer Science 2016-11-15 Yu Tsunoda , Yuichiro Fujiwara

Communication-avoiding algorithms allow redundant computations to minimize the number of inter-process communications. In this paper, we propose to exploit this redundancy for fault-tolerance purpose. We illustrate this idea with QR…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-03 Camille Coti

This paper considers the relationships among meaning generation, selection, and the dynamics of discourse from a variety of perspectives ranging from information theory and biology to sociology. Following Husserl's idea of a horizon of…

Digital Libraries · Computer Science 2018-03-28 Loet Leydesdorff , Mark W. Johnson , Inga Ivanova

The $l$-th stopping redundancy $\rho_l(\mathcal C)$ of the binary $[n, k, d]$ code $\mathcal C$, $1 \le l \le d$, is defined as the minimum number of rows in the parity-check matrix of $\mathcal C$, such that the smallest stopping set is of…

Information Theory · Computer Science 2017-03-07 Yauhen Yakimenka , Vitaly Skachek

We discuss inequalities holding between the vocabulary size, i.e., the number of distinct nonterminal symbols in a grammar-based compression for a string, and the excess length of the respective universal code, i.e., the code-based analog…

Information Theory · Computer Science 2020-03-11 Lukasz Debowski

This paper proposes a novel framework for detecting redundancy in supervised sentence categorisation. Unlike traditional singleton neural network, our model incorporates character-aware convolutional neural network (Char-CNN) with…

Computation and Language · Computer Science 2017-06-06 Xinyu Fu , Eugene Ch'ng , Uwe Aickelin , Simon See

Recurrent neural networks (RNNs) have been used extensively and with increasing success to model various types of sequential data. Much of this progress has been achieved through devising recurrent units and architectures with the…

Machine Learning · Statistics 2017-03-06 Yacine Jernite , Edouard Grave , Armand Joulin , Tomas Mikolov

[Draft] In this paper, the redundancy of Slepian Wolf coding is revisited. Applying the random binning and converse technique in \cite{yang}, the same results in \cite{he} are obtained with much simpler proofs. Moreover, our results reflect…

Information Theory · Computer Science 2013-05-09 Duo Xu