English
Related papers

Related papers: Non prefix-free codes for constrained sequences

200 papers

We revisit hierarchical bracketing encodings from a practical perspective in the context of dependency graph parsing. The approach encodes graphs as sequences, enabling linear-time parsing with $n$ tagging actions, and still representing…

Computation and Language · Computer Science 2025-09-12 Ana Ezquerro , Carlos Gómez-Rodríguez , David Vilares

We present a case for the use of codes possessing algebraic closure properties - coset codes - in developing coding techniques and characterizing achievable rate regions for generic multi-terminal channels. In particular, we consider three…

Information Theory · Computer Science 2022-03-02 Arun Padakandla , S. Sandeep Pradhan

We introduce the notion of weakly mutually uncorrelated (WMU) sequences, motivated by applications in DNA-based storage systems and synchronization protocols. WMU sequences are characterized by the property that no sufficiently long suffix…

Information Theory · Computer Science 2016-02-01 S. M. Hossein Tabatabaei Yazdi , Han Mao Kiah , Olgica Milenkovic

Variable-to-variable length (VV) codes are a class of lossless source coding. As their name implies, VV codes encode a variable-length sequence of source symbols into a variable-length codeword. This paper will give a complete proof of an…

Information Theory · Computer Science 2023-09-13 Wei Yan , Yunghsiang S. Han

A general lossless joint source-channel coding scheme based on linear codes is proposed and then analyzed in this paper. It is shown that a linear code with good joint spectrum can be used to establish limit-approaching joint source-channel…

Information Theory · Computer Science 2016-11-17 Shengtian Yang , Peiliang Qiu

In this letter, we evaluate the finite-length performance of network coding when using either random or structured encoding matrices. First, we present our novel construction of structured network codes over Fq (q = 2^m) using Pascal…

Networking and Internet Architecture · Computer Science 2019-11-28 Tan Do-Duy , M. Angeles Vazquez-Castro

This paper studies variable-length (VL) source coding of general sources with side-information. Novel one-shot coding theorems for coding with common side-information available at the encoder and the decoder and Slepian- Wolf (SW) coding…

Information Theory · Computer Science 2014-04-09 Shigeaki Kuzuoka , Shun Watanabe

Theoretical analysis has long indicated that feedback improves the error exponent but not the capacity of single-user memoryless channels. Recently Polyanskiy et al. studied the benefit of variable-length feedback with termination (VLFT)…

Information Theory · Computer Science 2013-02-26 Tsung-Yi Chen , Adam R. Williamson , Richard D. Wesel

Linear constraints for a matrix polytope with no fractional vertex are investigated as intersecting research among permutation codes, rank modulations, and linear programming methods. By focusing the discussion to the block structure of…

Combinatorics · Mathematics 2012-02-07 Manabu Hagiwara

A general lossless joint source-channel coding (JSCC) scheme based on linear codes and random interleavers for multiple-access channels (MACs) is presented and then analyzed in this paper. By the information-spectrum approach and the…

Information Theory · Computer Science 2009-03-31 Shengtian Yang , Yan Chen , Peiliang Qiu

There are some positively divisible non-Markovian processes whose transition matrices satisfy the Chapman-Kolmogorov equation. These processes should also satisfy the Kolmogorov consistency conditions, an essential requirement for a process…

Probability · Mathematics 2024-01-24 Bilal Canturk , Heinz-Peter Breuer

In real-world applications of large language models, outputs are often required to be confined: selecting items from predefined product or document sets, generating phrases that comply with safety standards, or conforming to specialized…

Computation and Language · Computer Science 2025-04-15 Haotian Ye , Himanshu Jain , Chong You , Ananda Theertha Suresh , Haowei Lin , James Zou , Felix Yu

In this paper we study spread codes: a family of constant-dimension codes for random linear network coding. In other words, the codewords are full-rank matrices of size (k x n) with entries in a finite field F_q. Spread codes are a family…

Information Theory · Computer Science 2012-06-08 Elisa Gorla , Felice Manganiello , Joachim Rosenthal

A cross-bifix-free set of words is a set in which no prefix of any length of any word is the suffix of any other word in the set. A construction of cross-bifix-free sets has recently been proposed by Chee {\it et al.} in 2013 within a…

Information Theory · Computer Science 2015-05-20 Antonio Bernini , Stefano Bilotta , Renzo Pinzani , Vincent Vajnovszki

Undetected errors are important for linear codes, which are the only type of errors after hard decision and automatic-repeat-request (ARQ), but do not receive much attention on their correction. In concatenated channel coding, suboptimal…

Information Theory · Computer Science 2019-01-09 Jingzhao Wang , Yuan Luo

We consider spatially coupled low-density parity-check codes with finite smoothing parameters. A finite smoothing parameter is important for designing practical codes that are decoded using low-complexity windowed decoders. By optimizing…

Information Theory · Computer Science 2017-01-27 Laurent Schmalen , Vahid Aref , Fanny Jardel

A class of linear codes that extends classic Goppa codes to a non-commutative context is defined. An efficient decoding algorithm, based on the solution of a non-commutative key equation, is designed. We show how the parameters of these…

Information Theory · Computer Science 2022-07-29 José Gómez-Torrecillas , F. J. Lobillo , Gabriel Navarro

In this paper, we show that nested lattice codes achieve the capacity of arbitrary channels with or without non-casual state information at the transmitter. We also show that nested lattice codes are optimal for source coding with or…

Information Theory · Computer Science 2012-03-20 Aria G. Sahebi , S. Sandeep Pradhan

This paper concerns non-overlapping codes, block codes motivated by synchronisation and DNA-based storage applications. Most existing constructions of these codes do not account for the restrictions posed by the physical properties of…

Information Theory · Computer Science 2025-02-05 Lidija Stanovnik , Miha Moškon , Miha Mraz

Hidden variables are ubiquitous in practical data analysis, and therefore modeling marginal densities and doing inference with the resulting models is an important problem in statistics, machine learning, and causal inference. Recently, a…

Machine Learning · Computer Science 2013-09-27 Ilya Shpitser , Robin J. Evans , Thomas S. Richardson , James M. Robins