English
Related papers

Related papers: Refined Upper Bounds on Stopping Redundancy of Bin…

200 papers

Locally repairable codes (LRCs) are a class of codes designed for the local correction of erasures. They have received considerable attention in recent years due to their applications in distributed storage. Most existing results on LRCs do…

Information Theory · Computer Science 2015-11-24 Pengfei Huang , Eitan Yaakobi , Hironori Uchikawa , Paul H. Siegel

In this paper, we investigate the redundancy of universal coding schemes on smooth parametric sources in the finite-length regime. We derive an upper bound on the probability of the event that a sequence of length $n$, chosen using…

Information Theory · Computer Science 2011-10-27 Ahmad Beirami , Faramarz Fekri

Log-linear models are typically fitted to contingency table data to describe and identify the relationship between different categorical variables. However, the data may include observed zero cell entries. The presence of zero cell entries…

Methodology · Statistics 2022-12-01 Serveh Sharifi Far , Michail Papathomas , Ruth King

A non-binary (2,v)-regular LDPC code is defined by a parity-check matrix with column weight 2 and row weight v. In this report, we give an ontology-based approach to the optimization for this class of codes. All possible inter-connected…

Information Theory · Computer Science 2014-09-09 Chao Chen

There has been a great deal of work establishing that random linear codes are as list-decodable as uniformly random codes, in the sense that a random linear binary code of rate $1 - H(p) - \epsilon$ is $(p,O(1/\epsilon))$-list-decodable…

Information Theory · Computer Science 2020-11-26 Ray Li , Mary Wootters

The Ku\v{c}era-G\'acs theorem is a landmark result in algorithmic randomness asserting that every real is computable from a Martin-L\"of random real. If the computation of the first $n$ bits of a sequence requires $n+h(n)$ bits of the…

Computational Complexity · Computer Science 2017-06-13 George Barmpalias , Andrew Lewis-Pye , Jason Teutsch

Low-rank parity-check (LRPC) are rank-metric codes over finite fields, which have been proposed by Gaborit et al. (2013) for cryptographic applications. Inspired by a recent adaption of Gabidulin codes to certain finite rings by Kamche et…

Information Theory · Computer Science 2020-12-07 Julian Renner , Alessandro Neri , Sven Puchinger

The paper introduces new bounds on the asymptotic density of parity-check matrices and the achievable rates under ML decoding of binary linear block codes transmitted over memoryless binary-input output-symmetric channels. The lower bounds…

Information Theory · Computer Science 2007-07-13 Gil Wiechman , Igal Sason

Aiming to recover the data from several concurrent node failures, linear $r$-LRC codes with locality $r$ were extended into $(r, \delta)$-LRC codes with locality $(r, \delta)$ which can enable the local recovery of a failed node in case of…

Information Theory · Computer Science 2022-02-22 Li Xu , Zhengchun Zhou , Jun Zhang , Sihem Mesnager

Low Rank Parity Check (LRPC) codes form a class of rank-metric error-correcting codes that was purposely introduced to design public-key encryption schemes. An LRPC code is defined from a parity check matrix whose entries belong to a…

Information Theory · Computer Science 2023-09-26 Étienne Burle , Ayoub Otmani

A combinatorial rectangle may be viewed as a matrix whose entries are all +-1. The discrepancy of an m by n matrix is the maximum among the absolute values of its m row sums and n column sums. In this paper, we investigate combinatorial…

Combinatorics · Mathematics 2019-09-13 Chunwei Song , Bowen Yao

Recall that a binary linear code of length $n$ is a linear subspace $\mathcal{C} = \{x\in\mathbb{F}_2^n\mid Ax=0\}$. Here the parity check matrix $A$ is a binary $m\times n$ matrix of rank $m$. We say that $\mathcal{C}$ has rate $R=1-\frac…

Information Theory · Computer Science 2025-04-07 Nati Linial , Edan Orzech

Although the deep structure guarantees the powerful expressivity of deep networks (DNNs), it also triggers serious overfitting problem. To improve the generalization capacity of DNNs, many strategies were developed to improve the diversity…

Machine Learning · Computer Science 2021-04-06 Chenguang Zhang , Yuexian Hou , Dawei Song , Liangzhu Ge , Yaoshuai Yao

A Bounded-Degree Low-Rank Parity-Check (BD-LRPC) code is a rank-metric code that admits a parity-check matrix whose support is generated by a set of powers of an element. This specific structure of the parity-check matrix was employed to…

Information Theory · Computer Science 2025-09-17 Hermann Tchatchiem Kamche

We study the performance of nonbinary low-density parity-check (LDPC) codes over finite integer rings over two channels that arise from the Lee metric. The first channel is a discrete memory-less channel (DMC) matched to the Lee metric. The…

Information Theory · Computer Science 2022-10-19 Jessica Bariffi , Hannes Bartz , Gianluigi Liva , Joachim Rosenthal

Recent large language models have shown promising capabilities in long-form reasoning, following structured chains of thought before arriving at a final answer. However, we observe that these reasoning paths tend to include substantial…

Stopping sets and stopping set distribution of a linear code play an important role in the performance analysis of iterative decoding for this linear code. Let $C$ be an $[n,k]$ linear code over $\f$ with parity-check matrix $H$, where the…

Information Theory · Computer Science 2013-04-30 Jun Zhang , Fang-Wei Fu , Daqing Wan

Recent years, several new types of codes were introduced to provide fault-tolerance and guarantee system reliability in distributed storage systems, among which locally repairable codes (LRCs for short) have played an important role. A…

Information Theory · Computer Science 2022-06-14 Yuanxiao Xi , Xiangliang Kong , Gennian Ge

The performance of iterative decoding techniques for linear block codes correcting erasures depends very much on the sizes of the stopping sets associated with the underlying Tanner graph, or, equivalently, the parity-check matrix…

Information Theory · Computer Science 2007-07-13 Jos H. Weber , Khaled A. S. Abdel-Ghaffar

We construct new linear codes with high minimum distance d. In at least 12 cases these codes improve the minimum distance of the previously known best linear codes for fixed parameters n,k. Among these new codes there is an optimal ternary…

Information Theory · Computer Science 2007-07-16 Axel Kohnert