English
Related papers

Related papers: Robust Gray Codes Approaching the Optimal Rate

200 papers

Achieving security against adversaries with unlimited computational power is of great interest in a communication scenario. Since polar codes are capacity achieving codes with low encoding-decoding complexity and they can approach perfect…

Information Theory · Computer Science 2018-01-23 Amirsina Torfi , Sobhan Soleymani , Siamak Aram , Vahid Tabataba Vakili

In this work we develop a general tensor network decoder for 2D codes. Specifically, we propose a decoder that approximates maximally likelihood decoding for 2D stabiliser and subsystem codes subject to Pauli noise. For a code consisting of…

Quantum Physics · Physics 2021-10-14 Christopher T. Chubb

We introduce a new algorithm for realizing Maximum Likelihood (ML) decoding in discrete channels with or without memory. In it, the receiver rank orders noise sequences from most likely to least likely. Subtracting noise from the received…

Information Theory · Computer Science 2019-08-12 Ken R. Duffy , Jiange Li , Muriel Médard

Gradient coding is a coding theoretic framework to provide robustness against slow or unresponsive machines, known as stragglers, in distributed machine learning applications. Recently, Kadhe et al. proposed a gradient code based on a…

Information Theory · Computer Science 2022-01-28 Animesh Sakorikar , Lele Wang

Sparse coding is a crucial subroutine in algorithms for various signal processing, deep learning, and other machine learning applications. The central goal is to learn an overcomplete dictionary that can sparsely represent a given input…

Machine Learning · Statistics 2017-12-14 Thanh V. Nguyen , Raymond K. W. Wong , Chinmay Hegde

We study the question of reconstructing two signals $f$ and $g$ from their convolution $y = f\ast g$. This problem, known as {\em blind deconvolution}, pervades many areas of science and technology, including astronomy, medical imaging,…

Information Theory · Computer Science 2016-06-16 Xiaodong Li , Shuyang Ling , Thomas Strohmer , Ke Wei

The design of block codes for short information blocks (e.g., a thousand or less information bits) is an open research problem that is gaining relevance thanks to emerging applications in wireless communication networks. In this paper, we…

Information Theory · Computer Science 2019-03-12 Mustafa Cemil Coşkun , Giuseppe Durisi , Thomas Jerkovits , Gianluigi Liva , William Ryan , Brian Stein , Fabian Steiner

Dating back to the seminal work of von Neumann [von Neumann, Automata Studies, 1956], it is known that error correcting codes can overcome faulty circuit components to enable robust computation. Choosing an appropriate code is non-trivial…

Information Theory · Computer Science 2025-10-06 Anirudh Krishna , Gilles Zémor

Structured statistical estimation problems are often solved by Conditional Gradient (CG) type methods to avoid the computationally expensive projection operation. However, the existing CG type methods are not robust to data corruption. To…

Machine Learning · Computer Science 2020-07-08 Jiacheng Zhuo , Liu Liu , Constantine Caramanis

Gaussian processes (GPs) enable principled computation of model uncertainty, making them attractive for safety-critical applications. Such scenarios demand that GP decisions are not only accurate, but also robust to perturbations. In this…

Machine Learning · Computer Science 2021-04-08 Andrea Patane , Arno Blaas , Luca Laurenti , Luca Cardelli , Stephen Roberts , Marta Kwiatkowska

A new approach to data compression is developed and applied to multimedia content. This method separates messages into components suitable for both lossless coding and 'lossy' or statistical coding techniques, compressing complex objects by…

Information Theory · Computer Science 2011-12-26 John Scoville

Guessing Codeword Decoding (GCD) is a recently proposed soft-input forward error correction decoder for arbitrary binary linear codes. Inspired by recent proposals that leverage binary linear codebook structure to reduce the number of…

Information Theory · Computer Science 2024-12-23 Joseph Griffin , Peihong Yuan , Ken R. Duffy , Muriel Medard

Locally recoverable (LRC) codes have recently been a focus point of research in coding theory due to their theoretical appeal and applications in distributed storage systems. In an LRC code, any erased symbol of a codeword can be recovered…

Information Theory · Computer Science 2018-05-16 Abhishek Agarwal , Alexander Barg , Sihuang Hu , Arya Mazumdar , Itzhak Tamo

Polar codes are the first class of constructive channel codes achieving the symmetric capacity of the binary-input discrete memoryless channels. But the corresponding code length is limited to the power of two. In this paper, we establish a…

Information Theory · Computer Science 2017-12-05 Kai Niu , Jincheng Dai , Kai Chen , Jiaru Lin , Q. T. Zhang , Athanasios V. Vasilakos

Retrieval-augmented generation (RAG) is susceptible to retrieval corruption attacks, where malicious passages injected into retrieval results can lead to inaccurate model responses. We propose RobustRAG, the first defense framework with…

Machine Learning · Computer Science 2026-04-02 Chong Xiang , Tong Wu , Zexuan Zhong , David Wagner , Danqi Chen , Prateek Mittal

A Gray code for a combinatorial class is a method for listing the objects in the class so that successive objects differ in some prespecified, small way, typically expressed as a bounded Hamming distance. In a previous work, the authors of…

Combinatorics · Mathematics 2017-03-20 Ahmad Sabri , Vincent Vajnovszki

We show that the tensor product of two random linear codes is robustly testable with high probability. This implies that one can obtain pairs of linear codes such that their product and the product of their dual codes are simultaneously…

Information Theory · Computer Science 2023-08-11 Gleb Kalachev , Pavel Panteleev

We consider lossy source compression of a binary symmetric source using polar codes and the low-complexity successive encoding algorithm. It was recently shown by Arikan that polar codes achieve the capacity of arbitrary symmetric…

Information Theory · Computer Science 2009-03-03 Satish Babu Korada , Rudiger Urbanke

In distributed optimization problems, a technique called gradient coding, which involves replicating data points, has been used to mitigate the effect of straggling machines. Recent work has studied approximate gradient coding, which…

Machine Learning · Statistics 2021-08-09 Margalit Glasgow , Mary Wootters

We improve the method in \cite{Seidl:10} for increasing the finite-lengh performance of polar codes by protecting specific, less reliable symbols with simple outer repetition codes. Decoding of the scheme integrates easily in the known…

Information Theory · Computer Science 2013-12-11 Mathis Seidl , Johannes B. Huber