English
Related papers

Related papers: Efficient Integer Retrieving from Unordered Compre…

200 papers

We establish the first information-theoretic limits for multimodal retrieval. Casting ranking as lossy source coding, we derive a single-letter rate-distortion function $R(D)$ for reciprocal-rank distortion and prove a converse bound that…

Information Theory · Computer Science 2025-09-16 Thomas Y. Chen

Recently Implicit Neural Representations (INRs) gained attention as a novel and effective representation for various data types. Thus far, prior work mostly focused on optimizing their reconstruction performance. This work investigates INRs…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Yannick Strümpler , Janis Postels , Ren Yang , Luc van Gool , Federico Tombari

We present a one-shot method for compressing large labeled graphs called Random Edge Coding. When paired with a parameter-free model based on P\'olya's Urn, the worst-case computational and memory complexities scale quasi-linearly and…

Machine Learning · Computer Science 2023-05-18 Daniel Severo , James Townsend , Ashish Khisti , Alireza Makhzani

First- and second-order Reed-Muller (RM(1) and RM(2), respectively) codes are two fundamental error-correcting codes which arise in communication as well as in probabilistically-checkable proofs and learning. In this paper, we take the…

Data Structures and Algorithms · Computer Science 2007-07-16 A. R. Calderbank , Anna C. Gilbert , Martin J. Strauss

Rateless/fountain codes are designed so that all input symbols can be recovered from a slightly larger number of coded symbols, with high probability using an iterative decoder. In this paper we investigate the number of input symbols that…

Information Theory · Computer Science 2007-07-13 Sujay Sanghavi

In this paper, we prove that with high probability, random Reed-Solomon codes approach the half-Singleton bound - the optimal rate versus error tradeoff for linear insdel codes - with linear-sized alphabets. More precisely, we prove that,…

Information Theory · Computer Science 2024-07-11 Roni Con , Zeyu Guo , Ray Li , Zihan Zhang

We examine an error-correcting coding framework in which each coded symbol is constrained to be a function of a fixed subset of the message symbols. With an eye toward distributed storage applications, we seek to design systematic codes…

Information Theory · Computer Science 2015-02-23 Wael Halbawi , Matthew Thill , Babak Hassibi

In this work it is shown that locally repairable codes (LRCs) can be list-decoded efficiently beyond the Johnson radius for a large range of parameters by utilizing the local error-correction capabilities. The corresponding decoding radius…

Information Theory · Computer Science 2020-09-16 Lukas Holzbaur , Sven Puchinger , Antonia Wachter-Zeh

Random network coding recently attracts attention as a technique to disseminate information in a network. This paper considers a non-coherent multi-shot network, where the unknown and time-variant network is used several times. In order to…

Information Theory · Computer Science 2016-11-17 Antonia Wachter-Zeh , Markus Stinner , Vladimir Sidorenko

Current methods which compress multisets at an optimal rate have computational complexity that scales linearly with alphabet size, making them too slow to be practical in many real-world settings. We show how to convert a compression…

Information Theory · Computer Science 2023-02-28 Daniel Severo , James Townsend , Ashish Khisti , Alireza Makhzani , Karen Ullrich

Motivated by applications of biometric identification and content identification systems, we consider the problem of random coding for channels, where each codeword undergoes lossy compression (vector quantization), and where the decoder…

Information Theory · Computer Science 2016-09-29 Neri Merhav

Lifted Reed-Solomon codes and multiplicity codes are two classes of evaluation codes that allow for the design of high-rate codes that can recover every codeword or information symbol from many disjoint sets. Recently, the underlying…

Information Theory · Computer Science 2020-10-30 Lukas Holzbaur , Rina Polyanskaya , Nikita Polyanskii , Ilya Vorobyev , Eitan Yaakobi

List recovery of error-correcting codes has emerged as a fundamental notion with broad applications across coding theory and theoretical computer science. Folded Reed-Solomon (FRS) and univariate multiplicity codes are explicit…

Information Theory · Computer Science 2025-12-10 Rohan Goyal , Venkatesan Guruswami

Extracting dense representations for terms and phrases is a task of great importance for knowledge discovery platforms targeting highly-technical fields. Dense representations are used as features for downstream components and have multiple…

Computation and Language · Computer Science 2023-05-26 Francesco Fusco , Diego Antognini

We establish that it is possible to extract accurate blockwise and bitwise soft output from Guessing Codeword Decoding with minimal additional computational complexity by considering it as a variant of Guessing Random Additive Noise…

Information Theory · Computer Science 2025-12-18 Ken R. Duffy , Peihong Yuan , Joseph Griffin , Muriel Medard

We construct $s$-interleaved linearized Reed--Solomon (ILRS) codes and variants and propose efficient decoding schemes that can correct errors beyond the unique decoding radius in the sum-rank metric. The proposed interpolation-based scheme…

Information Theory · Computer Science 2025-09-10 Hannes Bartz , Sven Puchinger

We consider the decoding of linear and array codes from errors when we are only allowed to download a part of the codeword. More specifically, suppose that we have encoded $k$ data symbols using an $(n,k)$ code with code length $n$ and…

Information Theory · Computer Science 2018-10-10 Itzhak Tamo , Min Ye , Alexander Barg

Neural speech codecs have demonstrated their ability to compress high-quality speech and audio by converting them into discrete token representations. Most existing methods utilize Residual Vector Quantization (RVQ) to encode speech into…

Sound · Computer Science 2024-10-22 Peiji Yang , Fengping Wang , Yicheng Zhong , Huawei Wei , Zhisheng Wang

Run-Length Encoding (RLE) is one of the most fundamental tools in data compression. However, its compression power drops significantly if there lacks consecutive elements in the sequence. In extreme cases, the output of the encoder may…

Data Structures and Algorithms · Computer Science 2023-12-29 Xutan Peng , Yi Zhang , Dejia Peng , Jiafa Zhu

The goal of natural language semantic code search is to retrieve a semantically relevant code snippet from a fixed set of candidates using a natural language query. Existing approaches are neither effective nor efficient enough towards a…

Computation and Language · Computer Science 2021-10-18 Akhilesh Deepak Gotmare , Junnan Li , Shafiq Joty , Steven C. H. Hoi