English
Related papers

Related papers: DoDo-Code: an Efficient Levenshtein Distance Embed…

200 papers

An embedding of a code is a mapping that preserves distances between codewords. We prove that any code with code distance $\rho$ and length $d$ can be embedded into an MDS code with the same code distance and length but under a larger…

Combinatorics · Mathematics 2024-04-23 Vladimir N. Potapov

As a crucial component of most modern deep recommender systems, feature embedding maps high-dimensional sparse user/item features into low-dimensional dense embeddings. However, these embeddings are usually assigned a unified dimension,…

Information Retrieval · Computer Science 2022-04-18 Liang Qu , Yonghong Ye , Ningzhi Tang , Lixin Zhang , Yuhui Shi , Hongzhi Yin

We study low-delay error correction codes for streaming recovery over a class of packet-erasure channels that introduce both burst-erasures and isolated erasures. We propose a simple, yet effective class of codes whose parameters can be…

Information Theory · Computer Science 2012-08-02 Ahmed Badr , Ashish Khisti , Wai-Tian Tan , John Apostolopoulos

Large pre-trained vision-language models have shown great prominence in transferring pre-acquired knowledge to various domains and downstream tasks with appropriate prompting or tuning. Existing prevalent tuning methods can be generally…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Huahui Yi , Ziyuan Qin , Wei Xu , Miaotian Guo , Kun Wang , Shaoting Zhang , Kang Li , Qicheng Lao

Designs for transmit alphabet constrained space-time codes naturally lead to questions about the design of rank distance codes. Recently, diversity embedded multi-level space-time codes for flat fading channels have been designed from sets…

Information Theory · Computer Science 2016-11-18 S. Dusad , S. N. Diggavi , A. R. Calderbank

DNA, with remarkable properties of high density, durability, and replicability, is one of the most appealing storage media. Emerging DNA storage technologies use composite DNA letters, where information is represented by probability…

Information Theory · Computer Science 2025-03-26 Wenkai Zhang , Zhiying Wang

Quantum error-correcting codes protect fragile quantum information by encoding it redundantly, but identifying codes that perform well in practice with minimal overhead remains difficult due to the combinatorial search space and the high…

Quantum Physics · Physics 2026-01-27 Yihua Chengyu , Richard Meister , Conor Carty , Sheng-Ku Lin , Roberto Bondesan

Balancing temporal resolution and spatial detail under limited compute budget remains a key challenge for video-based multi-modal large language models (MLLMs). Existing methods typically compress video representations using predefined…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Min Shi , Shihao Wang , Chieh-Yun Chen , Jitesh Jain , Kai Wang , Junjun Xiong , Guilin Liu , Zhiding Yu , Humphrey Shi

We propose a fast, distance-preserving, binary embedding algorithm to transform a high-dimensional dataset $\mathcal{T}\subseteq\mathbb{R}^n$ into binary sequences in the cube $\{\pm 1\}^m$. When $\mathcal{T}$ consists of well-spread (i.e.,…

Information Theory · Computer Science 2021-03-11 Jinjie Zhang , Rayan Saab

Already in the 1960s, Levenshtein and others studied error-correcting codes that protect against synchronization errors, such as symbol insertions and deletions. However, despite significant efforts, progress on designing such codes has…

Information Theory · Computer Science 2021-01-05 Bernhard Haeupler , Amirbehshad Shahrasbi

Three-dimensional (3D) printing's accessibility enables rapid manufacturing but also poses security risks, such as the unauthorized production of untraceable firearms and prohibited items. To ensure traceability and accountability,…

Information Theory · Computer Science 2025-08-07 Junsheng Liu , Netanel Raviv

Interactive exploration of large, multidimensional datasets plays a very important role in various scientific fields. It makes it possible not only to identify important structural features and forms, such as clusters of vertices and their…

Machine Learning · Computer Science 2023-03-10 Bartosz Minch

We consider the problem of designing low-redundancy codes in settings where one must correct deletions in conjunction with substitutions or adjacent transpositions; a combination of errors that is usually observed in DNA-based data storage.…

Information Theory · Computer Science 2021-12-21 Ryan Gabrys , Venkatesan Guruswami , João Ribeiro , Ke Wu

We consider the question of interactive communication, in which two remote parties perform a computation while their communication channel is (adversarially) noisy. We extend here the discussion into a more general and stronger class of…

Data Structures and Algorithms · Computer Science 2016-05-25 Mark Braverman , Ran Gelles , Jieming Mao , Rafail Ostrovsky

Embedding methods such as word embedding have become pillars for many applications containing discrete structures. Conventional embedding methods directly associate each symbol with a continuous embedding vector, which is equivalent to…

Machine Learning · Computer Science 2017-12-12 Ting Chen , Martin Renqiang Min , Yizhou Sun

In dense retrieval, deep encoders provide embeddings for both inputs and targets, and the softmax function is used to parameterize a distribution over a large number of candidate targets (e.g., textual passages for information retrieval).…

Machine Learning · Computer Science 2024-09-04 Nicholas Monath , Will Grathwohl , Michael Boratko , Rob Fergus , Andrew McCallum , Manzil Zaheer

Due to its high data density and longevity, DNA is considered a promising medium for satisfying ever-increasing data storage needs. However, the diversity of errors that occur in DNA sequences makes efficient error-correction a challenging…

Information Theory · Computer Science 2020-11-12 Yuanyuan Tang , Farzad Farnoud

Recent advancements in deep learning-based image compression are notable. However, prevalent schemes that employ a serial context-adaptive entropy model to enhance rate-distortion (R-D) performance are markedly slow. Furthermore, the…

Applications · Statistics 2024-03-25 Haisheng Fu , Feng Liang , Jie Liang , Zhenman Fang , Guohe Zhang , Jingning Han

Locally Decodable Codes (LDCs) are error-correcting codes $C:\Sigma^n\rightarrow \Sigma^m$ with super-fast decoding algorithms. They are important mathematical objects in many areas of theoretical computer science, yet the best…

Information Theory · Computer Science 2022-09-20 Alex Block , Jeremiah Blocki , Kuan Cheng , Elena Grigorescu , Xin Li , Yu Zheng , Minshen Zhu

The sequence reconstruction problem, introduced by Levenshtein in 2001, considers a scenario where the sender transmits a codeword from some codebook, and the receiver obtains $N$ noisy outputs of the codeword. We study the problem of…

Information Theory · Computer Science 2024-03-13 Shubhransh Singhvi , Roni Con , Han Mao Kiah , Eitan Yaakobi