English
Related papers

Related papers: $D$-ary Bounded-Length Huffman Coding

200 papers

In this paper we study the adaptive prefix coding problem in cases where the size of the input alphabet is large. We present an online prefix coding algorithm that uses $O(\sigma^{1 / \lambda + \epsilon}) $ bits of space for any constants…

Data Structures and Algorithms · Computer Science 2008-11-24 Travis Gagie , Marek Karpinski , Yakov Nekrich

For many kinds of prefix-free codes there are efficient and compact alternatives to the traditional tree-based representation. Since these put the codes into canonical form, however, they can only be used when we can choose the order in…

Data Structures and Algorithms · Computer Science 2021-04-02 Antonio Fariña , Travis Gagie , Szymon Grabowski , Giovanni Manzini , Gonzalo Navarro , Alberto Ordóñez

This paper presents new lower and upper bounds for the optimal compression of binary prefix codes in terms of the most probable input symbol, where compression efficiency is determined by the nonlinear codeword length objective of…

Information Theory · Computer Science 2008-09-09 Michael Baer

Probabilistic programming languages and other machine learning applications often require samples to be generated from a categorical distribution where the probability of each one of $n$ categories is specified as a parameter. If the…

Data Structures and Algorithms · Computer Science 2019-06-28 Daniel Tang

In this paper we study binary trees with choosable edge lengths, in particular rooted binary trees with the property that the two edges leading from every non-leaf to its two children are assigned integral lengths $l_1$ and $l_2$ with…

Information Theory · Computer Science 2016-08-08 Jens Maßberg

Since the Bin Packing Problem (BPP) is one of the main NP-hard problems, a lot of approximation algorithms have been suggested for it. It has been proven that the best algorithm for BPP has the approximation ratio of 3/2 and the time order…

Discrete Mathematics · Computer Science 2016-10-28 Abdolahad Noori Zehmakan

Huffman coding is well known to be useful in certain decision problems involving minimizing the average number of (freely chosen) queries to determine an unknown random variable. However, in problems where the queries are more constrained,…

Information Theory · Computer Science 2022-10-11 Shuyuan Zhang , Jichen Sun , Shengkang Chen

The two-dimensional non-oriented bin packing problem with due dates packs a set of rectangular items, which may be rotated by 90 degrees, into identical rectangular bins. The bins have equal processing times. An item's lateness is the…

Data Structures and Algorithms · Computer Science 2017-11-09 S. Polyakovskiy , R. M'Hallah

It is known that the following five counting problems lead to the same integer sequence~$f_t(n)$: the number of nonequivalent compact Huffman codes of length~$n$ over an alphabet of $t$ letters, the number of `nonequivalent' canonical…

Combinatorics · Mathematics 2024-10-17 Christian Elsholtz , Clemens Heuberger , Daniel Krenn

This paper presents an optimal construction of $N$-bit-delay almost instantaneous fixed-to-variable-length (AIFV) codes, the general form of binary codes we can make when finite bits of decoding delay are allowed. The presented method…

Information Theory · Computer Science 2025-08-29 Ryosuke Sugiura , Masaaki Nishino , Norihito Yasuda , Yutaka Kamamoto , Takehiro Moriya

Text compression schemes and compact data structures usually combine sophisticated probability models with basic coding methods whose average codeword length closely match the entropy of known distributions. In the frequent case where basic…

Information Theory · Computer Science 2019-10-02 N. Jesper Larsson

A common complaint about adaptive prefix coding is that it is much slower than static prefix coding. Karpinski and Nekrich recently took an important step towards resolving this: they gave an adaptive Shannon coding algorithm that encodes…

Information Theory · Computer Science 2008-12-18 Travis Gagie , Yakov Nekrich

In this paper, we revisit the classical data compression problem for domain specific texts. It is well-known that classical Huffman algorithm is optimal with respect to prefix encoding and the compression is done at character level. Since…

Information Theory · Computer Science 2013-07-04 K. Ilambharathi , G. S. N. V. Venkata Manik , N. Sadagopan , B. Sivaselvan

Let $A(n,d)$ (respectively $A(n,d,w)$) be the maximum possible number of codewords in a binary code (respectively binary constant-weight $w$ code) of length $n$ and minimum Hamming distance at least $d$. By adding new linear constraints to…

Information Theory · Computer Science 2012-12-17 Hyun Kwang Kim , Phan Thanh Toan

A covering code is a set of codewords with the property that the union of balls, suitably defined, around these codewords covers an entire space. Generally, the goal is to find the covering code with the minimum size codebook. While most…

Information Theory · Computer Science 2020-05-26 Andreas Lenz , Cyrus Rashtchian , Paul H. Siegel , Eitan Yaakobi

A lower bound on the minimum required code length of binary codes is obtained. The bound is obtained based on observing a close relation between the Ulam's liar game and channel coding. In fact, Spencer's optimal solution to the game is…

Information Theory · Computer Science 2010-07-27 Kaveh Mahdaviani , Shervin Shahidi , Shima Haddadi , Masoud Ardakani , Chintha Tellambura

Large Language Models (LLMs) have been widely adopted in commercial code completion engines, significantly enhancing coding efficiency and productivity. However, LLMs may generate code with quality issues that violate coding standards and…

Software Engineering · Computer Science 2025-03-20 Yuan Jiang , Yujian Zhang , Liang Lu , Christoph Treude , Xiaohong Su , Shan Huang , Tiantian Wang

Recent interest on permutation rank modulation shows the Kendall tau metric as an important distance metric. This note documents our first efforts to obtain upper bounds on optimal code sizes (for said metric) ala Delsarte's approach. For…

Information Theory · Computer Science 2012-06-07 Fabian Lim , Manabu Hagiwara

Weighted Hamming distance, as a similarity measure between binary codes and binary queries, provides superior accuracy in search tasks than Hamming distance. However, how to efficiently and accurately find $K$ binary codes that have the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Zhenyu Weng , Yuesheng Zhu , Ruixin Liu

Adaptive variable-length codes associate a variable-length codeword to the symbol being encoded depending on the previous symbols in the input string. This class of codes has been recently presented in [Dragos Trinca, arXiv:cs.DS/0505007]…

Data Structures and Algorithms · Computer Science 2007-05-23 Dragos Trinca