English
Related papers

Related papers: Dynamic Shannon Coding

200 papers

For some applications where the speed of decoding and the fault tolerance are important, like in video storing, one of the successful answers is Fix-Free Codes. These codes have been applied in some standards like H.263+ and MPEG-4. The…

Information Theory · Computer Science 2013-11-26 Alireza Poostindouz , Adel Aghajan

We give a polynomial-time approximation scheme for the generalization of Huffman Coding in which codeword letters have non-uniform costs (as in Morse code, where the dash is twice as long as the dot). The algorithm computes a…

Data Structures and Algorithms · Computer Science 2015-06-02 Mordecai Golin , Claire Mathieu , Neal E. Young

In this paper, a new lower bound on spectral efficiency in the low-power wideband regime is derived and utilized to develop an improved estimate of the behavior of spectral efficiency above but in the vicinity of the Shannon limit.

Information Theory · Computer Science 2014-07-10 Richard J. Barton

Universal fixed-to-variable lossless source coding for memoryless sources is studied in the finite blocklength and higher-order asymptotics regimes. Optimal third-order coding rates are derived for general fixed-to-variable codes and for…

Information Theory · Computer Science 2014-12-16 Oliver Kosut , Lalitha Sankar

A novel fast recursive coding technique is proposed. It operates with only integer values not longer 8 bits and is multiplication free. Recursion the algorithm is based on indirectly provides rather effective coding of symbols for very…

Information Theory · Computer Science 2007-08-22 Nikolay Ponomarenko , Vladimir Lukin , Karen Egiazarian , Jaakko Astola , Boris Y Ryabko

We address the recently suggested problem of causal lossless coding of a randomly arriving source samples. We construct variable-to-fixed coding schemes and show that they outperform the previously considered fixed-to-variable schemes when…

Information Theory · Computer Science 2020-10-27 Uri Abend , Anatoly Khina

PageRank is a metric that assigns importance to the vertices of a graph based on its neighbors and their scores. Recently, there has been increasing interest in computing PageRank on dynamic graphs, where the graph structure evolves due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-24 Subhajit Sahu

A skeleton Huffman tree is a Huffman tree in which all disjoint maximal perfect subtrees are shrunk into leaves. Skeleton Huffman trees, besides saving storage space, are also used for faster decoding and for speeding up Huffman-shaped…

Data Structures and Algorithms · Computer Science 2020-03-25 Dmitry Kosolobov , Oleg Merkurev

Symmetric fix-free codes are prefix condition codes in which each codeword is required to be a palindrome. Their study is motivated by the topic of joint source-channel coding. Although they have been considered by a few communities they…

Information Theory · Computer Science 2012-11-13 S. M. Hossein Tabatabaei Yazdi , Serap A. Savari

We introduce asynchronous dynamic decoder, which adopts an efficient A* algorithm to incorporate big language models in the one-pass decoding for large vocabulary continuous speech recognition. Unlike standard one-pass decoding with…

Sound · Computer Science 2021-03-17 Hang Lv , Zhehuai Chen , Hainan Xu , Daniel Povey , Lei Xie , Sanjeev Khudanpur

The rapidly improving performance of modern hardware renders convolutional codes obsolete, and allows for the practical implementation of more sophisticated correction codes such as low density parity check (LDPC) and turbo codes (TC). Both…

Information Theory · Computer Science 2015-03-20 Jarosław Duda , Paweł Korus

We construct efficient, unconditional non-malleable codes that are secure against tampering functions computed by small-depth circuits. For constant-depth circuits of polynomial size (i.e. $\mathsf{AC^0}$ tampering functions), our codes…

Computational Complexity · Computer Science 2018-02-22 Marshall Ball , Dana Dachman-Soled , Siyao Guo , Tal Malkin , Li-Yang Tan

Huffman coding finds a prefix code that minimizes mean codeword length for a given probability distribution over a finite number of items. Campbell generalized the Huffman problem to a family of problems in which the goal is to minimize not…

Information Theory · Computer Science 2007-07-16 Michael B. Baer

In this thesis we present several results in coding theory, concerning error-correcting codes and the Shannon capacity. 1. We give a general symmetry reduction of matrices occuring in semidefinite programs in coding theory. 2. We apply the…

Combinatorics · Mathematics 2020-05-07 Sven Polak

Homophonic coding is a framework to reversibly convert a message into a sequence with some target distribution. This is a promising tool to generate a codeword with a biased code-symbol distribution, which is required for capacity-achieving…

Information Theory · Computer Science 2016-07-26 Junya Honda , Hirosuke Yamamoto

In this paper, we propose a methodology to compute the optimal finite-length coding rate for random linear network coding schemes over a line network. To do so, we first model the encoding, reencoding, and decoding process of different…

Networking and Internet Architecture · Computer Science 2018-05-16 Tan Do-Duy , M. Ángeles Vázquez-Castro

This paper provides an algorithmic framework for obtaining fast distributed algorithms for a highly-dynamic setting, in which *arbitrarily many* edge changes may occur in each round. Our algorithm significantly improves upon prior work in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-13 Keren Censor-Hillel , Neta Dafni , Victor I. Kolobov , Ami Paz , Gregory Schwartzman

Safe control for control-affine systems has been extensively studied. However, due to the complexity of system dynamics, it is challenging and time-consuming to apply these methods directly to non-control-affine systems, which cover a large…

Systems and Control · Electrical Eng. & Systems 2022-01-03 Yihang Yao , Tianhao Wei , Changliu Liu

This paper presents a new theory, known as robust dynamic pro- gramming, for a class of continuous-time dynamical systems. Different from traditional dynamic programming (DP) methods, this new theory serves as a fundamental tool to analyze…

Optimization and Control · Mathematics 2018-09-18 Tao Bian , Zhong-Ping Jiang

We show how universal codes can be used for solving some of the most important statistical problems for time series. By definition, a universal code (or a universal lossless data compressor) can compress any sequence generated by a…

Information Theory · Computer Science 2008-09-09 Boris Ryabko