English
Related papers

Related papers: Fast Relative Entropy Coding with A* coding

200 papers

Recent advancements in deep learning-based image compression are notable. However, prevalent schemes that employ a serial context-adaptive entropy model to enhance rate-distortion (R-D) performance are markedly slow. Furthermore, the…

Applications · Statistics 2024-03-25 Haisheng Fu , Feng Liang , Jie Liang , Zhenman Fang , Guohe Zhang , Jingning Han

Recent techniques such as retrieval-augmented generation or chain-of-thought reasoning have led to longer contexts and increased inference costs. Context compression techniques can reduce these costs, but the most effective approaches…

Computation and Language · Computer Science 2025-10-24 Hippolyte Pilchen , Edouard Grave , Patrick Pérez

Discrete speech representation learning has recently attracted increasing interest in both acoustic and semantic modeling. Existing approaches typically encode 16 kHz waveforms into discrete tokens at a rate of 25 or 50 tokens per second.…

Computation and Language · Computer Science 2025-09-03 Jialong Zuo , Guangyan Zhang , Minghui Fang , Shengpeng Ji , Xiaoqi Jiao , Jingyu Li , Yiwen Guo , Zhou Zhao

Entropy coding is the backbone data compression. Novel machine-learning based compression methods often use a new entropy coder called Asymmetric Numeral Systems (ANS) [Duda et al., 2015], which provides very close to optimal bitrates and…

Machine Learning · Statistics 2022-01-11 Robert Bamler

In this paper, we propose a novel method, aggregation cross-entropy (ACE), for sequence recognition from a brand new perspective. The ACE loss function exhibits competitive performance to CTC and the attention mechanism, with much quicker…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Zecheng Xie , Yaoxiong Huang , Yuanzhi Zhu , Lianwen Jin , Yuliang Liu , Lele Xie

Lossless and near-lossless image compression is of paramount importance to professional users in many technical fields, such as medicine, remote sensing, precision engineering and scientific research. But despite rapidly growing research…

Image and Video Processing · Electrical Eng. & Systems 2024-01-12 Yuanchao Bai , Xianming Liu , Kai Wang , Xiangyang Ji , Xiaolin Wu , Wen Gao

The Ant Colony Optimization (ACO) algorithm is a nature-inspired metaheuristic method used for optimization problems. Although not a machine learning method per se, ACO is often employed alongside machine learning models to enhance…

Strongly Correlated Electrons · Physics 2026-05-14 G. M. Tonin , T. Pauletti , R. M. Dos Santos , V. V. França

The transmission or storage of signals typically involves data compression. The final processing step in compression systems is generally an entropy coding stage, which converts symbols into a bit stream based on their probability…

Information Theory · Computer Science 2026-01-13 Tilo Strutz , Roman Rischke

Retrieval-Augmented Generation (RAG) enhances coding tasks by incorporating retrieved code examples into prompts. However, lengthy prompts, often exceeding tens of thousands of tokens, introduce challenges related to limited context windows…

Software Engineering · Computer Science 2026-04-13 Pengfei He , Shaowei Wang , Tse-Hsun Chen

Adaptive variable-length codes associate a variable-length codeword to the symbol being encoded depending on the previous symbols in the input string. This class of codes has been recently presented in [Dragos Trinca, arXiv:cs.DS/0505007]…

Data Structures and Algorithms · Computer Science 2007-05-23 Dragos Trinca

This paper is concerned with a class of low density generator matrix codes (LDGM), called repetition and superposition (RaS) codes, which have been proved to be capacity-achieving over binary-input output-symmetric (BIOS) channels in terms…

Information Theory · Computer Science 2024-02-22 Yixin Wang , Xiao Ma

The concept of attention, numerical weights that emphasize the importance of particular data, has proven to be very relevant in artificial intelligence. Relative entropy (RE, aka Kullback-Leibler divergence) plays a central role in…

Information Theory · Computer Science 2024-01-10 Torsten Enßlin , Carolin Weidinger , Philipp Frank

We propose a very simple and efficient video compression framework that only focuses on modeling the conditional entropy between frames. Unlike prior learning-based approaches, we reduce complexity by not performing any form of explicit…

Image and Video Processing · Electrical Eng. & Systems 2020-08-24 Jerry Liu , Shenlong Wang , Wei-Chiu Ma , Meet Shah , Rui Hu , Pranaab Dhawan , Raquel Urtasun

We propose a relative entropy gradient sampler (REGS) for sampling from unnormalized distributions. REGS is a particle method that seeks a sequence of simple nonlinear transforms iteratively pushing the initial samples from a reference…

Machine Learning · Statistics 2021-10-07 Xingdong Feng , Yuan Gao , Jian Huang , Yuling Jiao , Xu Liu

Language models (LMs) are trained on billions of tokens in an attempt to recover the true language distribution. Still, vanilla random sampling from LMs yields low quality generations. Decoding algorithms attempt to restrict the LM…

Machine Learning · Computer Science 2026-01-06 Kareem Ahmed , Sameer Singh

Superdense Coding is a cornerstone in secure quantum communication, exploiting pre-shared entanglement to encode two classical bits within a single qubit. However, noise and decoherence deteriorate entanglement quality, restricting both…

Quantum Physics · Physics 2025-04-18 Syed Emad Uddin Shubha , Tasnuva Farheen

This paper addresses the problem of lossy image compression, a fundamental problem in image processing and information theory that is involved in many real-world applications. We start by reviewing the framework of variational autoencoders…

Image and Video Processing · Electrical Eng. & Systems 2023-12-06 Zhihao Duan , Ming Lu , Jack Ma , Yuning Huang , Zhan Ma , Fengqing Zhu

The leading approach for image compression with artificial neural networks (ANNs) is to learn a nonlinear transform and a fixed entropy model that are optimized for rate-distortion performance. We show that this approach can be…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 David Minnen , George Toderici , Saurabh Singh , Sung Jin Hwang , Michele Covell

Network coding is a novel solution that significantly improve the throughput and energy consumed of wireless networks by mixing traffic flows through algebraic operations. In conventional network coding scheme, a packet has to wait for…

Information Theory · Computer Science 2014-01-27 Hongyi Zeng , Wei Chen

This paper proposes a new lossless data compression coding scheme named an asymmetric encoding-decoding scheme (AEDS), which can be considered as a generalization of tANS (tabled variant of asymmetric numeral systems). In the AEDS, a data…

Information Theory · Computer Science 2026-01-26 Hirosuke Yamamoto , Ken-ichi Iwata