English
Related papers

Related papers: Entropy Computation of Document Images in Run-Leng…

200 papers

We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can be efficiently and accurately estimated via a converging…

Statistical Mechanics · Physics 2009-11-07 David P. Feldman , James P. Crutchfield

Image compression emerges as a pivotal tool in the efficient handling and transmission of digital images. Its ability to substantially reduce file size not only facilitates enhanced data storage capacity but also potentially brings…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Justin Yang , Zhihao Duan , Andrew Peng , Yuning Huang , Jiangpeng He , Fengqing Zhu

Document classification is the detection specific content of interest in text documents. In contrast to the data-driven machine learning classifiers, knowledge-based classifiers can be constructed based on domain specific knowledge, which…

Computation and Language · Computer Science 2022-06-07 AtMa P. O. Chan

Entropy estimation is of practical importance in information theory and statistical science. Many existing entropy estimators suffer from fast growing estimation bias with respect to dimensionality, rendering them unsuitable for…

Information Theory · Computer Science 2023-08-22 Ziqiao Ao , Jinglai Li

Efficient approximation lies at the heart of large-scale machine learning problems. In this paper, we propose a novel, robust maximum entropy algorithm, which is capable of dealing with hundreds of moments and allows for computationally…

Machine Learning · Statistics 2019-06-05 Diego Granziol , Binxin Ru , Stefan Zohren , Xiaowen Doing , Michael Osborne , Stephen Roberts

In this paper, we present our image compression framework designed for CLIC 2020 competition. Our method is based on Variational AutoEncoder (VAE) architecture which is strengthened with residual structures. In short, we make three…

Image and Video Processing · Electrical Eng. & Systems 2020-04-20 Zongyu Guo , Yaojun Wu , Runsen Feng , Zhizheng Zhang , Zhibo Chen

We present a novel compression algorithm for reducing the storage of LiDAR sensor data streams. Our model exploits spatio-temporal relationships across multiple LiDAR sweeps to reduce the bitrate of both geometry and intensity values.…

Image and Video Processing · Electrical Eng. & Systems 2021-01-12 Sourav Biswas , Jerry Liu , Kelvin Wong , Shenlong Wang , Raquel Urtasun

The entropy of the codes usually serves as the rate loss in the recent learned lossy image compression methods. Precise estimation of the probabilistic distribution of the codes plays a vital role in the performance. However, existing deep…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 Mu Li , Kai Zhang , Wangmeng Zuo , Radu Timofte , David Zhang

This paper studies the notion of computational entropy. Using techniques from convex optimization, we investigate the following problems: (a) Can we derandomize the computational entropy? More precisely, for the computational entropy, what…

Information Theory · Computer Science 2013-05-17 Maciej Skórski

Recently, learned image compression has achieved remarkable performance. The entropy model, which estimates the distribution of the latent representation, plays a crucial role in boosting rate-distortion performance. However, most entropy…

Image and Video Processing · Electrical Eng. & Systems 2024-09-16 Wei Jiang , Jiayu Yang , Yongqi Zhai , Peirong Ning , Feng Gao , Ronggang Wang

There has been a significant effort by the research community to address the problem of providing methods to organize documentation with the help of information Retrieval methods. In this report paper, we present several experiments with…

Information Retrieval · Computer Science 2022-06-07 Rui Portocarrero Sarmento , Douglas O. Cardoso , João Gama , Pavel Brazdil

We consider the problem of evaluating regular spanners over compressed documents, i.e., we wish to solve evaluation tasks directly on the compressed data, without decompression. As compressed forms of the documents we use straight-line…

Data Structures and Algorithms · Computer Science 2021-01-27 Markus L. Schmid , Nicole Schweikardt

Background: Transitioning from an old medical coding system to a new one can be challenging, especially when the two coding systems are significantly different. The US experienced such a transition in 2015. Objective: This research aims to…

Information Theory · Computer Science 2020-12-24 Jerome Niyirora

For neural video codec, it is critical, yet challenging, to design an efficient entropy model which can accurately predict the probability distribution of the quantized latent representation. However, most existing video codecs directly use…

Image and Video Processing · Electrical Eng. & Systems 2022-07-14 Jiahao Li , Bin Li , Yan Lu

The leading approach for image compression with artificial neural networks (ANNs) is to learn a nonlinear transform and a fixed entropy model that are optimized for rate-distortion performance. We show that this approach can be…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 David Minnen , George Toderici , Saurabh Singh , Sung Jin Hwang , Michele Covell

Identifying regularities in strings, such as \emph{periods} and \emph{covers}, is crucial for applications in text compression, computational biology, and pattern recognition. \emph{Characters-Distance-Sampling} (\texttt{CDS}) is an…

Data Structures and Algorithms · Computer Science 2025-03-03 Thierry Lecroq , Francesco Pio Marino

A new run length encoding algorithm for lossless data compression that exploits positional redundancy by representing data in a two-dimensional model of concentric circles is presented. This visual transform enables detection of runs (each…

Data Structures and Algorithms · Computer Science 2021-07-30 Pranav Venkatram

Variational Autoencoders (VAEs) have seen widespread use in learned image compression. They are used to learn expressive latent representations on which downstream compression methods can operate with high efficiency. Recently proposed…

Information Theory · Computer Science 2021-04-20 Gergely Flamich , Marton Havasi , José Miguel Hernández-Lobato

Image forensics has become increasingly crucial in our daily lives. Among various types of forgeries, copy-move forgery detection has received considerable attention within the academic community. Keypoint-based algorithms, particularly…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Li Jiang , Zhaowei Lu

Recent work of Acharya et al. (NeurIPS 2019) showed how to estimate the entropy of a distribution $\mathcal D$ over an alphabet of size $k$ up to $\pm\epsilon$ additive error by streaming over $(k/\epsilon^3) \cdot…

Data Structures and Algorithms · Computer Science 2022-05-23 Maryam Aliakbarpour , Andrew McGregor , Jelani Nelson , Erik Waingarten