English
Related papers

Related papers: Improving Lossless Compression Rates via Monte Car…

200 papers

We quantify the upper bound on the size of the implicit neural representation (INR) model from a digital perspective. The upper bound of the model size increases exponentially as the required bit-precision increases. To this end, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Woo Kyoung Han , Byeonghun Lee , Hyunmin Cho , Sunghoon Im , Kyong Hwan Jin

Trit-plane coding enables deep progressive image compression, but it cannot use autoregressive context models. In this paper, we propose the context-based trit-plane coding (CTC) algorithm to achieve progressive compression more compactly.…

Image and Video Processing · Electrical Eng. & Systems 2023-03-14 Seungmin Jeon , Kwang Pyo Choi , Youngo Park , Chang-Su Kim

The rapid growth of digital data has heightened the demand for efficient lossless compression methods. However, existing algorithms exhibit trade-offs: some achieve high compression ratios, others excel in encoding or decoding speed, and…

Information Theory · Computer Science 2025-10-01 Md. Atiqur Rahman , MM Fazle Rabbi

Entropy coding is widely used in typical learned image compression (LIC) that converts latents into a compact bitstream. However, entropy coding is typically sequential and becomes the coding latency bottleneck. To overcome it, we present…

Image and Video Processing · Electrical Eng. & Systems 2026-05-25 Hao Cao , Wenqi Guo , Zhijin Qin , Jungong Han

This study presents a new lossy image compression method that utilizes the multi-scale features of natural images. Our model consists of two networks: multi-scale lossy autoencoder and parallel multi-scale lossless coder. The multi-scale…

Machine Learning · Statistics 2018-05-17 Ken Nakanishi , Shin-ichi Maeda , Takeru Miyato , Daisuke Okanohara

Data used for analytics and machine learning often take the form of tables with categorical entries. We introduce a family of lossless compression algorithms for such data that proceed in four steps: $(i)$ Estimate latent variables…

Information Theory · Computer Science 2023-02-21 Andrea Montanari , Eric Weiner

We investigate lossy compression (source coding) of data in the form of permutations. This problem has direct applications in the storage of ordinal data or rankings, and in the analysis of sorting algorithms. We analyze the rate-distortion…

Information Theory · Computer Science 2016-11-18 Da Wang , Arya Mazumdar , Gregory Wornell

The ever-growing size of neural networks poses serious challenges on resource-constrained devices, such as embedded sensors. Compression algorithms that reduce their size can mitigate these problems, provided that model performance stays…

Machine Learning · Computer Science 2025-05-27 Alexander Conzelmann , Robert Bamler

Contemporary lossy image and video coding standards rely on transform coding, the process through which pixels are mapped to an alternative representation to facilitate efficient data compression. Despite impressive performance of…

Image and Video Processing · Electrical Eng. & Systems 2023-02-21 Lyndon R. Duong , Bohan Li , Cheng Chen , Jingning Han

The design of Quantum Turbo Codes (QTCs) typically relies on the analysis of their distance spectra, followed by Monte-Carlo simulations. By contrast, in this paper we appropriately adapt the conventional non-binary EXtrinsic Information…

Quantum Physics · Physics 2015-02-04 Zunaira Babar , Soon Xin Ng , Lajos Hanzo

As the demand for digital information grows in fields like medicine, remote sensing, and archival, efficient image compression becomes crucial. This paper focuses on lossless image compression, vital for managing the increasing volume of…

Information Theory · Computer Science 2024-05-01 Rustam Mamedov

We present a new lossy compressor for discrete-valued sources. For coding a sequence $x^n$, the encoder starts by assigning a certain cost to each possible reconstruction sequence. It then finds the one that minimizes this cost and…

Information Theory · Computer Science 2016-11-18 Shirin Jalali , Andrea Montanari , Tsachy Weissman

Context. Processing radio interferometric data often requires storing forward-predicted model data. In direction-dependent calibration, these data may have a volume an order of magnitude larger than the original data. Existing lossy…

Instrumentation and Methods for Astrophysics · Physics 2026-02-04 A. R. Offringa , R. J. van Weeren

In this paper, we propose a new class of bit flipping algorithms for low-density parity-check (LDPC) codes over the binary symmetric channel (BSC). Compared to the regular (parallel or serial) bit flipping algorithms, the proposed…

Information Theory · Computer Science 2016-11-17 Dung Viet Nguyen , Bane Vasic , Michael W. Marcellin

Learned image compression (LIC) methods have experienced significant progress during recent years. However, these methods are primarily dedicated to optimizing the rate-distortion (R-D) performance at medium and high bitrates (> 0.1 bits…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Anqi Li , Feng Li , Jiaxin Han , Huihui Bai , Runmin Cong , Chunjie Zhang , Meng Wang , Weisi Lin , Yao Zhao

In this study, we propose a novel scheme for systematic improvement of lossless image compression coders from the point of view of the universal codes in information theory. In the proposed scheme, we describe a generative model class of…

Information Theory · Computer Science 2019-04-17 Yuta Nakahara , Toshiyasu Matsushima

Recent advancements in neural compression have surpassed traditional codecs in PSNR and MS-SSIM measurements. However, at low bit-rates, these methods can introduce visually displeasing artifacts, such as blurring, color shifting, and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Daxin Li , Yuanchao Bai , Kai Wang , Junjun Jiang , Xianming Liu

We propose an end-to-end trainable image compression framework with a multi-scale and context-adaptive entropy model, especially for low bitrate compression. Due to the success of autoregressive priors in probabilistic generative model, the…

Image and Video Processing · Electrical Eng. & Systems 2019-10-18 Jing Zhou , Sihan Wen , Akira Nakagawa , Kimihiko Kazui , Zhiming Tan

This paper explores the combination of neural network quantization and entropy coding for memory footprint minimization. Edge deployment of quantized models is hampered by the harsh Pareto frontier of the accuracy-to-bitwidth tradeoff,…

Machine Learning · Computer Science 2024-06-11 C. Metz , O. Bichler , A. Dupret

Rate-distortion optimization through neural networks has accomplished competitive results in compression efficiency and image quality. This learning-based approach seeks to minimize the compromise between compression rate and reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Raül Pérez-Gonzalo , Andreas Espersen , Antonio Agudo