English
Related papers

Related papers: Rate Distortion Characteristic Modeling for Neural…

200 papers

We formalise the widespread idea of interpreting neural network decisions as an explicit optimisation problem in a rate-distortion framework. A set of input features is deemed relevant for a classification decision if the expected…

Machine Learning · Computer Science 2019-05-28 Jan Macdonald , Stephan Wäldchen , Sascha Hauch , Gitta Kutyniok

Deep neural object detection or segmentation networks are commonly trained with pristine, uncompressed data. However, in practical applications the input images are usually deteriorated by compression that is applied to efficiently transmit…

Image and Video Processing · Electrical Eng. & Systems 2022-05-16 Kristian Fischer , Christian Blum , Christian Herglotz , André Kaup

Neural Video Compression (NVC) has achieved remarkable performance in recent years. However, precise rate control remains a challenge due to the inherent limitations of learning-based codecs. To solve this issue, we propose a dynamic video…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Chenhao Zhang , Wei Gao

The field of neural image compression has witnessed exciting progress as recently proposed architectures already surpass the established transform coding based approaches. While, so far, research has mainly focused on architecture and model…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Joaquim Campos , Simon Meierhans , Abdelaziz Djelouah , Christopher Schroers

Rate-distortion (RD) theory is at the heart of lossy data compression. Here we aim to model the generalized RD (GRD) trade-off between the visual quality of a compressed video and its encoding profiles (e.g., bitrate and spatial…

Image and Video Processing · Electrical Eng. & Systems 2020-06-24 Zhengfang Duanmu , Wentao Liu , Zhuoran Li , Kede Ma , Zhou Wang

Rate-distortion optimization through neural networks has accomplished competitive results in compression efficiency and image quality. This learning-based approach seeks to minimize the compromise between compression rate and reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Raül Pérez-Gonzalo , Andreas Espersen , Antonio Agudo

A new Lossy Causal Temporal Convolutional Neural Network Autoencoder for anomaly detection is proposed in this work. Our framework uses a rate-distortion loss and an entropy bottleneck to learn a compressed latent representation for the…

Machine Learning · Computer Science 2022-12-06 Christopher P. Ley , Jorge F. Silva

We study task-oriented lossy compression through the lens of rate-distortion-classification (RDC) representations. The source is Bernoulli, the distortion measure is Hamming, and the binary classification variable is coupled to the source…

Information Theory · Computer Science 2026-05-19 Nam Nguyen , Thinh Nguyen , Bella Bose

Recent work has shown that Variational Autoencoders (VAEs) can be used to upper-bound the information rate-distortion (R-D) function of images, i.e., the fundamental limit of lossy image compression. In this paper, we report an improved…

Image and Video Processing · Electrical Eng. & Systems 2023-09-07 Zhihao Duan , Jack Ma , Jiangpeng He , Fengqing Zhu

We describe an image compression method, consisting of a nonlinear analysis transformation, a uniform quantizer, and a nonlinear synthesis transformation. The transforms are constructed in three successive stages of convolutional linear…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Johannes Ballé , Valero Laparra , Eero P. Simoncelli

Variable rate is a requirement for flexible and adaptable image and video compression. However, deep image compression methods are optimized for a single fixed rate-distortion tradeoff. While this can be addressed by training multiple…

Image and Video Processing · Electrical Eng. & Systems 2020-07-23 Fei Yang , Luis Herranz , Joost van de Weijer , José A. Iglesias Guitián , Antonio López , Mikhail Mozerov

Learned image compression has achieved great success due to its excellent modeling capacity, but seldom further considers the Rate-Distortion Optimization (RDO) of each input image. To explore this potential in the learned codec, we make…

Image and Video Processing · Electrical Eng. & Systems 2022-03-31 Dezhao Wang , Wenhan Yang , Yueyu Hu , Jiaying Liu

Recently, a number of authors have proposed decoding schemes for Reed-Solomon (RS) codes based on multiple trials of a simple RS decoding algorithm. In this paper, we present a rate-distortion (R-D) approach to analyze these…

Information Theory · Computer Science 2009-08-21 Phong S. Nguyen , Henry D. Pfister , Krishna R. Narayanan

Split computing has emerged as a recent paradigm for implementation of DNN-based AI workloads, wherein a DNN model is split into two parts, one of which is executed on a mobile/client device and the other on an edge-server (or cloud). Data…

Machine Learning · Computer Science 2022-08-25 Parual Datta , Nilesh Ahuja , V. Srinivasa Somayazulu , Omesh Tickoo

Consider the problem of estimating a latent signal from a lossy compressed version of the data when the compressor is agnostic to the relation between the signal and the data. This situation arises in a host of modern applications when data…

Information Theory · Computer Science 2021-01-12 Alon Kipnis , Stefano Rini , Andrea J. Goldsmith

By extracting task-relevant information while maximally compressing the input, the information bottleneck (IB) principle has provided a guideline for learning effective and robust representations of the target inference. However, extending…

Information Theory · Computer Science 2025-01-22 Yuhan Wang , Youlong Wu , Shuai Ma , Ying-Jun Angela Zhang

The high computational costs associated with large deep learning models significantly hinder their practical deployment. Model pruning has been widely explored in deep learning literature to reduce their computational burden, but its…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Md Adnan Faisal Hossain , Fengqing Zhu

In rate-distortion optimization, the encoder settings are determined by maximizing a reconstruction quality measure subject to a constraint on the bit rate. One of the main challenges of this approach is to define a quality measure that can…

Image and Video Processing · Electrical Eng. & Systems 2021-08-11 Qi Liu , Hui Yuan , Raouf Hamzaoui , Honglei Su , Junhui Hou , Huan Yang

Recent advancements in deep learning-based image compression are notable. However, prevalent schemes that employ a serial context-adaptive entropy model to enhance rate-distortion (R-D) performance are markedly slow. Furthermore, the…

Applications · Statistics 2024-03-25 Haisheng Fu , Feng Liang , Jie Liang , Zhenman Fang , Guohe Zhang , Jingning Han

The rate-distortion function (RDF) has long been an information-theoretic benchmark for data compression. As its natural extension, the indirect rate-distortion function (iRDF) corresponds to the scenario where the encoder can only access…

Information Theory · Computer Science 2025-03-11 Zichao Yu , Qiang Sun , Wenyi Zhang