English
Related papers

Related papers: Advancing The Rate-Distortion-Computation Frontier…

200 papers

We propose sandwiching standard image and video codecs between pre- and post-processing neural networks. The networks are jointly trained through a differentiable codec proxy to minimize a given rate-distortion loss. This sandwich…

Image and Video Processing · Electrical Eng. & Systems 2025-02-24 Onur G. Guleryuz , Philip A. Chou , Berivan Isik , Hugues Hoppe , Danhang Tang , Ruofei Du , Jonathan Taylor , Philip Davidson , Sean Fanello

Image classification remains a fundamental yet challenging task in computer vision, particularly when fine-grained feature extraction and background noise suppression are required simultaneously. Conventional convolutional neural networks,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Wentao Jiang , Yuanchan Xu , Heng Yuan

Neural compression methods are gaining popularity due to their superior rate-distortion performance over traditional methods, even at extremely low bitrates below 0.1 bpp. As deep learning architectures, these models are prone to bias…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Tian Qiu , Arjun Nichani , Rasta Tadayontahmasebi , Haewon Jeong

Recent advances in deep learning have led to superhuman performance across a variety of applications. Recently, these methods have been successfully employed to improve the rate-distortion performance in the task of image compression.…

Image and Video Processing · Electrical Eng. & Systems 2022-02-01 Ankur Mali , Alexander Ororbia , Daniel Kifer , Lee Giles

We describe a search-free resizing framework that can further improve the rate-distortion tradeoff of recent learned image compression models. Our approach is simple: compose a pair of differentiable downsampling/upsampling layers that…

Image and Video Processing · Electrical Eng. & Systems 2022-04-27 Li-Heng Chen , Christos G. Bampis , Zhi Li , Lukáš Krasula , Alan C. Bovik

This paper presents a set of full-resolution lossy image compression methods based on neural networks. Each of the architectures we describe can provide variable compression rates during deployment without requiring retraining of the…

Computer Vision and Pattern Recognition · Computer Science 2017-07-10 George Toderici , Damien Vincent , Nick Johnston , Sung Jin Hwang , David Minnen , Joel Shor , Michele Covell

The rapid rise of real-time communication and large language models has significantly increased the importance of speech compression. Deep learning-based neural speech codecs have outperformed traditional signal-level speech codecs in terms…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Jun Xu , Zhengxue Cheng , Guangchuan Chi , Yuhan Liu , Yuelin Hu , Li Song

Neural video compression (NVC) technologies have advanced rapidly in recent years, yielding state-of-the-art schemes such as DCVC-RT that offer superior compression efficiency to H.266/VVC and real-time encoding/decoding capabilities.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Hui Xiang , Yifan Bian , Li Li , Jingran Wu , Xianguo Zhang , Dong Liu

A composite source, consisting of multiple subsources and a memoryless switch, outputs one symbol at a time from the subsource selected by the switch. If some data should be encoded more accurately than other data from an information…

Information Theory · Computer Science 2024-11-14 Jiakun Liu , H. Vincent Poor , Iickho Song , Wenyi Zhang

Feature coding for machines (FCM) is a lossy compression paradigm for split-inference. The transmitter encodes the outputs of the first part of a neural network before sending them to the receiver for completing the inference. Practical FCM…

Image and Video Processing · Electrical Eng. & Systems 2026-01-30 Samuel Fernández-Menduiña , Hyomin Choi , Fabien Racapé , Eduardo Pavez , Antonio Ortega

Dataset condensation, a concept within data-centric learning, efficiently transfers critical attributes from an original dataset to a synthetic version, maintaining both diversity and realism. This approach significantly improves model…

Machine Learning · Computer Science 2025-01-20 Shitong Shao , Zikai Zhou , Huanran Chen , Zhiqiang Shen

The rapid growth of visual data under stringent storage and bandwidth constraints makes extremely low-bitrate image compression increasingly important. While Vector Quantization (VQ) offers strong structural fidelity, existing methods lack…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Shiyin Jiang , Wei Long , Minghao Han , Zhenghao Chen , Ce Zhu , Shuhang Gu

Optimized for pixel fidelity metrics, images compressed by existing image codec are facing systematic challenges when used for visual analysis tasks, especially under low-bitrate coding. This paper proposes a visual analysis-motivated…

Image and Video Processing · Electrical Eng. & Systems 2021-04-22 Zhimeng Huang , Chuanmin Jia , Shanshe Wang , Siwei Ma

We study task-oriented lossy compression through the lens of rate-distortion-classification (RDC) representations. The source is Bernoulli, the distortion measure is Hamming, and the binary classification variable is coupled to the source…

Information Theory · Computer Science 2026-05-19 Nam Nguyen , Thinh Nguyen , Bella Bose

Deep video compression has made significant progress in recent years, achieving rate-distortion performance that surpasses that of traditional video compression methods. However, rate control schemes tailored for deep video compression have…

Multimedia · Computer Science 2025-05-09 Bowen Gu , Hao Chen , Ming Lu , Jie Yao , Zhan Ma

This paper studies the rate-distortion-perception (RDP) tradeoff for a memoryless source model in the asymptotic limit of large block-lengths. The perception measure is based on a divergence between the distributions of the source and…

Information Theory · Computer Science 2025-04-29 Sadaf Salehkalaibar , Jun Chen , Ashish Khisti , Wei Yu

In many learning situations, resources at inference time are significantly more constrained than resources at training time. This paper studies a general paradigm, called Differentiable ARchitecture Compression (DARC), that combines model…

Machine Learning · Computer Science 2019-05-21 Shashank Singh , Ashish Khetan , Zohar Karnin

The field of neural image compression has witnessed exciting progress as recently proposed architectures already surpass the established transform coding based approaches. While, so far, research has mainly focused on architecture and model…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Joaquim Campos , Simon Meierhans , Abdelaziz Djelouah , Christopher Schroers

Recent advancements in deep learning-based image compression are notable. However, prevalent schemes that employ a serial context-adaptive entropy model to enhance rate-distortion (R-D) performance are markedly slow. Furthermore, the…

Applications · Statistics 2024-03-25 Haisheng Fu , Feng Liang , Jie Liang , Zhenman Fang , Guohe Zhang , Jingning Han

Neural Video Compression (NVC) has achieved remarkable performance in recent years. However, precise rate control remains a challenge due to the inherent limitations of learning-based codecs. To solve this issue, we propose a dynamic video…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Chenhao Zhang , Wei Gao