English
Related papers

Related papers: Balanced Rate-Distortion Optimization in Learned I…

200 papers

We describe an image compression method, consisting of a nonlinear analysis transformation, a uniform quantizer, and a nonlinear synthesis transformation. The transforms are constructed in three successive stages of convolutional linear…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Johannes Ballé , Valero Laparra , Eero P. Simoncelli

Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage space. Error-bounded lossy compression has been considered one…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-09 Daoce Wang , Jesus Pulido , Pascal Grosset , Sian Jin , Jiannan Tian , James Ahrens , Dingwen Tao

High dynamic range (HDR) capture and display have seen significant growth in popularity driven by the advancements in technology and increasing consumer demand for superior image quality. As a result, HDR image compression is crucial to…

Image and Video Processing · Electrical Eng. & Systems 2024-07-19 Peibei Cao , Haoyu Chen , Jingzhe Ma , Yu-Chieh Yuan , Zhiyong Xie , Xin Xie , Haiqing Bai , Kede Ma

The rate-distortion performance of neural image compression models has exceeded the state-of-the-art for non-learned codecs, but neural codecs are still far from widespread deployment and adoption. The largest obstacle is having efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 David Minnen , Nick Johnston

Variable rate is a requirement for flexible and adaptable image and video compression. However, deep image compression methods are optimized for a single fixed rate-distortion tradeoff. While this can be addressed by training multiple…

Image and Video Processing · Electrical Eng. & Systems 2020-07-23 Fei Yang , Luis Herranz , Joost van de Weijer , José A. Iglesias Guitián , Antonio López , Mikhail Mozerov

Despite a short history, neural image codecs have been shown to surpass classical image codecs in terms of rate-distortion performance. However, most of them suffer from significantly longer decoding times, which hinders the practical…

Image and Video Processing · Electrical Eng. & Systems 2023-05-16 Yixin Gao , Runsen Feng , Zongyu Guo , Zhibo Chen

In this paper, we propose Image Downscaling Assessment by Rate-Distortion (IDA-RD), a novel measure to quantitatively evaluate image downscaling algorithms. In contrast to image-based methods that measure the quality of downscaled images,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Yuanbang Liang , Bhavesh Garg , Paul L Rosin , Yipeng Qin

In federated learning (FL), the communication constraint between the remote learners and the Parameter Server (PS) is a crucial bottleneck. For this reason, model updates must be compressed so as to minimize the loss in accuracy resulting…

Machine Learning · Computer Science 2023-01-24 Yangyi Liu , Stefano Rini , Sadaf Salehkalaibar , Jun Chen

Learnable Image Compression (LIC) has shown the potential to outperform standardized video codecs in RD efficiency, prompting the research for hardware-friendly implementations. Most existing LIC hardware implementations prioritize latency…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Alaa Mazouz , Sumanta Chaudhuri , Marco Cagnanzzo , Mihai Mitrea , Enzo Tartaglione , Attilio Fiandrotti

In recent years, learned image compression (LIC) methods have achieved significant performance improvements. However, obtaining a more compact latent representation and reducing the impact of quantization errors remain key challenges in the…

Image and Video Processing · Electrical Eng. & Systems 2025-02-24 Shiqi Jiang , Hui Yuan , Shuai Li , Raouf Hamzaoui , Xu Wang , Junyan Huo

Learned image compression (LIC) integrates deep neural networks (DNNs) to map high-dimensional images into compact latent representations, reducing redundancy and achieving superior rate-distortion (RD) performance in benign settings.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Jiaming Liang , Chi-Man Pun , Weisi Lin , Greta Seng Peng Mok

Direct Preference Optimization (DPO) has been proposed as a promising alternative to Proximal Policy Optimization (PPO) based Reinforcement Learning with Human Feedback (RLHF). However, empirical evaluations consistently reveal suboptimal…

Machine Learning · Computer Science 2025-03-03 Qinwei Ma , Jingzhe Shi , Can Jin , Jenq-Neng Hwang , Serge Belongie , Lei Li

High perceptual quality and low distortion degree are two important goals in image restoration tasks such as super-resolution (SR). Most of the existing SR methods aim to achieve these goals by minimizing the corresponding yet conflicting…

Image and Video Processing · Electrical Eng. & Systems 2024-09-25 Lingchen Sun , Jie Liang , Shuaizheng Liu , Hongwei Yong , Lei Zhang

We consider distributed optimization under communication constraints for training deep learning models. We propose a new algorithm, whose parameter updates rely on two forces: a regular gradient step, and a corrective direction dictated by…

Machine Learning · Computer Science 2022-04-29 Yunfei Teng , Wenbo Gao , Francois Chalus , Anna Choromanska , Donald Goldfarb , Adrian Weller

Rate-distortion (R-D) function, a key quantity in information theory, characterizes the fundamental limit of how much a data source can be compressed subject to a fidelity criterion, by any compression algorithm. As researchers push for…

Information Theory · Computer Science 2022-03-14 Yibo Yang , Stephan Mandt

Despite its improvements in coding performance compared to traditional codecs, Learned Image Compression (LIC) suffers from large computational costs for storage and deployment. Model quantization offers an effective solution to reduce the…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Md Adnan Faisal Hossain , Zhihao Duan , Fengqing Zhu

Learned image compression (LIC) has reached a comparable coding gain with traditional hand-crafted methods such as VVC intra. However, the large network complexity prohibits the usage of LIC on resource-limited embedded systems. Network…

Image and Video Processing · Electrical Eng. & Systems 2022-05-31 Heming Sun , Lu Yu , Jiro Katto

Communication compression has become a key strategy to speed up distributed optimization. However, existing decentralized algorithms with compression mainly focus on compressing DGD-type algorithms. They are unsatisfactory in terms of…

Machine Learning · Computer Science 2021-03-22 Xiaorui Liu , Yao Li , Rongrong Wang , Jiliang Tang , Ming Yan

The rate-distortion (RD) theory is one of the key concepts in information theory, providing theoretical limits for compression performance and guiding the source coding design, with both theoretical and practical significance. The…

Information Theory · Computer Science 2025-07-28 Shitong Wu , Sicheng Xu , Lingyi Chen , Huihui Wu , Wenyi Zhang

In recent years, there has been a sharp increase in transmission of images to remote servers specifically for the purpose of computer vision. In many applications, such as surveillance, images are mostly transmitted for automated analysis,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Alon Harell , Anderson De Andrade , Ivan V. Bajic