English
Related papers

Related papers: Balanced Rate-Distortion Optimization in Learned I…

200 papers

In recent years, the compression of large language models (LLMs) has emerged as a key problem in facilitating LLM deployment on resource-limited devices, reducing compute costs, and mitigating the environmental footprint due to large-scale…

Machine Learning · Computer Science 2025-05-07 Sean I. Young

In this paper, we propose a distributed algorithm, called Directed-Distributed Gradient Descent (D-DGD), to solve multi-agent optimization problems over directed graphs. Existing algorithms mostly deal with similar problems under the…

Optimization and Control · Mathematics 2016-02-02 Chenguang Xi , Qiong Wu , Usman A. Khan

Rate-Distortion Optimized Quantization (RDOQ) has played an important role in the coding performance of recent video compression standards such as H.264/AVC, H.265/HEVC, VP9 and AV1. This scheme yields significant reductions in bit-rate at…

Machine Learning · Computer Science 2020-12-14 Dana Kianfar , Auke Wiggers , Amir Said , Reza Pourreza , Taco Cohen

In rate-distortion optimization, the encoder settings are determined by maximizing a reconstruction quality measure subject to a constraint on the bit rate. One of the main challenges of this approach is to define a quality measure that can…

Image and Video Processing · Electrical Eng. & Systems 2021-08-11 Qi Liu , Hui Yuan , Raouf Hamzaoui , Honglei Su , Junhui Hou , Huan Yang

The problem of high-dimensional and large-scale representation of visual data is addressed from an unsupervised learning perspective. The emphasis is put on discrete representations, where the description length can be measured in bits and…

Machine Learning · Computer Science 2019-01-25 Sohrab Ferdowsi

Recently, deep learning-based image compression has made signifcant progresses, and has achieved better ratedistortion (R-D) performance than the latest traditional method, H.266/VVC, in both subjective metric and the more challenging…

Image and Video Processing · Electrical Eng. & Systems 2022-06-23 Haisheng Fu , Feng Liang , Jie Liang , Binglin Li , Guohe Zhang , Jingning Han

In deep learning, optimization plays a vital role. By focusing on image classification, this work investigates the pros and cons of the widely used optimizers, and proposes a new optimizer: Perturbated Unit Gradient Descent (PUGD) algorithm…

Machine Learning · Computer Science 2022-11-10 Ching-Hsun. Tseng , Liu-Hsueh. Cheng , Shin-Jye. Lee , Xiaojun Zeng

Real-world image super-resolution (Real-SR) is a challenging problem due to the complex degradation patterns in low-resolution images. Unlike approaches that assume a broadly encompassing degradation space, we focus specifically on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Shuchen Lin , Mingtao Feng , Weisheng Dong , Fangfang Wu , Jianqiao Luo , Yaonan Wang , Guangming Shi

By extracting task-relevant information while maximally compressing the input, the information bottleneck (IB) principle has provided a guideline for learning effective and robust representations of the target inference. However, extending…

Information Theory · Computer Science 2025-01-22 Yuhan Wang , Youlong Wu , Shuai Ma , Ying-Jun Angela Zhang

The latest advancements in neural image compression show great potential in surpassing the rate-distortion performance of conventional standard codecs. Nevertheless, there exists an indelible domain gap between the datasets utilized for…

Image and Video Processing · Electrical Eng. & Systems 2023-08-16 Yue Lv , Jinxi Xiang , Jun Zhang , Wenming Yang , Xiao Han , Wei Yang

The probabilistic diffusion model (DM), generating content by inferencing through a recursive chain structure, has emerged as a powerful framework for visual generation. After pre-training on enormous data, the model needs to be properly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Tao Ren , Zishi Zhang , Jingyang Jiang , Zehao Li , Shentao Qin , Yi Zheng , Guanghao Li , Qianyou Sun , Yan Li , Jiafeng Liang , Xinping Li , Yijie Peng

Learned Image Compression (LIC) has achieved dramatic progress regarding objective and subjective metrics. MSE-based models aim to improve objective metrics while generative models are leveraged to improve visual quality measured by…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Jixiang Luo , Yan Wang , Hongwei Qin

This paper introduces a dual-critic reinforcement learning (RL) framework to address the problem of frame-level bit allocation in HEVC/H.265. The objective is to minimize the distortion of a group of pictures (GOP) under a rate constraint.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Yung-Han Ho , Guo-Lun Jin , Yun Liang , Wen-Hsiao Peng , Xiaobo Li

Conventional learning methods simplify the bilinear model by regarding two intrinsically coupled factors independently, which degrades the optimization procedure. One reason lies in the insufficient training due to the asynchronous gradient…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Li'an Zhuo , Baochang Zhang , Linlin Yang , Hanlin Chen , Qixiang Ye , David Doermann , Guodong Guo , Rongrong Ji

Learned image compression has recently shown the potential to outperform the standard codecs. State-of-the-art rate-distortion (R-D) performance has been achieved by context-adaptive entropy coding approaches in which hyperprior and…

Image and Video Processing · Electrical Eng. & Systems 2021-01-01 Mohammad Akbari , Jie Liang , Jingning Han , Chengjie Tu

This paper proposes a learning aided gradient descent (LAGD) algorithm to solve the weighted sum rate (WSR) maximization problem for multiple-input single-output (MISO) beamforming. The proposed LAGD algorithm directly optimizes the…

Signal Processing · Electrical Eng. & Systems 2022-07-26 Zhixiong Yang , Jing-Yuan Xia , Junshan Luo , Shuanghui Zhang , Deniz Gündüz

Low-rank decomposition (LRD) is a state-of-the-art method for visual data reconstruction and modelling. However, it is a very challenging problem when the image data contains significant occlusion, noise, illumination variation, and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chen Chen , Baochang Zhang , Alessio Del Bue , Vittorio Murino

This paper explores the possibility of extending the capability of pre-trained neural image compressors (e.g., adapting to new data or target bitrates) without breaking backward compatibility, the ability to decode bitstreams encoded by the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-01 Zhihao Duan , Ming Lu , Justin Yang , Jiangpeng He , Zhan Ma , Fengqing Zhu

Learned image compression (LIC) is becoming more and more popular these years with its high efficiency and outstanding compression quality. Still, the practicality against modified inputs added with specific noise could not be ignored.…

Image and Video Processing · Electrical Eng. & Systems 2024-03-28 Tianyu Zhu , Heming Sun , Xiankui Xiong , Xuanpeng Zhu , Yong Gong , Minge jing , Yibo Fan

Image compression is one of the most fundamental techniques and commonly used applications in the image and video processing field. Earlier methods built a well-designed pipeline, and efforts were made to improve all modules of the pipeline…

Image and Video Processing · Electrical Eng. & Systems 2021-03-29 Yueyu Hu , Wenhan Yang , Zhan Ma , Jiaying Liu