English
Related papers

Related papers: Learned Video Compression via Heterogeneous Deform…

200 papers

In neural video codecs, current state-of-the-art methods typically adopt multi-scale motion compensation to handle diverse motions. These methods estimate and compress either optical flow or deformable offsets to reduce inter-frame…

Multimedia · Computer Science 2024-12-03 Yongqi Zhai , Jiayu Yang , Wei Jiang , Chunhui Yang , Luyang Tang , Ronggang Wang

Recent years have witnessed rapid advances in learnt video coding. Most algorithms have solely relied on the vector-based motion representation and resampling (e.g., optical flow based bilinear sampling) for exploiting the inter frame…

Image and Video Processing · Electrical Eng. & Systems 2021-08-29 Haojie Liu , Ming Lu , Zhiqi Chen , Xun Cao , Zhan Ma , Yao Wang

Most existing deep-learning-based single image dynamic scene blind deblurring (SIDSBD) methods usually design deep networks to directly remove the spatially-variant motion blurs from one inputted motion blurred image, without blur kernels…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Shu Tang , Yang Wu , Hongxing Qin , Xianzhong Xie , Shuli Yang , Jing Wang

It has recently been demonstrated that spatial resolution adaptation can be integrated within video compression to improve overall coding performance by spatially down-sampling before encoding and super-resolving at the decoder. Significant…

Image and Video Processing · Electrical Eng. & Systems 2021-01-21 Di Ma , Fan Zhang , David R. Bull

Motion compensation is a key component of video codecs. Conventional codecs (HEVC and VVC) have carefully refined this coding step, with an important focus on sub-pixel motion compensation. On the other hand, learned codecs achieve…

Multimedia · Computer Science 2025-09-24 Théo Ladune , Thomas Leguay , Pierrick Philippe , Gordon Clare , Félix Henry

This paper presents a learned video compression method in response to video compression track of the 6th Challenge on Learned Image Compression (CLIC), at DCC 2024.Specifically, we propose a unified contextual video compression framework…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Jiayu Yang , Wei Jiang , Yongqi Zhai , Chunhui Yang , Ronggang Wang

To enhance image compression performance, recent deep neural network-based research can be divided into three categories: a learnable codec, a postprocessing network, and a compact representation network. The learnable codec has been…

Image and Video Processing · Electrical Eng. & Systems 2021-12-21 Hanbin Son , Taeoh Kim , Hyeongmin Lee , Sangyoun Lee

Recently, learning based video compression methods attract increasing attention. However, the previous works suffer from error propagation due to the accumulation of reconstructed error in inter predictive coding. Meanwhile, the previous…

Image and Video Processing · Electrical Eng. & Systems 2020-03-26 Guo Lu , Chunlei Cai , Xiaoyun Zhang , Li Chen , Wanli Ouyang , Dong Xu , Zhiyong Gao

Disparity compensation represents the primary strategy in stereo video compression (SVC) for exploiting cross-view redundancy. These mechanisms can be broadly categorized into two types: one that employs explicit horizontal shifting, and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Shiyin Jiang , Zhenghao Chen , Minghao Han , Shuhang Gu

In this paper, we propose a partition-masked Convolution Neural Network (CNN) to achieve compressed-video enhancement for the state-of-the-art coding standard, High Efficiency Video Coding (HECV). More precisely, our method utilizes the…

Multimedia · Computer Science 2019-12-30 Xiaoyi He , Qiang Hu , Xintong Han , Xiaoyun Zhang , Chongyang Zhang , Weiyao Lin

We present an approach for high-resolution video frame prediction by conditioning on both past frames and past optical flows. Previous approaches rely on resampling past frames, guided by a learned future optical flow, or on direct…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Fitsum A. Reda , Guilin Liu , Kevin J. Shih , Robert Kirby , Jon Barker , David Tarjan , Andrew Tao , Bryan Catanzaro

Video compression aims to reconstruct seamless frames by encoding the motion and residual information from existing frames. Previous neural video compression methods necessitate distinct codecs for three types of frames (I-frame, P-frame…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Meiqin Liu , Chenming Xu , Yukai Gu , Chao Yao , Yao Zhao

Deep learning-based image compression has made great progresses recently. However, many leading schemes use serial context-adaptive entropy model to improve the rate-distortion (R-D) performance, which is very slow. In addition, the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-07 Haisheng Fu , Feng Liang , Jie Liang , Yongqiang Wang , Guohe Zhang , Jingning Han

Most of the classical denoising methods restore clear results by selecting and averaging pixels in the noisy input. Instead of relying on hand-crafted selecting and averaging strategies, we propose to explicitly learn this process with deep…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Xiangyu Xu , Muchen Li , Wenxiu Sun

Video compression is a fundamental topic in the visual intelligence, bridging visual signal sensing/capturing and high-level visual analytics. The broad success of artificial intelligence (AI) technology has enriched the horizon of video…

Image and Video Processing · Electrical Eng. & Systems 2025-05-01 Chuanmin Jia , Feng Ye , Siwei Ma , Wen Gao , Huifang Sun , Leonardo Chiariglione

Learning-based video compression has been extensively studied over the past years, but it still has limitations in adapting to various motion patterns and entropy models. In this paper, we propose multi-mode video compression (MMVC), a…

Image and Video Processing · Electrical Eng. & Systems 2023-04-06 Bowen Liu , Yu Chen , Rakesh Chowdary Machineni , Shiyu Liu , Hun-Seok Kim

This paper proposes a Perceptual Learned Video Compression (PLVC) approach with recurrent conditional GAN. We employ the recurrent auto-encoder-based compression network as the generator, and most importantly, we propose a recurrent…

Image and Video Processing · Electrical Eng. & Systems 2022-05-03 Ren Yang , Radu Timofte , Luc Van Gool

Recent advances in deep generative modeling have enabled efficient modeling of high dimensional data distributions and opened up a new horizon for solving data compression problems. Specifically, autoencoder based learned image or video…

Machine Learning · Computer Science 2020-04-10 Adam Golinski , Reza Pourreza , Yang Yang , Guillaume Sautiere , Taco S Cohen

In recent years, end-to-end learnt video codecs have demonstrated their potential to compete with conventional coding algorithms in term of compression efficiency. However, most learning-based video compression models are associated with…

Image and Video Processing · Electrical Eng. & Systems 2024-07-02 Tianhao Peng , Ge Gao , Heming Sun , Fan Zhang , David Bull

Recently, learned video compression has achieved exciting performance. Following the traditional hybrid prediction coding framework, most learned methods generally adopt the motion estimation motion compensation (MEMC) method to remove…

Image and Video Processing · Electrical Eng. & Systems 2023-10-20 Yiming Wang , Qian Huang , Bin Tang , Huashan Sun , Xing Li