English
Related papers

Related papers: Efficient Sub-pixel Motion Compensation in Learned…

200 papers

Recently, learned video compression has drawn lots of attention and show a rapid development trend with promising results. However, the previous works still suffer from some criticial issues and have a performance gap with traditional…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Yibo Shi , Yunying Ge , Jing Wang , Jue Mao

We present a new algorithm for video coding, learned end-to-end for the low-latency mode. In this setting, our approach outperforms all existing video codecs across nearly the entire bitrate range. To our knowledge, this is the first…

Image and Video Processing · Electrical Eng. & Systems 2018-11-20 Oren Rippel , Sanjay Nair , Carissa Lew , Steve Branson , Alexander G. Anderson , Lubomir Bourdev

Given recent advances in learned video prediction, we investigate whether a simple video codec using a pre-trained deep model for next frame prediction based on previously encoded/decoded frames without sending any motion side information…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Serkan Sulun , A. Murat Tekalp

Plenoptic images and videos bearing rich information demand a tremendous amount of data storage and high transmission cost. While there has been much study on plenoptic image coding, investigations into plenoptic video coding have been very…

Image and Video Processing · Electrical Eng. & Systems 2022-07-04 Thuc Nguyen Huu , Vinh Van Duong , Jonghoon Yim , Byeungwoo Jeon

This paper shows that motion vectors representing the true motion of an object in a scene can be exploited to improve the encoding process of computer generated video sequences. Therefore, a set of sequences is presented for which the true…

Image and Video Processing · Electrical Eng. & Systems 2023-09-14 Christian Herglotz , David Müller , Andreas Weinlich , Frank Bauer , Michael Ortner , Marc Stamminger , André Kaup

Conventional video compression methods employ a linear transform and block motion model, and the steps of motion estimation, mode and quantization parameter selection, and entropy coding are optimized individually due to combinatorial…

Image and Video Processing · Electrical Eng. & Systems 2021-05-28 M. Akin Yilmaz , A. Murat Tekalp

Motion estimation is one of the important procedures in the all video encoders. Most of the complexity of the video coder depends on the complexity of the motion estimation step. The original motion estimation algorithm has a remarkable…

Image and Video Processing · Electrical Eng. & Systems 2018-03-14 Amin Banitalebi , Said Nader-Esfahani , Alireza Nasiri Avanaki

Autoencoder-based image codecs achieve state-of-the-art compression performance but often incur high computational complexity, particularly at decoding time. This work introduces a low-complexity learned image compression framework based on…

Image and Video Processing · Electrical Eng. & Systems 2026-05-14 Théophile Blard , Pierrick Philippe , Théo Ladune , Xiaoran Jiang , Olivier Déforges

Video compression is a critical component of Internet video delivery. Recent work has shown that deep learning techniques can rival or outperform human-designed algorithms, but these methods are significantly less compute and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Mehrdad Khani , Vibhaalakshmi Sivaraman , Mohammad Alizadeh

Conventional video compression (VC) methods are based on motion compensated transform coding, and the steps of motion estimation, mode and quantization parameter selection, and entropy coding are optimized individually due to the…

Image and Video Processing · Electrical Eng. & Systems 2021-12-20 M. Akın Yılmaz , A. Murat Tekalp

We propose a neural image codec at reduced complexity which overfits the decoder parameters to each input image. While autoencoders perform up to a million multiplications per decoded pixel, the proposed approach only requires 2300…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Thomas Leguay , Théo Ladune , Pierrick Philippe , Gordon Clare , Félix Henry

Motion modelling with block-based architecture has been widely used in video coding where a frame is divided into fixed-sized blocks that are motion compensated independently. This often leads to coding inefficiency as fixed-sized blocks…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Priyabrata Karmakar , Manzur Murshed , Manoranjan Paul , David Taubman

Motion estimation is a key component of any modern video codec. Our understanding of motion and the estimation of motion from video has come a very long way since 2000. More than 135 different algorithms have been recently reviewed by…

Image and Video Processing · Electrical Eng. & Systems 2020-07-24 Daniel J. Ringis , Davinder Singh , Francois Pitie , Anil Kokaram

Compression methods based on inpainting are an evolving alternative to classical transform-based codecs for still images. Attempts to apply these ideas to video compression are rare, since reaching real-time performance is very challenging.…

Image and Video Processing · Electrical Eng. & Systems 2021-05-05 Sarah Andris , Pascal Peter , Rahul Mohideen Kaja Mohideen , Joachim Weickert , Sebastian Hoffmann

While learned video codecs have demonstrated great promise, they have yet to achieve sufficient efficiency for practical deployment. In this work, we propose several novel ideas for learned video compression which allow for improved…

Image and Video Processing · Electrical Eng. & Systems 2021-10-06 Oren Rippel , Alexander G. Anderson , Kedar Tatwawadi , Sanjay Nair , Craig Lytle , Lubomir Bourdev

This paper investigates the efficacy of jointly optimizing content-specific post-processing filters to adapt a human oriented video/image codec into a codec suitable for machine vision tasks. By observing that artifacts produced by…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Honglei Zhang , Jukka I. Ahonen , Nam Le , Ruiying Yang , Francesco Cricri

Recent years have witnessed rapid advances in learnt video coding. Most algorithms have solely relied on the vector-based motion representation and resampling (e.g., optical flow based bilinear sampling) for exploiting the inter frame…

Image and Video Processing · Electrical Eng. & Systems 2021-08-29 Haojie Liu , Ming Lu , Zhiqi Chen , Xun Cao , Zhan Ma , Yao Wang

We introduce a practical real-time neural video codec (NVC) designed to deliver high compression ratio, low latency and broad versatility. In practice, the coding speed of NVCs depends on 1) computational costs, and 2) non-computational…

Image and Video Processing · Electrical Eng. & Systems 2025-03-19 Zhaoyang Jia , Bin Li , Jiahao Li , Wenxuan Xie , Linfeng Qi , Houqiang Li , Yan Lu

The end-to-end learning-based video compression has attracted substantial attentions by paving another way to compress video signals as stacked visual features. This paper proposes an efficient end-to-end deep video codec with jointly…

Image and Video Processing · Electrical Eng. & Systems 2022-05-03 Tiesong Zhao , Weize Feng , Hongji Zeng , Yuzhen Niu , Jiaying Liu

Motion compensation is a fundamental technology in video coding to remove the temporal redundancy between video frames. To further improve the coding efficiency, sub-pel motion compensation has been utilized, which requires interpolation of…

Multimedia · Computer Science 2018-03-30 Ning Yan , Dong Liu , Houqiang Li , Feng Wu