English
Related papers

Related papers: Leveraging Video Coding Knowledge for Deep Video E…

200 papers

We present a new algorithm for video coding, learned end-to-end for the low-latency mode. In this setting, our approach outperforms all existing video codecs across nearly the entire bitrate range. To our knowledge, this is the first…

Image and Video Processing · Electrical Eng. & Systems 2018-11-20 Oren Rippel , Sanjay Nair , Carissa Lew , Steve Branson , Alexander G. Anderson , Lubomir Bourdev

Recently, foundational diffusion models have attracted considerable attention in image compression tasks, whereas their application to video compression remains largely unexplored. In this article, we introduce DiffVC, a diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Wenzhuo Ma , Zhenzhong Chen

Video Quality Assessment (VQA) is a very challenging task due to its highly subjective nature. Moreover, many factors influence VQA. Compression of video content, while necessary for minimising transmission and storage requirements,…

Composed video retrieval is a challenging task that strives to retrieve a target video based on a query video and a textual description detailing specific modifications. Standard retrieval frameworks typically struggle to handle the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Omkar Thawakar , Dmitry Demidov , Ritesh Thawkar , Rao Muhammad Anwer , Mubarak Shah , Fahad Shahbaz Khan , Salman Khan

Machine learning techniques for more efficient video compression and video enhancement have been developed thanks to breakthroughs in deep learning. The new techniques, considered as an advanced form of Artificial Intelligence (AI), bring…

Image and Video Processing · Electrical Eng. & Systems 2021-05-28 Luka Murn , Marc Gorriz Blanch , Maria Santamaria , Fiona Rivera , Marta Mrak

Learning-based methods have enabled the recovery of a video sequence from a single motion-blurred image or a single coded exposure image. Recovering video from a single motion-blurred image is a very ill-posed problem and the recovered…

Computer Vision and Pattern Recognition · Computer Science 2020-11-16 S Anupama , Prasan Shedligeri , Abhishek Pal , Kaushik Mitra

This paper explores the application of enhancement filtering techniques in neural video compression. Specifically, we categorize these techniques into in-loop contextual filtering and out-of-loop reconstruction enhancement based on whether…

Image and Video Processing · Electrical Eng. & Systems 2025-09-05 Yaojun Wu , Chaoyi Lin , Yiming Wang , Semih Esenlik , Zhaobin Zhang , Kai Zhang , Li Zhang

The recent progress in artificial intelligence has led to an ever-increasing usage of images and videos by machine analysis algorithms, mainly neural networks. Nonetheless, compression, storage and transmission of media have traditionally…

Image and Video Processing · Electrical Eng. & Systems 2024-01-22 Jukka I. Ahonen , Nam Le , Honglei Zhang , Antti Hallapuro , Francesco Cricri , Hamed Rezazadegan Tavakoli , Miska M. Hannuksela , Esa Rahtu

Modern video summarization methods are based on deep neural networks that require a large amount of annotated data for training. However, existing datasets for video summarization are small-scale, easily leading to over-fitting of the deep…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Li Haopeng , Ke Qiuhong , Gong Mingming , Tom Drummond

For any video codecs, the coding efficiency highly relies on whether the current signal to be encoded can find the relevant contexts from the previous reconstructed signals. Traditional codec has verified more contexts bring substantial…

Image and Video Processing · Electrical Eng. & Systems 2023-03-15 Jiahao Li , Bin Li , Yan Lu

Scaling and lossy coding are widely used in video transmission and storage. Previous methods for enhancing the resolution of such videos often ignore the inherent interference between resolution loss and compression artifacts, which…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Dewang Hou , Yang Zhao , Yuyao Ye , Jiayu Yang , Jian Zhang , Ronggang Wang

Video coding technology has been continuously improved for higher compression ratio with higher resolution. However, the state-of-the-art video coding standards, such as H.265/HEVC and Versatile Video Coding, are still designed with the…

Image and Video Processing · Electrical Eng. & Systems 2022-11-22 Daniel Wood

In an adaptive bitrate streaming application, the efficiency of video compression and the encoded video quality depend on both the video codec and the quality metric used to perform encoding optimization. The development of such a quality…

Image and Video Processing · Electrical Eng. & Systems 2024-04-11 Yixu Chen , Zaixi Shang , Hai Wei , Yongjun Wu , Sriram Sethuraman

For decades, video compression technology has been a prominent research area. Traditional hybrid video compression framework and end-to-end frameworks continue to explore various intra- and inter-frame reference and prediction strategies…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Gai Zhang , Xinfeng Zhang , Lv Tang , Yue Li , Kai Zhang , Li Zhang

Existing codecs are designed to eliminate intrinsic redundancies to create a compact representation for compression. However, strong external priors from Multimodal Large Language Models (MLLMs) have not been explicitly explored in video…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Pingping Zhang , Jinlong Li , Kecheng Chen , Meng Wang , Long Xu , Haoliang Li , Nicu Sebe , Sam Kwong , Shiqi Wang

Learned wavelet image and video coding approaches provide an explainable framework with a latent space corresponding to a wavelet decomposition. The wavelet image coder iWave++ achieves state-of-the-art performance and has been employed for…

Image and Video Processing · Electrical Eng. & Systems 2024-11-07 Anna Meyer , Srivatsa Prativadibhayankaram , André Kaup

In 2021, a new track has been initiated in the Challenge for Learned Image Compression~: the video track. This category proposes to explore technologies for the compression of short video clips at 1 Mbit/s. This paper proposes to generate…

Image and Video Processing · Electrical Eng. & Systems 2021-05-21 Théo Ladune , Pierrick Philippe

Recent advances in video compression introduce implicit neural representation (INR) based methods, which effectively capture global dependencies and characteristics of entire video sequences. Unlike traditional and deep learning based…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Lv Tang , Jun Zhu , Xinfeng Zhang , Li Zhang , Siwei Ma , Qingming Huang

Prevalent predictive coding-based video compression methods rely on a heavy encoder to reduce temporal redundancy, which makes it challenging to deploy them on resource-constrained devices. Since the 1970s, distributed source coding theory…

Image and Video Processing · Electrical Eng. & Systems 2023-04-04 Xinjie Zhang , Jiawei Shao , Jun Zhang

With the increasing use of neural network (NN)-based computer vision applications that process image and video data as input, interest has emerged in video compression technology optimized for computer vision tasks. In fact, given the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Hyomin Choi , Heeji Han , Chris Rosewarne , Fabien Racapé