English
Related papers

Related papers: Towards Practical Real-Time Neural Video Compressi…

200 papers

Neural video compression has emerged as a novel paradigm combining trainable multilayer neural networks and machine learning, achieving competitive rate-distortion (RD) performances, but still remaining impractical due to heavy neural…

Image and Video Processing · Electrical Eng. & Systems 2022-05-16 Zhaocheng Liu , Luis Herranz , Fei Yang , Saiping Zhang , Shuai Wan , Marta Mrak , Marc Górriz Blanch

Volumetric videos, benefiting from immersive 3D realism and interactivity, hold vast potential for various applications, while the tremendous data volume poses significant challenges for compression. Recently, NeRF has demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Zhiyu Zhang , Guo Lu , Huanxiong Liang , Anni Tang , Qiang Hu , Li Song

We propose a novel neural representation for videos (NeRV) which encodes videos in neural networks. Unlike conventional representations that treat videos as frame sequences, we represent videos as neural networks taking frame index as…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Hao Chen , Bo He , Hanyu Wang , Yixuan Ren , Ser-Nam Lim , Abhinav Shrivastava

With the increasing efforts of bringing high-quality virtual reality technologies into the market, efficient 360-degree video compression gains in importance. As such, the state-of-the-art H.266/VVC video coding standard integrates…

Image and Video Processing · Electrical Eng. & Systems 2024-02-19 Andy Regensky , Fabian Brand , André Kaup

The Versatile Video Coding (VVC) standard has been finalized by Joint Video Exploration Team (JVET) in 2020. Compared to the High Efficiency Video Coding (HEVC) standard, VVC offers about 50% compression efficiency gain, in terms of…

Image and Video Processing · Electrical Eng. & Systems 2023-12-19 Yiqun Liu , Mohsen Abdoli , Thomas Guionnet , Christine Guillemot , Aline Roumy

With neural video codecs (NVCs) emerging as promising alternatives for traditional compression methods, it is increasingly important to determine whether existing quality metrics remain valid for evaluating their performance. However, few…

Image and Video Processing · Electrical Eng. & Systems 2026-05-19 Benjamin Herb , Rakesh Rao Ramachandra Rao , Steve Göring , Alexander Raake

With the increasing advancements in video compression efficiency achieved by newer codecs such as HEVC, AV1, and VVC, and intelligent encoding strategies, as well as improved bandwidth availability,there has been a proliferation and…

Multimedia · Computer Science 2022-04-13 Nabajeet Barman , Steven Schmidt , Saman Zadtootaghaj , Maria G Martini

Versatile Video Coding (VVC) allows for large compression efficiency gains over its predecessor, High Efficiency Video Coding (HEVC). The added efficiency comes at the cost of increased runtime complexity, especially for encoding. It is…

The ever-growing multimedia traffic has underscored the importance of effective multimedia codecs. Among them, the up-to-date lossy video coding standard, Versatile Video Coding (VVC), has been attracting attentions of video coding…

Image and Video Processing · Electrical Eng. & Systems 2022-05-10 Tiesong Zhao , Yuhang Huang , Weize Feng , Yiwen Xu , Sam Kwong

The integration of advanced video codecs into the streaming pipeline is growing in response to the increasing demand for high quality video content. However, the significant computational demand for advanced codecs like Versatile Video…

Multimedia · Computer Science 2023-12-14 Yiqun Liu , Hadi Amirpour , Mohsen Abdoli , Christian Timmerer , Thomas Guionnet

Implicit neural representations (INR) has found successful applications across diverse domains. To employ INR in real-life, it is important to speed up training. In the field of INR for video applications, the state-of-the-art approach…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Seungjun Shin , Suji Kim , Dokwan Oh

In response to the growing demand for high-quality videos, Versatile Video Coding (VVC) was released in 2020, building on the hybrid coding architecture of its predecessor, HEVC, achieving about 50% bitrate reduction for the same visual…

Multimedia · Computer Science 2025-03-04 Kamran Qureshi , Hadi Amirpour , Christian Timmerer

In theory, vector quantization (VQ) is always better than scalar quantization (SQ) in terms of rate-distortion (R-D) performance. Recent state-of-the-art methods for neural image compression are mainly based on nonlinear transform coding…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Runsen Feng , Zongyu Guo , Weiping Li , Zhibo Chen

For neural video codec, it is critical, yet challenging, to design an efficient entropy model which can accurately predict the probability distribution of the quantized latent representation. However, most existing video codecs directly use…

Image and Video Processing · Electrical Eng. & Systems 2022-07-14 Jiahao Li , Bin Li , Yan Lu

Digital media is ubiquitous and produced in ever-growing quantities. This necessitates a constant evolution of compression techniques, especially for video, in order to maintain efficient storage and transmission. In this work, we aim at…

Image and Video Processing · Electrical Eng. & Systems 2020-04-29 Jan P. Klopp , Liang-Gee Chen , Shao-Yi Chien

Succinct representation of complex signals using coordinate-based neural representations (CNRs) has seen great progress, and several recent efforts focus on extending them for handling videos. Here, the main challenge is how to (a)…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Subin Kim , Sihyun Yu , Jaeho Lee , Jinwoo Shin

High Efficiency Video Coding (HEVC) has doubled the video compression ratio with equivalent subjective quality as compared to its predecessor H.264/AVC. The significant coding efficiency improvement is attributed to many new techniques.…

Image and Video Processing · Electrical Eng. & Systems 2019-12-04 Yongfei Zhang , Chao Zhang , Rui Fan , Siwei Ma , Zhibo Chen , C. -C. Jay Kuo

Commonly used datasets for evaluating video codecs are all very high quality and not representative of video typically used in video conferencing scenarios. We present the Video Conferencing Dataset (VCD) for evaluating video codecs for…

Image and Video Processing · Electrical Eng. & Systems 2023-11-15 Babak Naderi , Ross Cutler , Nabakumar Singh Khongbantabam , Yasaman Hosseinkashi , Henrik Turbell , Albert Sadovnikov , Quan Zhou

The past decade has witnessed the huge success of deep learning in well-known artificial intelligence applications such as face recognition, autonomous driving, and large language model like ChatGPT. Recently, the application of deep…

Image and Video Processing · Electrical Eng. & Systems 2023-09-15 Yue Li , Junru Li , Chaoyi Lin , Kai Zhang , Li Zhang , Franck Galpin , Thierry Dumas , Hongtao Wang , Muhammed Coban , Jacob Ström , Du Liu , Kenneth Andersson

In this paper, we propose a partition-masked Convolution Neural Network (CNN) to achieve compressed-video enhancement for the state-of-the-art coding standard, High Efficiency Video Coding (HECV). More precisely, our method utilizes the…

Multimedia · Computer Science 2019-12-30 Xiaoyi He , Qiang Hu , Xintong Han , Xiaoyun Zhang , Chongyang Zhang , Weiyao Lin