English
Related papers

Related papers: Real-Time Neural Video Compression with Unified In…

200 papers

Video has become the predominant medium for information dissemination, driving the need for efficient video codecs. Recent advancements in learned video compression have shown promising results, surpassing traditional codecs in terms of…

Multimedia · Computer Science 2023-09-12 Peng-Yu Chen , Wen-Hsiao Peng

Video compression has always been a popular research area, where many traditional and deep video compression methods have been proposed. These methods typically rely on signal prediction theory to enhance compression performance by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Lv Tang , Xinfeng Zhang , Gai Zhang , Xiaoqi Ma

The emergence of Neural Radiance Fields (NeRF) has greatly impacted 3D scene modeling and novel-view synthesis. As a kind of visual media for 3D scene representation, compression with high rate-distortion performance is an eternal target.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Sicheng Li , Hao Li , Yiyi Liao , Lu Yu

In theory, vector quantization (VQ) is always better than scalar quantization (SQ) in terms of rate-distortion (R-D) performance. Recent state-of-the-art methods for neural image compression are mainly based on nonlinear transform coding…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Runsen Feng , Zongyu Guo , Weiping Li , Zhibo Chen

Implicit neural representation (INR) methods for video compression have recently achieved visual quality and compression ratios that are competitive with traditional pipelines. However, due to the need for per-sample network training, the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Matthew Gwilliam , Roy Zhang , Namitha Padmanabhan , Hongyang Du , Abhinav Shrivastava

Contemporary lossy image and video coding standards rely on transform coding, the process through which pixels are mapped to an alternative representation to facilitate efficient data compression. Despite impressive performance of…

Image and Video Processing · Electrical Eng. & Systems 2023-02-21 Lyndon R. Duong , Bohan Li , Cheng Chen , Jingning Han

Over the last few years, neural image compression has gained wide attention from research and industry, yielding promising end-to-end deep neural codecs outperforming their conventional counterparts in rate-distortion performance. Despite…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Ahmed Ghorbel , Wassim Hamidouche , Luce Morin

Video compression is a fundamental topic in the visual intelligence, bridging visual signal sensing/capturing and high-level visual analytics. The broad success of artificial intelligence (AI) technology has enriched the horizon of video…

Image and Video Processing · Electrical Eng. & Systems 2025-05-01 Chuanmin Jia , Feng Ye , Siwei Ma , Wen Gao , Huifang Sun , Leonardo Chiariglione

We propose a novel neural representation for videos (NeRV) which encodes videos in neural networks. Unlike conventional representations that treat videos as frame sequences, we represent videos as neural networks taking frame index as…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Hao Chen , Bo He , Hanyu Wang , Yixuan Ren , Ser-Nam Lim , Abhinav Shrivastava

As the latest video coding standard, versatile video coding (VVC) has shown its ability in retaining pixel quality. To excavate more compression potential for video conference scenarios under ultra-low bitrate, this paper proposes a bitrate…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Anni Tang , Yan Huang , Jun Ling , Zhiyu Zhang , Yiwei Zhang , Rong Xie , Li Song

Prevalent predictive coding-based video compression methods rely on a heavy encoder to reduce temporal redundancy, which makes it challenging to deploy them on resource-constrained devices. Since the 1970s, distributed source coding theory…

Image and Video Processing · Electrical Eng. & Systems 2023-04-04 Xinjie Zhang , Jiawei Shao , Jun Zhang

We present a perceptually-driven video compression framework integrating implicit neural representations (INRs) and pre-trained video diffusion models to address the extremely low bitrate regime (<0.05 bpp). Our approach exploits the…

Image and Video Processing · Electrical Eng. & Systems 2026-04-10 Eren Çetin , Lucas Relic , Yuanyi Xue , Markus Gross , Christopher Schroers , Roberto Azevedo

Recent years have witnessed the significant development of learning-based video compression methods, which aim at optimizing objective or perceptual quality and bit rates. In this paper, we introduce deep video compression with perceptual…

Image and Video Processing · Electrical Eng. & Systems 2021-10-11 Saiping Zhang , Marta Mrak , Luis Herranz , Marc Górriz , Shuai Wan , Fuzheng Yang

Large Vision-Language Models (VLMs) have been extended to understand both images and videos. Visual token compression is leveraged to reduce the considerable token length of visual inputs. To meet the needs of different tasks, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Chenyu Yang , Xuan Dong , Xizhou Zhu , Weijie Su , Jiahao Wang , Hao Tian , Zhe Chen , Wenhai Wang , Lewei Lu , Jifeng Dai

We propose a very simple and efficient video compression framework that only focuses on modeling the conditional entropy between frames. Unlike prior learning-based approaches, we reduce complexity by not performing any form of explicit…

Image and Video Processing · Electrical Eng. & Systems 2020-08-24 Jerry Liu , Shenlong Wang , Wei-Chiu Ma , Meet Shah , Rui Hu , Pranaab Dhawan , Raquel Urtasun

Lossy image and video compression algorithms yield visually annoying artifacts including blocking, blurring, and ringing, especially at low bit-rates. To reduce these artifacts, post-processing techniques have been extensively studied.…

Multimedia · Computer Science 2017-02-21 Yuanying Dai , Dong Liu , Feng Wu

Content-adaptive compression is crucial for enhancing the adaptability of the pre-trained neural codec for various contents. Although these methods have been very practical in neural image compression (NIC), their application in neural…

Image and Video Processing · Electrical Eng. & Systems 2024-09-05 Zhenghao Chen , Luping Zhou , Zhihao Hu , Dong Xu

Local rate control is a key enabler to generalize image and video compression for dedicated challenges, such as video coding for machines. While traditional hybrid video coding can easily adapt the local rate-distortion trade-off by…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Marc Windsheimer , Simon Deniffel , André Kaup

Implicit neural representations (INR) has found successful applications across diverse domains. To employ INR in real-life, it is important to speed up training. In the field of INR for video applications, the state-of-the-art approach…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Seungjun Shin , Suji Kim , Dokwan Oh

Nowadays, real-time video communication over the internet through video conferencing applications has become an invaluable tool in everyone's professional and personal life. This trend underlines the need for video coding algorithms that…

Multimedia · Computer Science 2015-10-05 Stamos Katsigiannis , Georgios Papaioannou , Dimitris Maroulis