English
Related papers

Related papers: Neural Video Compression using 2D Gaussian Splatti…

200 papers

Video compression is a critical component of Internet video delivery. Recent work has shown that deep learning techniques can rival or outperform human-designed algorithms, but these methods are significantly less compute and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Mehrdad Khani , Vibhaalakshmi Sivaraman , Mohammad Alizadeh

Neural video codecs have demonstrated great potential in video transmission and storage applications. Existing neural hybrid video coding approaches rely on optical flow or Gaussian-scale flow for prediction, which cannot support…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Zongyu Guo , Runsen Feng , Zhizheng Zhang , Xin Jin , Zhibo Chen

The proliferation of high resolution videos posts great storage and bandwidth pressure on cloud video services, driving the development of next-generation video codecs. Despite great progress made in neural video coding, existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Yueyu Hu , Chenhao Zhang , Onur G. Guleryuz , Debargha Mukherjee , Yao Wang

While feed-forward 3D Gaussian splatting reconstructs renderable Gaussian primitives from sparse context views without per-scene optimization, existing pipelines do not provide a compact scene representation for storage or transmission. A…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Pengpeng Yu , Runqing Jiang , Qi Zhang , Dingquan Li , Jing Wang , Yulan Guo

Video compression has always been a popular research area, where many traditional and deep video compression methods have been proposed. These methods typically rely on signal prediction theory to enhance compression performance by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Lv Tang , Xinfeng Zhang , Gai Zhang , Xiaoqi Ma

Perceptual optimization is widely recognized as essential for neural compression, yet balancing the rate-distortion-perception tradeoff remains challenging. This difficulty is especially pronounced in video compression, where frame-wise…

Image and Video Processing · Electrical Eng. & Systems 2025-10-14 Zongyu Guo , Zhaoyang Jia , Jiahao Li , Xiaoyi Zhang , Bin Li , Yan Lu

Volumetric video represents a transformative advancement in visual media, enabling users to freely navigate immersive virtual experiences and narrowing the gap between digital and real worlds. However, the need for extensive manual…

Graphics · Computer Science 2024-09-16 Yuheng Jiang , Zhehao Shen , Yu Hong , Chengcheng Guo , Yize Wu , Yingliang Zhang , Jingyi Yu , Lan Xu

For any video codecs, the coding efficiency highly relies on whether the current signal to be encoded can find the relevant contexts from the previous reconstructed signals. Traditional codec has verified more contexts bring substantial…

Image and Video Processing · Electrical Eng. & Systems 2023-03-15 Jiahao Li , Bin Li , Yan Lu

Gaussian splatting has emerged as a competitive explicit representation for image and video reconstruction. In this work, we present P-GSVC, the first layered progressive 2D Gaussian splatting framework that provides a unified solution for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Longan Wang , Yuang Shi , Wei Tsang Ooi

The enhanced Deep Hierarchical Video Compression-DHVC 2.0-has been introduced. This single-model neural video codec operates across a broad range of bitrates, delivering not only superior compression performance to representative methods…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Ming Lu , Zhihao Duan , Wuyang Cong , Dandan Ding , Fengqing Zhu , Zhan Ma

Stereoscopic video conferencing is still challenging due to the need to compress stereo RGB-D video in real-time. Though hardware implementations of standard video codecs such as H.264 / AVC and HEVC are widely available, they are not…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yueyu Hu , Onur G. Guleryuz , Philip A. Chou , Danhang Tang , Jonathan Taylor , Rus Maxham , Yao Wang

Given the popularity of 360{\deg} images on social media platforms, 360{\deg} image compression becomes a critical technology for media storage and transmission. Conventional 360{\deg} image compression pipeline projects the spherical image…

Image and Video Processing · Electrical Eng. & Systems 2026-03-25 Jingwei Liao , Bo Chen , Klara Nahrstedt , Zhisheng Yan

Video compression is a fundamental topic in the visual intelligence, bridging visual signal sensing/capturing and high-level visual analytics. The broad success of artificial intelligence (AI) technology has enriched the horizon of video…

Image and Video Processing · Electrical Eng. & Systems 2025-05-01 Chuanmin Jia , Feng Ye , Siwei Ma , Wen Gao , Huifang Sun , Leonardo Chiariglione

Several groups are currently investigating how deep learning may advance the state-of-the-art in image and video coding. An open question is how to make deep neural networks work in conjunction with existing (and upcoming) video codecs,…

Image and Video Processing · Electrical Eng. & Systems 2019-12-17 Eirina Bourtsoulatze , Aaron Chadha , Ilya Fadeev , Vasileios Giotsas , Yiannis Andreopoulos

We present a novel compression framework for 3D Gaussian splatting (3DGS) data that leverages transform coding tools originally developed for point clouds. Contrary to existing 3DGS compression methods, our approach can produce compressed…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Chenjunjie Wang , Shashank N. Sridhara , Eduardo Pavez , Antonio Ortega , Cheng Chang

High-quality novel view synthesis (NVS) from real-world videos is crucial for applications such as cultural heritage preservation, digital twins, and immersive media. However, real-world videos typically contain long sequences with…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Hojun Song , Heejung Choi , Aro Kim , Chae-yeong Song , Gahyeon Kim , Soo Ye Kim , Jaehyup Lee , Sang-hyo Park

Implicit neural representations (INRs) enable fast video compression and effective video processing, but a single model rarely offers scalable decoding across rates and resolutions. In practice, multi-resolution typically relies on…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Mufan Liu , Qi Yang , Miaoran Zhao , He Huang , Le Yang , Zhu Li , Yiling Xu

This study proposes a practical approach for compressing 360-degree equirectangular videos using pretrained neural video compression (NVC) models. Without requiring additional training or changes in the model architectures, the proposed…

Image and Video Processing · Electrical Eng. & Systems 2025-12-24 Daichi Arai , Yuichi Kondo , Kyohei Unno , Yasuko Sugito , Yuichi Kusakabe

Learning-based Neural Video Codecs (NVCs) have emerged as a compelling alternative to standard video codecs, demonstrating promising performance, and simple and easily maintainable pipelines. However, NVCs often fall short of compression…

Image and Video Processing · Electrical Eng. & Systems 2024-12-02 Hyunmo Yang , Seungjun Oh , Eunbyung Park

3D Gaussian Splatting represents a breakthrough in the field of novel view synthesis. It establishes Gaussians as core rendering primitives for highly accurate real-world environment reconstruction. Recent advances have drastically…

Graphics · Computer Science 2025-06-25 Jonathan Haberl , Philipp Fleck , Clemens Arth