中文
相关论文

相关论文: Immersive Video Compression using Implicit Neural …

200 篇论文

We introduce a modality-agnostic neural compression algorithm based on a functional view of data and parameterised as an Implicit Neural Representation (INR). Bridging the gap between latent coding and sparsity, we obtain compact latent…

机器学习 · 统计学 2023-04-10 Jonathan Richard Schwarz , Jihoon Tack , Yee Whye Teh , Jaeho Lee , Jinwoo Shin

Almost all digital videos are coded into compact representations before being transmitted. Such compact representations need to be decoded back to pixels before being displayed to humans and - as usual - before being enhanced/analyzed by…

图像与视频处理 · 电气工程与系统科学 2023-11-03 Xihua Sheng , Li Li , Dong Liu , Houqiang Li

For decades, video compression technology has been a prominent research area. Traditional hybrid video compression framework and end-to-end frameworks continue to explore various intra- and inter-frame reference and prediction strategies…

图像与视频处理 · 电气工程与系统科学 2024-10-04 Gai Zhang , Xinfeng Zhang , Lv Tang , Yue Li , Kai Zhang , Li Zhang

Implicit neural video representations encode entire video sequences within the parameters of a neural network and enable constant time frame reconstruction. Recent work on Neural Representations for Videos (NeRV) has demonstrated…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Muhammad Hannan Akhtar , Ihab Amer , Tamer Shanableh

We study how to represent a video with implicit neural representations (INRs). Classical INRs methods generally utilize MLPs to map input coordinates to output pixels. While some recent works have tried to directly reconstruct the whole…

计算机视觉与模式识别 · 计算机科学 2022-08-09 Yunpeng Bai , Chao Dong , Cairong Wang

Implicit Neural Networks (INRs) have emerged as powerful representations to encode all forms of data, including images, videos, audios, and scenes. With video, many INRs for video have been proposed for the compression task, and recent…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Shishira R Maiya , Anubhav Gupta , Matthew Gwilliam , Max Ehrlich , Abhinav Shrivastava

Recently Implicit Neural Representations (INRs) gained attention as a novel and effective representation for various data types. Thus far, prior work mostly focused on optimizing their reconstruction performance. This work investigates INRs…

图像与视频处理 · 电气工程与系统科学 2022-08-05 Yannick Strümpler , Janis Postels , Ren Yang , Luc van Gool , Federico Tombari

Implicit neural representations for videos (NeRV) have shown strong potential for video compression. However, applying NeRV to high-resolution 360-degree videos causes high memory usage and slow decoding, making real-time applications…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Daichi Arai , Kyohei Unno , Yasuko Sugito , Yuichi Kusakabe

Recent deep-learning-based video compression methods brought coding gains over conventional codecs such as AVC and HEVC. However, learning-based codecs generally require considerable computation time and model complexity. In this paper, we…

图像与视频处理 · 电气工程与系统科学 2023-03-22 Hochang Rhee , Seyun Kim , Nam Ik Cho

Existing codecs are designed to eliminate intrinsic redundancies to create a compact representation for compression. However, strong external priors from Multimodal Large Language Models (MLLMs) have not been explicitly explored in video…

计算机视觉与模式识别 · 计算机科学 2025-02-17 Pingping Zhang , Jinlong Li , Kecheng Chen , Meng Wang , Long Xu , Haoliang Li , Nicu Sebe , Sam Kwong , Shiqi Wang

Neural video compression (NVC) technologies have advanced rapidly in recent years, yielding state-of-the-art schemes such as DCVC-RT that offer superior compression efficiency to H.266/VVC and real-time encoding/decoding capabilities.…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Hui Xiang , Yifan Bian , Li Li , Jingran Wu , Xianguo Zhang , Dong Liu

While video compression based on implicit neural representations (INRs) has recently demonstrated great potential, existing INR-based video codecs still cannot achieve state-of-the-art (SOTA) performance compared to their conventional or…

图像与视频处理 · 电气工程与系统科学 2025-03-26 Ge Gao , Siyue Teng , Tianhao Peng , Fan Zhang , David Bull

Decomposing a video into a layer-based representation is crucial for easy video editing for the creative industries, as it enables independent editing of specific layers. Existing video-layer decomposition models rely on implicit neural…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Maria Pilligua , Danna Xue , Javier Vazquez-Corral

While learned video codecs have demonstrated great promise, they have yet to achieve sufficient efficiency for practical deployment. In this work, we propose several novel ideas for learned video compression which allow for improved…

图像与视频处理 · 电气工程与系统科学 2021-10-06 Oren Rippel , Alexander G. Anderson , Kedar Tatwawadi , Sanjay Nair , Craig Lytle , Lubomir Bourdev

While neural lossless image compression has advanced significantly with learned entropy models, lossless video compression remains largely unexplored in the neural setting. We present NeuralLVC, a neural lossless video codec that combines…

图像与视频处理 · 电气工程与系统科学 2026-04-07 Tiberio Uricchio , Marco Bertini

With the popularity of video applications, the security of video content has emerged as a pressing issue that demands urgent attention. Most video content protection methods mainly rely on encryption technology, which needs to be manually…

密码学与安全 · 计算机科学 2024-08-29 Yangping Lin , Yan Ke , Ke Niu , Jia Liu , Xiaoyuan Yang

Implicit Neural Representation (INR) is an innovative approach for representing complex shapes or objects without explicitly defining their geometry or surface structure. Instead, INR represents objects as continuous functions. Previous…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Hanqiu Chen , Hang Yang , Stephen Fitzmeyer , Cong Hao

We present a novel approach for super-resolution that utilizes implicit neural representation (INR) to effectively reconstruct and enhance low-resolution videos and images. By leveraging the capacity of neural networks to implicitly encode…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Mary Aiyetigbo , Wanqi Yuan , Feng Luo , Nianyi Li

Implicit neural representation (INR) has recently emerged as a promising paradigm for signal representations. Typically, INR is parameterized by a multiplayer perceptron (MLP) which takes the coordinates as the inputs and generates…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Zhicheng Cai

Storage and transport of six degrees of freedom (6DoF) dynamic volumetric visual content for immersive applications requires efficient compression. ISO/IEC MPEG has recently been working on a standard that aims to efficiently code and…

图像与视频处理 · 电气工程与系统科学 2022-06-07 Maria Santamaria , Vinod Kumar Malamal Vadakital , Lukasz Kondrad , Antti Hallapuro , Miska M. Hannuksela