English
Related papers

Related papers: Boosting Neural Representations for Videos with a …

200 papers

Existing implicit neural representation (INR) methods do not fully exploit spatiotemporal redundancies in videos. Index-based INRs ignore the content-specific spatial features and hybrid INRs ignore the contextual dependency on adjacent…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Qi Zhao , M. Salman Asif , Zhan Ma

We propose a novel neural representation for videos (NeRV) which encodes videos in neural networks. Unlike conventional representations that treat videos as frame sequences, we represent videos as neural networks taking frame index as…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Hao Chen , Bo He , Hanyu Wang , Yixuan Ren , Ser-Nam Lim , Abhinav Shrivastava

Recently Implicit Neural Representations (INRs) gained attention as a novel and effective representation for various data types. Thus far, prior work mostly focused on optimizing their reconstruction performance. This work investigates INRs…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Yannick Strümpler , Janis Postels , Ren Yang , Luc van Gool , Federico Tombari

Videos typically record the streaming and continuous visual data as discrete consecutive frames. Since the storage cost is expensive for videos of high fidelity, most of them are stored in a relatively low resolution and frame rate. Recent…

Image and Video Processing · Electrical Eng. & Systems 2022-06-10 Zeyuan Chen , Yinbo Chen , Jingwen Liu , Xingqian Xu , Vidit Goel , Zhangyang Wang , Humphrey Shi , Xiaolong Wang

Implicit Neural Networks (INRs) have emerged as powerful representations to encode all forms of data, including images, videos, audios, and scenes. With video, many INRs for video have been proposed for the compression task, and recent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Shishira R Maiya , Anubhav Gupta , Matthew Gwilliam , Max Ehrlich , Abhinav Shrivastava

We present NeRV-Diffusion, an implicit latent video diffusion model that synthesizes videos via generating neural network weights. The generated weights can be rearranged as the parameters of a convolutional neural network, which forms an…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yixuan Ren , Hanyu Wang , Hao Chen , Bo He , Abhinav Shrivastava

Implicit neural representations (INR) has found successful applications across diverse domains. To employ INR in real-life, it is important to speed up training. In the field of INR for video applications, the state-of-the-art approach…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Seungjun Shin , Suji Kim , Dokwan Oh

Neural Representations for Videos(NeRV) have emerged as a promising paradigm for video compression by representing videos as compact neural networks with efficient decoding. Hybrid NeRV methods further improve reconstruction quality through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yunjie Xu , Xiang Feng , Chengkai Wang , Alan Wee-Chung Liew , Xuefei Yin , Yanming Zhu

Implicit Neural Representation (INR) has emerged as an effective method for unsupervised image denoising. However, INR models are typically overparameterized; consequently, these models are prone to overfitting during learning, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Zipei Yan , Zhengji Liu , Jizhou Li

Deep variational autoencoders for image and video compression have gained significant attraction in the recent years, due to their potential to offer competitive or better compression rates compared to the decades long traditional codecs…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Bharath Bhushan Damodaran , Muhammet Balcilar , Franck Galpin , Pierre Hellier

Implicit Neural Representations (INR) have recently shown to be powerful tool for high-quality video compression. However, existing works are limiting as they do not explicitly exploit the temporal redundancy in videos, leading to a long…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Shishira R Maiya , Sharath Girish , Max Ehrlich , Hanyu Wang , Kwot Sin Lee , Patrick Poirson , Pengxiang Wu , Chen Wang , Abhinav Shrivastava

We study how to represent a video with implicit neural representations (INRs). Classical INRs methods generally utilize MLPs to map input coordinates to output pixels. While some recent works have tried to directly reconstruct the whole…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Yunpeng Bai , Chao Dong , Cairong Wang

Video compression has recently benefited from implicit neural representations (INRs), which model videos as continuous functions. INRs offer compact storage and flexible reconstruction, providing a promising alternative to traditional…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jun Zhu , Xinfeng Zhang , Lv Tang , Junhao Jiang , Gai Zhang , Jia Wang

Decomposing a video into a layer-based representation is crucial for easy video editing for the creative industries, as it enables independent editing of specific layers. Existing video-layer decomposition models rely on implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Maria Pilligua , Danna Xue , Javier Vazquez-Corral

We propose a new continuous video modeling framework based on implicit neural representations (INRs) called ActINR. At the core of our approach is the observation that INRs can be considered as a learnable dictionary, with the shapes of the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Alper Kayabasi , Anil Kumar Vadathya , Guha Balakrishnan , Vishwanath Saragadam

Neural Implicit Representation (NIR) has recently gained significant attention due to its remarkable ability to encode complex and high-dimensional data into representation space and easily reconstruct it through a trainable mapping…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Haeyong Kang , Jaehong Yoon , DaHyun Kim , Sung Ju Hwang , Chang D Yoo

Implicit Neural Representations (INRs) have recently demonstrated impressive performance for video compression. However, since a separate INR must be overfit for each video, scaling to high-resolution videos while maintaining encoding…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Namitha Padmanabhan , Matthew Gwilliam , Abhinav Shrivastava

Neural video compression has recently demonstrated significant potential to compete with conventional video codecs in terms of rate-quality performance. These learned video codecs are however associated with various issues related to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Ge Gao , Ho Man Kwan , Fan Zhang , David Bull

As a novel video representation method, Neural Representations for Videos (NeRV) has shown great potential in the fields of video compression, video restoration, and video interpolation. In the process of representing videos using NeRV,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Qingling Chang , Haohui Yu , Shuxuan Fu , Zhiqiang Zeng , Chuangquan Chen

Implicit Neural Representations (INRs) have revolutionized signal processing and computer vision by modeling signals as continuous, differentiable functions parameterized by neural networks. However, INRs are prone to the spectral bias…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Ali Haider , Muhammad Salman Ali , Maryam Qamar , Tahir Khalil , Soo Ye Kim , Jihyong Oh , Enzo Tartaglione , Sung-Ho Bae