English
Related papers

Related papers: MSNeRV: Neural Video Representation with Multi-Sca…

200 papers

As a novel video representation method, Neural Representations for Videos (NeRV) has shown great potential in the fields of video compression, video restoration, and video interpolation. In the process of representing videos using NeRV,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Qingling Chang , Haohui Yu , Shuxuan Fu , Zhiqiang Zeng , Chuangquan Chen

Neural video compression has recently demonstrated significant potential to compete with conventional video codecs in terms of rate-quality performance. These learned video codecs are however associated with various issues related to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Ge Gao , Ho Man Kwan , Fan Zhang , David Bull

Compression and reconstruction of visual data have been widely studied in the computer vision community, even before the popularization of deep learning. More recently, some have used deep learning to improve or refine existing pipelines,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Hao Chen , Matt Gwilliam , Bo He , Ser-Nam Lim , Abhinav Shrivastava

Implicit neural representations (INRs) have emerged as a promising approach for video storage and processing, showing remarkable versatility across various video tasks. However, existing methods often fail to fully leverage their…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Xinjie Zhang , Ren Yang , Dailan He , Xingtong Ge , Tongda Xu , Yan Wang , Hongwei Qin , Jun Zhang

Video compression technology is essential for transmitting and storing videos. Many video compression methods reduce information in videos by removing high-frequency components and utilizing similarities between frames. Alternatively, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Taiga Hayami , Hiroshi Watanabe

Recent works have demonstrated the viability of utilizing over-fitted implicit neural representations (INRs) as alternatives to autoencoder-based models for neural video compression. Among these INR-based video codecs, Neural Video…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Ho Man Kwan , Tianhao Peng , Ge Gao , Fan Zhang , Mike Nilsson , Andrew Gower , David Bull

Videos typically record the streaming and continuous visual data as discrete consecutive frames. Since the storage cost is expensive for videos of high fidelity, most of them are stored in a relatively low resolution and frame rate. Recent…

Image and Video Processing · Electrical Eng. & Systems 2022-06-10 Zeyuan Chen , Yinbo Chen , Jingwen Liu , Xingqian Xu , Vidit Goel , Zhangyang Wang , Humphrey Shi , Xiaolong Wang

We propose a novel neural representation for videos (NeRV) which encodes videos in neural networks. Unlike conventional representations that treat videos as frame sequences, we represent videos as neural networks taking frame index as…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Hao Chen , Bo He , Hanyu Wang , Yixuan Ren , Ser-Nam Lim , Abhinav Shrivastava

Implicit Neural Networks (INRs) have emerged as powerful representations to encode all forms of data, including images, videos, audios, and scenes. With video, many INRs for video have been proposed for the compression task, and recent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Shishira R Maiya , Anubhav Gupta , Matthew Gwilliam , Max Ehrlich , Abhinav Shrivastava

Implicit Neural Representations (INR) have recently shown to be powerful tool for high-quality video compression. However, existing works are limiting as they do not explicitly exploit the temporal redundancy in videos, leading to a long…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Shishira R Maiya , Sharath Girish , Max Ehrlich , Hanyu Wang , Kwot Sin Lee , Patrick Poirson , Pengxiang Wu , Chen Wang , Abhinav Shrivastava

Multi-view videos are becoming widely used in different fields, but their high resolution and multi-camera shooting raise significant challenges for storage and transmission. In this paper, we propose MV-MGINR, a multi-grid implicit neural…

Image and Video Processing · Electrical Eng. & Systems 2025-09-23 Qingyue Ling , Zhengxue Cheng , Donghui Feng , Shen Wang , Chen Zhu , Guo Lu , Heming Sun , Jiro Katto , Li Song

Neural Representations for Videos (NeRV) have simplified the video codec process and achieved swift decoding speeds by encoding video content into a neural network, presenting a promising solution for video compression. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Li Yu , Zhihui Li , Jimin Xiao , Moncef Gabbouj

For decades, video compression technology has been a prominent research area. Traditional hybrid video compression framework and end-to-end frameworks continue to explore various intra- and inter-frame reference and prediction strategies…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Gai Zhang , Xinfeng Zhang , Lv Tang , Yue Li , Kai Zhang , Li Zhang

Implicit neural representations for video (NeRV) have recently become a novel way for high-quality video representation. However, existing works employ a single network to represent the entire video, which implicitly confuse static and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Hao Yan , Zhihui Ke , Xiaobo Zhou , Tie Qiu , Xidong Shi , Dadong Jiang

Neural Representations for Videos(NeRV) have emerged as a promising paradigm for video compression by representing videos as compact neural networks with efficient decoding. Hybrid NeRV methods further improve reconstruction quality through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yunjie Xu , Xiang Feng , Chengkai Wang , Alan Wee-Chung Liew , Xuefei Yin , Yanming Zhu

Despite the abundant availability and content richness for video data, its high-dimensionality poses challenges for video research. Recent advancements have explored the implicit representation for videos using neural networks,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Hao Chen , Saining Xie , Ser-Nam Lim , Abhinav Shrivastava

We present NeRV-Diffusion, an implicit latent video diffusion model that synthesizes videos via generating neural network weights. The generated weights can be rearranged as the parameters of a convolutional neural network, which forms an…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yixuan Ren , Hanyu Wang , Hao Chen , Bo He , Abhinav Shrivastava

Neural representation for video (NeRV), which employs a neural network to parameterize video signals, introduces a novel methodology in video representations. However, existing NeRV-based methods have difficulty in capturing fine spatial…

Image and Video Processing · Electrical Eng. & Systems 2025-01-06 Jina Kim , Jihoo Lee , Je-Won Kang

We present a perceptually-driven video compression framework integrating implicit neural representations (INRs) and pre-trained video diffusion models to address the extremely low bitrate regime (<0.05 bpp). Our approach exploits the…

Image and Video Processing · Electrical Eng. & Systems 2026-04-10 Eren Çetin , Lucas Relic , Yuanyi Xue , Markus Gross , Christopher Schroers , Roberto Azevedo

Generating videos is a complex task that is accomplished by generating a set of temporally coherent images frame-by-frame. This limits the expressivity of videos to only image-based operations on the individual video frames needing network…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Bipasha Sen , Aditya Agarwal , Vinay P Namboodiri , C. V. Jawahar