English
Related papers

Related papers: How to Design and Train Your Implicit Neural Repre…

200 papers

Videos typically record the streaming and continuous visual data as discrete consecutive frames. Since the storage cost is expensive for videos of high fidelity, most of them are stored in a relatively low resolution and frame rate. Recent…

Image and Video Processing · Electrical Eng. & Systems 2022-06-10 Zeyuan Chen , Yinbo Chen , Jingwen Liu , Xingqian Xu , Vidit Goel , Zhangyang Wang , Humphrey Shi , Xiaolong Wang

Neural Video Representation~(NVR) is a promising paradigm for video compression, showing great potential in improving video storage and transmission efficiency. While recent advances have made efforts in architectural refinements to improve…

Image and Video Processing · Electrical Eng. & Systems 2025-11-17 Ziyi Li , Qingyu Mao , Shuai Liu , Qilei Li , Fanyang Meng , Yongsheng Liang

High-resolution (HR) videos play a crucial role in many computer vision applications. Although existing video restoration (VR) methods can significantly enhance video quality by exploiting temporal information across video frames, they are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Mary Aiyetigbo , Wanqi Yuan , Feng Luo , Nianyi Li

We present a perceptually-driven video compression framework integrating implicit neural representations (INRs) and pre-trained video diffusion models to address the extremely low bitrate regime (<0.05 bpp). Our approach exploits the…

Image and Video Processing · Electrical Eng. & Systems 2026-04-10 Eren Çetin , Lucas Relic , Yuanyi Xue , Markus Gross , Christopher Schroers , Roberto Azevedo

Deep variational autoencoders for image and video compression have gained significant attraction in the recent years, due to their potential to offer competitive or better compression rates compared to the decades long traditional codecs…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Bharath Bhushan Damodaran , Muhammet Balcilar , Franck Galpin , Pierre Hellier

Existing AI-based point cloud compression methods struggle with dependence on specific training data distributions, which limits their real-world deployment. Implicit Neural Representation (INR) methods solve the above problem by encoding…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Wenjie Huang , Qi Yang , Shuting Xia , He Huang , Zhu Li , Yiling Xu

Neural representation for video (NeRV), which employs a neural network to parameterize video signals, introduces a novel methodology in video representations. However, existing NeRV-based methods have difficulty in capturing fine spatial…

Image and Video Processing · Electrical Eng. & Systems 2025-01-06 Jina Kim , Jihoo Lee , Je-Won Kang

Implicit neural representation (INR) has emerged as a promising solution for encoding volumetric data, offering continuous representations and seamless compatibility with the volume rendering pipeline. However, optimizing an INR network…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Maizhe Yang , Kaiyuan Tang , Chaoli Wang

Recent works in spatiotemporal radiance fields can produce photorealistic free-viewpoint videos. However, they are inherently unsuitable for interactive streaming scenarios (e.g. video conferencing, telepresence) because have an inevitable…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Shengze Wang , Alexey Supikov , Joshua Ratcliff , Henry Fuchs , Ronald Azuma

Generating videos is a complex task that is accomplished by generating a set of temporally coherent images frame-by-frame. This limits the expressivity of videos to only image-based operations on the individual video frames needing network…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Bipasha Sen , Aditya Agarwal , Vinay P Namboodiri , C. V. Jawahar

Recently, the image-wise implicit neural representation of videos, NeRV, has gained popularity for its promising results and swift speed compared to regular pixel-wise implicit representations. However, the redundant parameters within the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Zizhang Li , Mengmeng Wang , Huaijin Pi , Kechun Xu , Jianbiao Mei , Yong Liu

Decomposing a video into a layer-based representation is crucial for easy video editing for the creative industries, as it enables independent editing of specific layers. Existing video-layer decomposition models rely on implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Maria Pilligua , Danna Xue , Javier Vazquez-Corral

With the increasing consumption of 3D displays and virtual reality, multi-view video has become a promising format. However, its high resolution and multi-camera shooting result in a substantial increase in data volume, making storage and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Chen Zhu , Guo Lu , Bing He , Rong Xie , Li Song

Recently, Implicit Neural Representations (INRs) parameterized by neural networks have emerged as a powerful and promising tool to represent different kinds of signals due to its continuous, differentiable properties, showing superiorities…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Wentao Yuan , Qingtian Zhu , Xiangyue Liu , Yikang Ding , Haotian Zhang , Chi Zhang

Succinct representation of complex signals using coordinate-based neural representations (CNRs) has seen great progress, and several recent efforts focus on extending them for handling videos. Here, the main challenge is how to (a)…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Subin Kim , Sihyun Yu , Jaeho Lee , Jinwoo Shin

We introduce a modality-agnostic neural compression algorithm based on a functional view of data and parameterised as an Implicit Neural Representation (INR). Bridging the gap between latent coding and sparsity, we obtain compact latent…

Machine Learning · Statistics 2023-04-10 Jonathan Richard Schwarz , Jihoon Tack , Yee Whye Teh , Jaeho Lee , Jinwoo Shin

Implicit Neural Representations (INRs) have demonstrated significant potential in video compression by representing videos as neural networks. However, as the number of frames increases, the memory consumption for training and inference…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Jia Wang , Xinfeng Zhang , Gai Zhang , Jun Zhu , Lv Tang , Li Zhang

The storage of medical images is one of the challenges in the medical imaging field. There are variable works that use implicit neural representation (INR) to compress volumetric medical images. However, there is room to improve the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-14 Armin Sheibanifard , Hongchuan Yu

Implicit Neural Representations (INRs) aim to parameterize discrete signals through implicit continuous functions. However, formulating each image with a separate neural network~(typically, a Multi-Layer Perceptron (MLP)) leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Wenyong Zhou , Taiqiang Wu , Zhengwu Liu , Yuxin Cheng , Chen Zhang , Ngai Wong

Neural Representations for Videos (NeRV) have simplified the video codec process and achieved swift decoding speeds by encoding video content into a neural network, presenting a promising solution for video compression. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Li Yu , Zhihui Li , Jimin Xiao , Moncef Gabbouj