English
Related papers

Related papers: Implicit Neural Representation for Video and Image…

200 papers

Video super-resolution (VSR) is the task of restoring high-resolution frames from a sequence of low-resolution inputs. Different from single image super-resolution, VSR can utilize frames' temporal information to reconstruct results with…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Wenyi Lian , Wenjing Lian

Existing methods for spectral reconstruction usually learn a discrete mapping from RGB images to a number of spectral bands. However, this modeling strategy ignores the continuous nature of spectral signature. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Ruikang Xu , Mingde Yao , Chang Chen , Lizhi Wang , Zhiwei Xiong

Implicit Neural Representations (INRs) have emerged in the last few years as a powerful tool to encode continuously a variety of different signals like images, videos, audio and 3D shapes. When applied to 3D shapes, INRs allow to overcome…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Luca De Luigi , Adriano Cardace , Riccardo Spezialetti , Pierluigi Zama Ramirez , Samuele Salti , Luigi Di Stefano

Extracting Implicit Neural Representations (INRs) on video data poses unique challenges due to the additional temporal dimension. In the context of videos, INRs have predominantly relied on a frame-only parameterization, which sacrifices…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Sonam Gupta , Snehal Singh Tomar , Grigorios G Chrysos , Sukhendu Das , A. N. Rajagopalan

Implicit neural representations (INRs) have emerged as a compact and parametric alternative to discrete array-based data representations, encoding information directly in neural network weights to enable resolution-independent…

Machine Learning · Computer Science 2025-09-22 Yuan Ni , Zhantao Chen , Cheng Peng , Rajan Plumley , Chun Hong Yoon , Jana B. Thayer , Joshua J. Turner

Decomposing a video into a layer-based representation is crucial for easy video editing for the creative industries, as it enables independent editing of specific layers. Existing video-layer decomposition models rely on implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Maria Pilligua , Danna Xue , Javier Vazquez-Corral

Implicit Neural Representations (INR) have recently shown to be powerful tool for high-quality video compression. However, existing works are limiting as they do not explicitly exploit the temporal redundancy in videos, leading to a long…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Shishira R Maiya , Sharath Girish , Max Ehrlich , Hanyu Wang , Kwot Sin Lee , Patrick Poirson , Pengxiang Wu , Chen Wang , Abhinav Shrivastava

The many variations of Implicit Neural Representations (INRs), where a neural network is trained as a continuous representation of a signal, have tremendous practical utility for downstream tasks including novel view synthesis, video…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Namitha Padmanabhan , Matthew Gwilliam , Pulkit Kumar , Shishira R Maiya , Max Ehrlich , Abhinav Shrivastava

Implicit neural representations store videos as neural networks and have performed well for various vision tasks such as video compression and denoising. With frame index or positional index as input, implicit representations (NeRV, E-NeRV,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Hao Chen , Matt Gwilliam , Ser-Nam Lim , Abhinav Shrivastava

Limited by imaging systems, the reconstruction of Magnetic Resonance Imaging (MRI) images from partial measurement is essential to medical imaging research. Benefiting from the diverse and complementary information of multi-contrast MR…

Image and Video Processing · Electrical Eng. & Systems 2023-07-11 Jiamiao Zhang , Yichen Chi , Jun Lyu , Wenming Yang , Yapeng Tian

Implicit neural representation (INR) has emerged as a promising solution for encoding volumetric data, offering continuous representations and seamless compatibility with the volume rendering pipeline. However, optimizing an INR network…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Maizhe Yang , Kaiyuan Tang , Chaoli Wang

Cardiac magnetic resonance (CMR) imaging is widely used to characterize cardiac morphology and function. To accelerate CMR imaging, various methods have been proposed to recover high-quality spatiotemporal CMR images from highly…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Xuanyu Tian , Lixuan Chen , Qing Wu , Xiao Wang , Jie Feng , Yuyao Zhang , Hongjiang Wei

Deep learning-based dMRI super-resolution methods can effectively enhance image resolution by leveraging the learning capabilities of neural networks on large datasets. However, these methods tend to learn a fixed scale mapping between…

Image and Video Processing · Electrical Eng. & Systems 2024-08-15 Ruoyou Wu , Jian Cheng , Cheng Li , Juan Zou , Jing Yang , Wenxin Fan , Yong Liang , Shanshan Wang

Positional encodings are employed to capture the high frequency information of the encoded signals in implicit neural representation (INR). In this paper, we propose a novel positional encoding method which improves the reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Bharath Bhushan Damodaran , Francois Schnitzler , Anne Lambert , Pierre Hellier

Implicit neural representations (INRs) have become an important method for encoding various data types, such as 3D objects or scenes, images, and videos. They have proven to be particularly effective at representing 3D content, e.g., 3D…

Machine Learning · Computer Science 2025-01-28 Yushi Guan , Daniel Kwan , Ruofan Liang , Selvakumar Panneer , Nilesh Jain , Nilesh Ahuja , Nandita Vijaykumar

Implicit Neural Representations (INRs) have emerged as a powerful alternative to traditional pixel-based formats by modeling images as continuous functions over spatial coordinates. A key challenge, however, lies in the spectral bias of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Sumit Kumar Dam , Mrityunjoy Gain , Eui-Nam Huh , Choong Seon Hong

Implicit representation of an image can map arbitrary coordinates in the continuous domain to their corresponding color values, presenting a powerful capability for image reconstruction. Nevertheless, existing implicit representation…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Canyu Zhang , Xiaoguang Li , Qing Guo , Song Wang

Implicit neural representation (INR) models signals as continuous functions using neural networks, offering efficient and differentiable optimization for inverse problems across diverse disciplines. However, the representational capacity of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Zhicheng Cai , Hao Zhu , Linsen Chen , Qiu Shen , Xun Cao

Neural representation for video (NeRV), which employs a neural network to parameterize video signals, introduces a novel methodology in video representations. However, existing NeRV-based methods have difficulty in capturing fine spatial…

Image and Video Processing · Electrical Eng. & Systems 2025-01-06 Jina Kim , Jihoo Lee , Je-Won Kang

Implicit Neural Representations (INRs) encode discrete signals in a continuous manner using neural networks, demonstrating significant value across various multimedia applications. However, the vulnerability of INRs presents a critical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Wenyong Zhou , Yuxin Cheng , Zhengwu Liu , Taiqiang Wu , Chen Zhang , Ngai Wong