English
Related papers

Related papers: VideoINR: Learning Video Implicit Neural Represent…

200 papers

Implicit neural representations (INRs) have emerged as a powerful tool for solving inverse problems in computer vision and computational imaging. INRs represent images as continuous domain functions realized by a neural network taking…

Image and Video Processing · Electrical Eng. & Systems 2025-06-12 Mahrokh Najaf , Gregory Ongie

Implicit Neural Representations (INRs) are nowadays used to represent multimedia signals across various real-life applications, including image super-resolution, image compression, or 3D rendering. Existing methods that leverage INRs are…

Machine Learning · Computer Science 2023-06-21 Filip Szatkowski , Karol J. Piczak , Przemysław Spurek , Jacek Tabor , Tomasz Trzciński

Existing digital sensors capture images at fixed spatial and spectral resolutions (e.g., RGB, multispectral, and hyperspectral images), and each combination requires bespoke machine learning models. Neural Implicit Functions partially…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Gengchen Mai , Ni Lao , Weiwei Sun , Yuchi Ma , Jiaming Song , Chenlin Meng , Hongxu Ma , Jinmeng Rao , Ziyuan Li , Stefano Ermon

Hyperspectral image (HSI) super-resolution without additional auxiliary image remains a constant challenge due to its high-dimensional spectral patterns, where learning an effective spatial and spectral representation is a fundamental…

Image and Video Processing · Electrical Eng. & Systems 2021-12-21 Kaiwei Zhang

As a novel video representation method, Neural Representations for Videos (NeRV) has shown great potential in the fields of video compression, video restoration, and video interpolation. In the process of representing videos using NeRV,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Qingling Chang , Haohui Yu , Shuxuan Fu , Zhiqiang Zeng , Chuangquan Chen

Models for image representation learning are typically designed for either recognition or generation. Various forms of contrastive learning help models learn to convert images to embeddings that are useful for classification, detection, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Matthew Gwilliam , Xiao Wang , Xuefeng Hu , Zhenheng Yang

In this paper, we explore the space-time video super-resolution task, which aims to generate a high-resolution (HR) slow-motion video from a low frame rate (LFR), low-resolution (LR) video. A simple solution is to split it into two…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Xiaoyu Xiang , Yapeng Tian , Yulun Zhang , Yun Fu , Jan P. Allebach , Chenliang Xu

Diffusion-based generative models have demonstrated exceptional promise in the video super-resolution (VSR) task, achieving a substantial advancement in detail generation relative to prior methods. However, these approaches face significant…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zhongdao Wang , Guodongfang Zhao , Jingjing Ren , Bailan Feng , Shifeng Zhang , Wenbo Li

Although many video prediction methods have obtained good performance in low-resolution (64$\sim$128) videos, predictive models for high-resolution (512$\sim$4K) videos have not been fully explored yet, which are more meaningful due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Zheng Chang , Xinfeng Zhang , Shanshe Wang , Siwei Ma , Wen Gao

In the field of video compression, the pursuit for better quality at lower bit rates remains a long-lasting goal. Recent developments have demonstrated the potential of Implicit Neural Representation (INR) as a promising alternative to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Daniel Silver , Ron Kimmel

Recent works have shown the ability of Implicit Neural Representations (INR) to carry meaningful representations of signal derivatives. In this work, we leverage this property to perform Video Frame Interpolation (VFI) by explicitly…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Weihao Zhuang , Tristan Hascoet , Ryoichi Takashima , Tetsuya Takiguchi

Implicit Neural Representations (INRs) are increasingly recognized as a versatile data modality for representing discretized signals, offering benefits such as infinite query resolution and reduced storage requirements. Existing signal…

Machine Learning · Computer Science 2025-03-26 Dhananjaya Jayasundara , Sudarshan Rajagopalan , Yasiru Ranasinghe , Trac D. Tran , Vishal M. Patel

Recent work in Deep Learning has re-imagined the representation of data as functions mapping from a coordinate space to an underlying continuous signal. When such functions are approximated by neural networks this introduces a compelling…

Machine Learning · Statistics 2022-08-09 Jonathan Richard Schwarz , Yee Whye Teh

Video super-resolution (VSR) technology excels in reconstructing low-quality video, avoiding unpleasant blur effect caused by interpolation-based algorithms. However, vast computation complexity and memory occupation hampers the edge of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Yanpeng Cao , Chengcheng Wang , Changjun Song , Yongming Tang , He Li

Video Super-Resolution (VSR) aims to recover sequences of high-resolution (HR) frames from low-resolution (LR) frames. Previous methods mainly utilize temporally adjacent frames to assist the reconstruction of target frames. However, in the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Yongjie Chen , Tieru Wu

To the best of our knowledge, the existing deep-learning-based Video Super-Resolution (VSR) methods exclusively make use of videos produced by the Image Signal Processor (ISP) of the camera system as inputs. Such methods are 1) inherently…

Image and Video Processing · Electrical Eng. & Systems 2021-02-24 Xiaohong Liu , Kangdi Shi , Zhe Wang , Jun Chen

Nowadays, there is an explosive growth of screen contents due to the wide application of screen sharing, remote cooperation, and online education. To match the limited terminal bandwidth, high-resolution (HR) screen contents may be…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Jingyu Yang , Sheng Shen , Huanjing Yue , Kun Li

Recently Implicit Neural Representations (INRs) gained attention as a novel and effective representation for various data types. Thus far, prior work mostly focused on optimizing their reconstruction performance. This work investigates INRs…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Yannick Strümpler , Janis Postels , Ren Yang , Luc van Gool , Federico Tombari

Recent years have seen considerable research activities devoted to video enhancement that simultaneously increases temporal frame rate and spatial resolution. However, the existing methods either fail to explore the intrinsic relationship…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Zhihao Shi , Xiaohong Liu , Chengqi Li , Linhui Dai , Jun Chen , Timothy N. Davidson , Jiying Zhao

Implicit Neural Representations (INRs) provide a powerful continuous framework for modeling complex visual and geometric signals, but spectral bias remains a fundamental challenge, limiting their ability to capture high-frequency details.…

Machine Learning · Computer Science 2025-12-01 Yesom Park , Kelvin Kan , Thomas Flynn , Yi Huang , Shinjae Yoo , Stanley Osher , Xihaier Luo