English
Related papers

Related papers: Implicit Neural Representation for Video Restorati…

200 papers

Implicit Neural Representations (INRs) have emerged as a paradigm in knowledge representation, offering exceptional flexibility and performance across a diverse range of applications. INRs leverage multilayer perceptrons (MLPs) to model…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Amer Essakine , Yanqi Cheng , Chun-Wun Cheng , Lipei Zhang , Zhongying Deng , Lei Zhu , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

Video restoration (e.g., video super-resolution) aims to restore high-quality frames from low-quality frames. Different from single image restoration, video restoration generally requires to utilize temporal information from multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Jingyun Liang , Jiezhang Cao , Yuchen Fan , Kai Zhang , Rakesh Ranjan , Yawei Li , Radu Timofte , Luc Van Gool

An implicit neural representation (INR) is a neural network that approximates a spatiotemporal function. Many memory-intensive visualization tasks, including modern 4D CT scanning methods, represent data natively as INRs. While INRs are…

Machine Learning · Computer Science 2025-12-03 Jennifer Zvonek , Andrew Gillette

Neural reconstruction and rendering strategies have demonstrated state-of-the-art performances due, in part, to their ability to preserve high level shape details. Existing approaches, however, either represent objects as implicit surface…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Angtian Wang , Yuanlu Xu , Nikolaos Sarafianos , Robert Maier , Edmond Boyer , Alan Yuille , Tony Tung

Implicit neural representations (INRs) enable fast video compression and effective video processing, but a single model rarely offers scalable decoding across rates and resolutions. In practice, multi-resolution typically relies on…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Mufan Liu , Qi Yang , Miaoran Zhao , He Huang , Le Yang , Zhu Li , Yiling Xu

Great successes have been achieved using deep learning techniques for image super-resolution (SR) with fixed scales. To increase its real world applicability, numerous models have also been proposed to restore SR images with arbitrary scale…

Image and Video Processing · Electrical Eng. & Systems 2022-09-28 Zhihong Pan , Baopu Li , Dongliang He , Wenhao Wu , Errui Ding

Deep Video Quality Assessment (VQA) methods have shown impressive high-performance capabilities. Notably, no-reference (NR) VQA methods play a vital role in situations where obtaining reference videos is restricted or not feasible.…

Image and Video Processing · Electrical Eng. & Systems 2024-07-31 Xiaoheng Tan , Jiabin Zhang , Yuhui Quan , Jing Li , Yajing Wu , Zilin Bian

Reward and representation learning are two long-standing challenges for learning an expanding set of robot manipulation skills from sensory observations. Given the inherent cost and scarcity of in-domain, task-specific robot data, learning…

Robotics · Computer Science 2023-03-08 Yecheng Jason Ma , Shagun Sodhani , Dinesh Jayaraman , Osbert Bastani , Vikash Kumar , Amy Zhang

With the popularity of video applications, the security of video content has emerged as a pressing issue that demands urgent attention. Most video content protection methods mainly rely on encryption technology, which needs to be manually…

Cryptography and Security · Computer Science 2024-08-29 Yangping Lin , Yan Ke , Ke Niu , Jia Liu , Xiaoyuan Yang

Implicit Neural Representations (INRs) have emerged as a powerful alternative to traditional pixel-based formats by modeling images as continuous functions over spatial coordinates. A key challenge, however, lies in the spectral bias of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Sumit Kumar Dam , Mrityunjoy Gain , Eui-Nam Huh , Choong Seon Hong

Accelerating Magnetic Resonance Imaging (MRI) reduces scan time but often degrades image quality. While Implicit Neural Representations (INRs) show promise for MRI reconstruction, they struggle at high acceleration factors due to weak prior…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Ziad Al-Haj Hemidi , Eytan Kats , Mattias P. Heinrich

Decoding remote sensing images to achieve high perceptual quality, particularly at low bitrates, remains a significant challenge. To address this problem, we propose the invertible neural network-based remote sensing image compression…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Junhui Li , Xingsong Hou

Implicit Neural Representations (INRs) encoding continuous multi-media data via multi-layer perceptrons has shown undebatable promise in various computer vision tasks. Despite many successful applications, editing and processing an INR…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Dejia Xu , Peihao Wang , Yifan Jiang , Zhiwen Fan , Zhangyang Wang

High-resolution slice-to-volume reconstruction (SVR) from multiple motion-corrupted low-resolution 2D slices constitutes a critical step in image-based diagnostics of moving subjects, such as fetal brain Magnetic Resonance Imaging (MRI).…

Audio-visual speech recognition (AVSR) has gained remarkable success for ameliorating the noise-robustness of speech recognition. Mainstream methods focus on fusing audio and visual inputs to obtain modality-invariant representations.…

Sound · Computer Science 2023-02-03 Chen Chen , Yuchen Hu , Qiang Zhang , Heqing Zou , Beier Zhu , Eng Siong Chng

Event cameras sense the intensity changes asynchronously and produce event streams with high dynamic range and low latency. This has inspired research endeavors utilizing events to guide the challenging video superresolution (VSR) task. In…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Yunfan Lu , Zipeng Wang , Minjie Liu , Hongjian Wang , Lin Wang

This paper presents a general-purpose video super-resolution (VSR) method, dubbed VSR-HE, specifically designed to enhance the perceptual quality of compressed content. Targeting scenarios characterized by heavy compression, the method…

Image and Video Processing · Electrical Eng. & Systems 2025-06-18 Yuxuan Jiang , Siyue Teng , Qiang Zhu , Chen Feng , Chengxi Zeng , Fan Zhang , Shuyuan Zhu , Bing Zeng , David Bull

To the best of our knowledge, the existing deep-learning-based Video Super-Resolution (VSR) methods exclusively make use of videos produced by the Image Signal Processor (ISP) of the camera system as inputs. Such methods are 1) inherently…

Image and Video Processing · Electrical Eng. & Systems 2021-02-24 Xiaohong Liu , Kangdi Shi , Zhe Wang , Jun Chen

Blind video super-resolution (BVSR) is a low-level vision task which aims to generate high-resolution videos from low-resolution counterparts in unknown degradation scenarios. Existing approaches typically predict blur kernels that are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Qiang Zhu , Yuxuan Jiang , Shuyuan Zhu , Fan Zhang , David Bull , Bing Zeng

The state of the art in video super-resolution (SR) are techniques based on deep learning, but they perform poorly on real-world videos (see Figure 1). The reason is that training image-pairs are commonly created by downscaling a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Noam Elron , Alex Itskovich , Shahar S. Yuval , Noam Levy