English
Related papers

Related papers: Revisiting Temporal Modeling for Video Super-resol…

200 papers

In recent years, Deep Learning has been successfully applied to multimodal learning problems, with the aim of learning useful joint representations in data fusion applications. When the available modalities consist of time series data such…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Xitong Yang , Palghat Ramesh , Radha Chitta , Sriganesh Madhvanath , Edgar A. Bernal , Jiebo Luo

Diffusion models have shown great potential in generating realistic image detail. However, adapting these models to video super-resolution (VSR) remains challenging due to their inherent stochasticity and lack of temporal modeling. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yong Liu , Jinshan Pan , Yinchuan Li , Qingji Dong , Chao Zhu , Yu Guo , Fei Wang

Recent progress in using recurrent neural networks (RNNs) for image description has motivated the exploration of their application for video description. However, while images are static, working with videos requires modeling their dynamic…

Machine Learning · Statistics 2015-10-02 Li Yao , Atousa Torabi , Kyunghyun Cho , Nicolas Ballas , Christopher Pal , Hugo Larochelle , Aaron Courville

In recent years, deep learning has made great progress in many fields such as image recognition, natural language processing, speech recognition and video super-resolution. In this survey, we comprehensively investigate 33 state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Hongying Liu , Zhubo Ruan , Peng Zhao , Chao Dong , Fanhua Shang , Yuanyuan Liu , Linlin Yang , Radu Timofte

A very deep convolutional neural network (CNN) has recently achieved great success for image super-resolution (SR) and offered hierarchical features as well. However, most deep CNN based SR models do not make full use of the hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Yulun Zhang , Yapeng Tian , Yu Kong , Bineng Zhong , Yun Fu

Real-world low-resolution (LR) videos have diverse and complex degradations, imposing great challenges on video super-resolution (VSR) algorithms to reproduce their high-resolution (HR) counterparts with high quality. Recently, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Xi Yang , Chenhang He , Jianqi Ma , Lei Zhang

Image super-resolution (SR) is one of the vital image processing methods that improve the resolution of an image in the field of computer vision. In the last two decades, significant progress has been made in the field of super-resolution,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Syed Muhammad Arsalan Bashir , Yi Wang , Mahrukh Khan , Yilong Niu

Video restoration (e.g., video super-resolution) aims to restore high-quality frames from low-quality frames. Different from single image restoration, video restoration generally requires to utilize temporal information from multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Jingyun Liang , Jiezhang Cao , Yuchen Fan , Kai Zhang , Rakesh Ranjan , Yawei Li , Radu Timofte , Luc Van Gool

Existing video super-resolution (VSR) methods generally adopt a recurrent propagation network to extract spatio-temporal information from the entire video sequences, exhibiting impressive performance. However, the key components in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Hao Li , Jiangxin Dong , Jinshan Pan

With the recent trend for ultra high definition displays, the demand for high quality and efficient video super-resolution (VSR) has become more important than ever. Previous methods adopt complex motion compensation strategies to exploit…

Image and Video Processing · Electrical Eng. & Systems 2019-09-19 Dario Fuoli , Shuhang Gu , Radu Timofte

Most video super-resolution methods super-resolve a single reference frame with the help of neighboring frames in a temporal sliding window. They are less efficient compared to the recurrent-based methods. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Takashi Isobe , Xu Jia , Shuhang Gu , Songjiang Li , Shengjin Wang , Qi Tian

3D super-resolution aims to reconstruct high-fidelity 3D models from low-resolution (LR) multi-view images. Early studies primarily focused on single-image super-resolution (SISR) models to upsample LR images into high-resolution images.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Hyun-kyu Ko , Dongheok Park , Youngin Park , Byeonghyeon Lee , Juhee Han , Eunbyung Park

Space-time video super-resolution (STVSR) is the task of interpolating videos with both Low Frame Rate (LFR) and Low Resolution (LR) to produce High-Frame-Rate (HFR) and also High-Resolution (HR) counterparts. The existing methods based on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhicheng Geng , Luming Liang , Tianyu Ding , Ilya Zharkov

Video super-resolution (VSR) aims to restore a photo-realistic high-resolution (HR) video frame from both its corresponding low-resolution (LR) frame (reference frame) and multiple neighboring frames (supporting frames). Due to varying…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Yapeng Tian , Yulun Zhang , Yun Fu , Chenliang Xu

Video-based person reID is an important task, which has received much attention in recent years due to the increasing demand in surveillance and camera networks. A typical video-based person reID system consists of three parts: an…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 Jiyang Gao , Ram Nevatia

The video super-resolution (VSR) method based on the recurrent convolutional network has strong temporal modeling capability for video sequences. However, the temporal receptive field of different recurrent units in the unidirectional…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Shuyun Wang , Ming Yu , Cuihong Xue , Yingchun Guo , Gang Yan

Designed as extremely deep architectures, deep residual networks which provide a rich visual representation and offer robust convergence behaviors have recently achieved exceptional performance in numerous computer vision problems. Being…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 T. Hoang Ngan Le , Chi Nhan Duong , Ligong Han , Khoa Luu , Marios Savvides , Dipan Pal

Recently, image super-resolution has been widely studied and achieved significant progress by leveraging the power of deep convolutional neural networks. However, there has been limited advancement in video super-resolution (VSR) due to the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Chao Li , Dongliang He , Xiao Liu , Yukang Ding , Shilei Wen

Recurrent models are a popular choice for video enhancement tasks such as video denoising or super-resolution. In this work, we focus on their stability as dynamical systems and show that they tend to fail catastrophically at inference time…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Thomas Tanay , Aivar Sootla , Matteo Maggioni , Puneet K. Dokania , Philip Torr , Ales Leonardis , Gregory Slabaugh

Recent advances in video super-resolution have shown that convolutional neural networks combined with motion compensation are able to merge information from multiple low-resolution (LR) frames to generate high-quality images. Current…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Mehdi S. M. Sajjadi , Raviteja Vemulapalli , Matthew Brown