English
Related papers

Related papers: Rethinking Alignment in Video Super-Resolution Tra…

200 papers

In this paper, we propose a novel video super-resolution method that aims at generating high-fidelity high-resolution (HR) videos from low-resolution (LR) ones. Previous methods predominantly leverage temporal neighbor frames to assist the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Jiyang Yu , Jingen Liu , Liefeng Bo , Tao Mei

Video super-resolution (VSR) aims at restoring a video in low-resolution (LR) and improving it to higher-resolution (HR). Due to the characteristics of video tasks, it is very important that motion information among frames should be well…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Hongying Liu , Peng Zhao , Zhubo Ruan , Fanhua Shang , Yuanyuan Liu

Although Vision Transformers (ViTs) have recently advanced computer vision tasks significantly, an important real-world problem was overlooked: adapting to variable input resolutions. Typically, images are resized to a fixed resolution,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Wenzhuo Liu , Fei Zhu , Shijie Ma , Cheng-Lin Liu

In this paper, we propose a new Transformer block for video future frames prediction based on an efficient local spatial-temporal separation attention mechanism. Based on this new Transformer block, a fully autoregressive video future…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Xi Ye , Guillaume-Alexandre Bilodeau

The tradeoff between reconstruction quality and compute required for video super-resolution (VSR) remains a formidable challenge in its adoption for deployment on resource-constrained edge devices. While transformer-based VSR models have…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Kavitha Viswanathan , Shashwat Pathak , Piyush Bharambe , Harsh Choudhary , Amit Sethi

Most Video Super-Resolution (VSR) methods enhance a video reference frame by aligning its neighboring frames and mining information on these frames. Recently, deformable alignment has drawn extensive attention in VSR community for its…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Jiayi Lin , Yan Huang , Liang Wang

In real-world video super-resolution (VSR), videos suffer from in-the-wild degradations and artifacts. VSR methods, especially recurrent ones, tend to propagate artifacts over time in the real-world setting and are more vulnerable than…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yuehan Zhang , Angela Yao

To solve the issue of video dehazing, there are two main tasks to attain: how to align adjacent frames to the reference frame; how to restore the reference frame. Some papers adopt explicit approaches (e.g., the Markov random field, optical…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Runde Li

Recent advances in video super-resolution have shown that convolutional neural networks combined with motion compensation are able to merge information from multiple low-resolution (LR) frames to generate high-quality images. Current…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Mehdi S. M. Sajjadi , Raviteja Vemulapalli , Matthew Brown

Video Anomaly Detection (VAD), aiming to identify abnormalities within a specific context and timeframe, is crucial for intelligent Video Surveillance Systems. While recent deep learning-based VAD models have shown promising results by…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Hao Shen , Lu Shi , Wanru Xu , Yigang Cen , Linna Zhang , Gaoyun An

In this paper, we tackle the problem of video alignment, the process of matching the frames of a pair of videos containing similar actions. The main challenge in video alignment is that accurate correspondence should be established despite…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Niloufar Fakhfour , Mohammad ShahverdiKondori , Sajjad Hashembeiki , Mohammadjavad Norouzi , Hoda Mohammadzade

In this paper, we tackle the task of blurry video super-resolution (BVSR), aiming to generate high-resolution (HR) videos from low-resolution (LR) and blurry inputs. Current BVSR methods often fail to restore sharp details at high…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Dachun Kai , Yueyi Zhang , Jin Wang , Zeyu Xiao , Zhiwei Xiong , Xiaoyan Sun

The recent proposal of a new alignment solution for X-ray tomography, Virtual alignment method (VAM) allowed a more accurate method to remove the possible errors that limit the resolution and clarity of the reconstructed image. In the field…

Image and Video Processing · Electrical Eng. & Systems 2020-10-28 Kyungtaek Jun , Seokhwan Yoon , Jae-Hong Lim , SeungJoon Noh

Video restoration tasks, including super-resolution, deblurring, etc, are drawing increasing attention in the computer vision community. A challenging benchmark named REDS is released in the NTIRE19 Challenge. This new benchmark challenges…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Xintao Wang , Kelvin C. K. Chan , Ke Yu , Chao Dong , Chen Change Loy

The success of existing video super-resolution (VSR) algorithms stems mainly exploiting the temporal information from the neighboring frames. However, none of these methods have discussed the influence of the temporal redundancy in the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Yuhao Huang , Hang Dong , Jinshan Pan , Chao Zhu , Yu Guo , Ding Liu , Lean Fu , Fei Wang

Built on top of self-attention mechanisms, vision transformers have demonstrated remarkable performance on a variety of vision tasks recently. While achieving excellent performance, they still require relatively intensive computational cost…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Lingchen Meng , Hengduo Li , Bor-Chun Chen , Shiyi Lan , Zuxuan Wu , Yu-Gang Jiang , Ser-Nam Lim

Multi-image super-resolution (MISR) can achieve higher image quality than single-image super-resolution (SISR) by aggregating sub-pixel information from multiple spatially shifted frames. Among MISR tasks, burst super-resolution (BurstSR)…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Tengda Huang , Yu Zhang , Tianren Li , Yufu Qu , Fulin Liu , Zhenzhong Wei

Although deep learning has made significant impact on image/video restoration and super-resolution, learned deinterlacing has so far received less attention in academia or industry. This is despite deinterlacing is well-suited for…

Image and Video Processing · Electrical Eng. & Systems 2024-04-22 Ronglei Ji , A. Murat Tekalp

The transformer architectures, based on self-attention mechanism and convolution-free design, recently found superior performance and booming applications in computer vision. However, the discontinuous patch-wise tokenization process…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Shengju Qian , Hao Shao , Yi Zhu , Mu Li , Jiaya Jia

The primary challenge in video super-resolution (VSR) is to handle large motions in the input frames, which makes it difficult to accurately aggregate information from multiple frames. Existing works either adopt deformable convolutions or…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Zhihe Lu , Zeyu Xiao , Jiawang Bai , Zhiwei Xiong , Xinchao Wang