English
Related papers

Related papers: You Only Align Once: Bidirectional Interaction for…

200 papers

High-spatio-temporal resolution (HSTR) video recording plays a crucial role in enhancing various imagery tasks that require fine-detailed information. State-of-the-art cameras provide this required high frame-rate and high spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 H. Umut Suluhan , Abdullah Enes Doruk , Hasan F. Ates , Bahadir K. Gunturk

Temporal modeling is crucial for video super-resolution. Most of the video super-resolution methods adopt the optical flow or deformable convolution for explicitly motion compensation. However, such temporal modeling techniques increase the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Takashi Isobe , Xu Jia , Xin Tao , Changlin Li , Ruihuang Li , Yongjie Shi , Jing Mu , Huchuan Lu , Yu-Wing Tai

Videos typically record the streaming and continuous visual data as discrete consecutive frames. Since the storage cost is expensive for videos of high fidelity, most of them are stored in a relatively low resolution and frame rate. Recent…

Image and Video Processing · Electrical Eng. & Systems 2022-06-10 Zeyuan Chen , Yinbo Chen , Jingwen Liu , Xingqian Xu , Vidit Goel , Zhangyang Wang , Humphrey Shi , Xiaolong Wang

This paper explores an efficient solution for Space-time Super-Resolution, aiming to generate High-resolution Slow-motion videos from Low Resolution and Low Frame rate videos. A simplistic solution is the sequential running of Video Super…

Image and Video Processing · Electrical Eng. & Systems 2021-06-09 Saikat Dutta , Nisarg A. Shah , Anurag Mittal

Video super-resolution (VSR), with the aim to restore a high-resolution video from its corresponding low-resolution version, is a spatial-temporal sequence prediction problem. Recently, Transformer has been gaining popularity due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jiezhang Cao , Yawei Li , Kai Zhang , Luc Van Gool

Recent advances in video super-resolution have shown that convolutional neural networks combined with motion compensation are able to merge information from multiple low-resolution (LR) frames to generate high-quality images. Current…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Mehdi S. M. Sajjadi , Raviteja Vemulapalli , Matthew Brown

Different from the Single Image Super-Resolution(SISR) task, the key for Video Super-Resolution(VSR) task is to make full use of complementary information across frames to reconstruct the high-resolution sequence. Since images from…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Lielin Jiang , Na Wang , Qingqing Dang , Rui Liu , Baohua Lai

Event cameras sense the intensity changes asynchronously and produce event streams with high dynamic range and low latency. This has inspired research endeavors utilizing events to guide the challenging video superresolution (VSR) task. In…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Yunfan Lu , Zipeng Wang , Minjie Liu , Hongjian Wang , Lin Wang

Effective aggregation of temporal information of consecutive frames is the core of achieving video super-resolution. Many scholars have utilized structures such as sliding windows and recurrent to gather spatio-temporal information of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Yonggui Zhu , Guofang Li

Space-time video super-resolution (STVSR) aims to increase the spatial and temporal resolutions of low-resolution and low-frame-rate videos. Recently, deformable convolution based methods have achieved promising STVSR performance, but they…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Gang Xu , Jun Xu , Zhen Li , Liang Wang , Xing Sun , Ming-Ming Cheng

Modern one-stage video instance segmentation networks suffer from two limitations. First, convolutional features are neither aligned with anchor boxes nor with ground-truth bounding boxes, reducing the mask sensitivity to spatial location.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Minghan Li , Shuai Li , Lida Li , Lei Zhang

Arbitrary-scale video super-resolution (AVSR) aims to enhance the resolution of video frames, potentially at various scaling factors, which presents several challenges regarding spatial detail reproduction, temporal consistency, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Wei Shang , Dongwei Ren , Wanying Zhang , Yuming Fang , Wangmeng Zuo , Kede Ma

Generative deep learning has sparked a new wave of Super-Resolution (SR) algorithms that enhance single images with impressive aesthetic results, albeit with imaginary details. Multi-frame Super-Resolution (MFSR) offers a more grounded…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Michel Deudon , Alfredo Kalaitzis , Israel Goytom , Md Rifat Arefin , Zhichao Lin , Kris Sankaran , Vincent Michalski , Samira E. Kahou , Julien Cornebise , Yoshua Bengio

Recently, deep learning based video super-resolution (SR) methods have achieved promising performance. To simultaneously exploit the spatial and temporal information of videos, employing 3-dimensional (3D) convolutions is a natural…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Sheng Li , Fengxiang He , Bo Du , Lefei Zhang , Yonghao Xu , Dacheng Tao

Video super-resolution (VSR) aims to reconstruct a high-resolution (HR) video from a low-resolution (LR) counterpart. Achieving successful VSR requires producing realistic HR details and ensuring both spatial and temporal consistency. To…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Janghyeok Han , Gyujin Sim , Geonung Kim , Hyun-seung Lee , Kyuha Choi , Youngseok Han , Sunghyun Cho

While prior methods in Continuous Spatial-Temporal Video Super-Resolution (C-STVSR) employ Implicit Neural Representation (INR) for continuous encoding, they often struggle to capture the complexity of video data, relying on simple…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Eunjin Kim , Hyeonjin Kim , Kyong Hwan Jin , Jaejun Yoo

We consider the problem of space-time super-resolution (ST-SR): increasing spatial resolution of video frames and simultaneously interpolating frames to increase the frame rate. Modern approaches handle these axes one at a time. In…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Muhammad Haris , Greg Shakhnarovich , Norimichi Ukita

Wide area surveillance has many applications and tracking of objects under observation is an important task, which often needs high spatio-temporal resolution (HSTR) video for better precision. This paper presents the usage of multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 H. Umut Suluhan , Hasan F. Ates , Bahadir K. Gunturk

Diffusion models have significantly advanced video super-resolution (VSR) by enhancing perceptual quality, largely through elaborately designed temporal modeling to ensure inter-frame consistency. However, existing methods usually suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Xijun Wang , Xin Li , Bingchen Li , Zhibo Chen

In this paper, we address the problem of enhancing perceptual quality in video super-resolution (VSR) using Diffusion Models (DMs) while ensuring temporal consistency among frames. We present StableVSR, a VSR method based on DMs that can…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Claudio Rota , Marco Buzzelli , Joost van de Weijer