English
Related papers

Related papers: Is There Tradeoff between Spatial and Temporal in …

200 papers

The target of space-time video super-resolution (STVSR) is to increase both the frame rate (also referred to as the temporal resolution) and the spatial resolution of a given video. Recent approaches solve STVSR using end-to-end deep neural…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Zijie Yue , Miaojing Shi

Temporal modeling is crucial for video super-resolution. Most of the video super-resolution methods adopt the optical flow or deformable convolution for explicitly motion compensation. However, such temporal modeling techniques increase the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Takashi Isobe , Xu Jia , Xin Tao , Changlin Li , Ruihuang Li , Yongjie Shi , Jing Mu , Huchuan Lu , Yu-Wing Tai

Video super-resolution plays an important role in surveillance video analysis and ultra-high-definition video display, which has drawn much attention in both the research and industrial communities. Although many deep learning-based VSR…

Image and Video Processing · Electrical Eng. & Systems 2020-08-21 Takashi Isobe , Fang Zhu , Xu Jia , Shengjin Wang

Convolutional neural networks have enabled accurate image super-resolution in real-time. However, recent attempts to benefit from temporal correlations in video super-resolution have been limited to naive or inefficient architectures. In…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Jose Caballero , Christian Ledig , Andrew Aitken , Alejandro Acosta , Johannes Totz , Zehan Wang , Wenzhe Shi

Deep learning-based blind super-resolution (SR) methods have recently achieved unprecedented performance in upscaling frames with unknown degradation. These models are able to accurately estimate the unknown downscaling kernel from a given…

Image and Video Processing · Electrical Eng. & Systems 2021-08-20 Lichuan Xiang , Royson Lee , Mohamed S. Abdelfattah , Nicholas D. Lane , Hongkai Wen

Recent years have seen considerable research activities devoted to video enhancement that simultaneously increases temporal frame rate and spatial resolution. However, the existing methods either fail to explore the intrinsic relationship…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Zhihao Shi , Xiaohong Liu , Chengqi Li , Linhui Dai , Jun Chen , Timothy N. Davidson , Jiying Zhao

We consider the problem of space-time super-resolution (ST-SR): increasing spatial resolution of video frames and simultaneously interpolating frames to increase the frame rate. Modern approaches handle these axes one at a time. In…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Muhammad Haris , Greg Shakhnarovich , Norimichi Ukita

Video super-resolution (VSR) is a task that aims to reconstruct high-resolution (HR) frames from the low-resolution (LR) reference frame and multiple neighboring frames. The vital operation is to utilize the relative misaligned frames for…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Meiqin Liu , Shuo Jin , Chao Yao , Chunyu Lin , Yao Zhao

In video super-resolution, the spatio-temporal coherence between, and among the frames must be exploited appropriately for accurate prediction of the high resolution frames. Although 2D convolutional neural networks (CNNs) are powerful in…

Computer Vision and Pattern Recognition · Computer Science 2019-06-21 Soo Ye Kim , Jeongyeon Lim , Taeyoung Na , Munchurl Kim

Recent advances in video super-resolution have shown that convolutional neural networks combined with motion compensation are able to merge information from multiple low-resolution (LR) frames to generate high-quality images. Current…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Mehdi S. M. Sajjadi , Raviteja Vemulapalli , Matthew Brown

Video super-resolution aims at generating a high-resolution video from its low-resolution counterpart. With the rapid rise of deep learning, many recently proposed video super-resolution methods use convolutional neural networks in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Xiaohong Liu , Lingshi Kong , Yang Zhou , Jiying Zhao , Jun Chen

The state of the art in video super-resolution (SR) are techniques based on deep learning, but they perform poorly on real-world videos (see Figure 1). The reason is that training image-pairs are commonly created by downscaling a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Noam Elron , Alex Itskovich , Shahar S. Yuval , Noam Levy

Space-time video super-resolution (STVSR) is the task of interpolating videos with both Low Frame Rate (LFR) and Low Resolution (LR) to produce High-Frame-Rate (HFR) and also High-Resolution (HR) counterparts. The existing methods based on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhicheng Geng , Luming Liang , Tianyu Ding , Ilya Zharkov

Video action recognition has made significant strides, but challenges remain in effectively using both spatial and temporal information. While existing methods often focus on either spatial features (e.g., object appearance) or temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Huilin Chen , Lei Wang , Yifan Chen , Tom Gedeon , Piotr Koniusz

When a very fast dynamic event is recorded with a low-framerate camera, the resulting video suffers from severe motion blur (due to exposure time) and motion aliasing (due to low sampling rate in time). True Temporal Super-Resolution (TSR)…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Liad Pollak Zuckerman , Eyal Naor , George Pisha , Shai Bagon , Michal Irani

Super-resolution (SR) has been widely used to convert low-resolution legacy videos to high-resolution (HR) ones, to suit the increasing resolution of displays (e.g. UHD TVs). However, it becomes easier for humans to notice motion artifacts…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Soo Ye Kim , Jihyong Oh , Munchurl Kim

Spatial-Temporal Video Super-Resolution (ST-VSR) aims to generate super-resolved videos with higher resolution(HR) and higher frame rate (HFR). Quite intuitively, pioneering two-stage based methods complete ST-VSR by directly combining two…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Mengshun Hu , Kui Jiang , Liang Liao , Jing Xiao , Junjun Jiang , Zheng Wang

Video super-resolution, which aims at producing a high-resolution video from its corresponding low-resolution version, has recently drawn increasing attention. In this work, we propose a novel method that can effectively incorporate…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Takashi Isobe , Songjiang Li , Xu Jia , Shanxin Yuan , Gregory Slabaugh , Chunjing Xu , Ya-Li Li , Shengjin Wang , Qi Tian

Video colorization is a challenging and highly ill-posed problem. Although recent years have witnessed remarkable progress in single image colorization, there is relatively less research effort on video colorization and existing methods…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yihao Liu , Hengyuan Zhao , Kelvin C. K. Chan , Xintao Wang , Chen Change Loy , Yu Qiao , Chao Dong

In this paper, we explore the space-time video super-resolution task, which aims to generate a high-resolution (HR) slow-motion video from a low frame rate (LFR), low-resolution (LR) video. A simple solution is to split it into two…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Xiaoyu Xiang , Yapeng Tian , Yulun Zhang , Yun Fu , Jan P. Allebach , Chenliang Xu
‹ Prev 1 2 3 10 Next ›