English
Related papers

Related papers: Deep Space-Time Video Upsampling Networks

200 papers

In recent years, deep learning has made great progress in many fields such as image recognition, natural language processing, speech recognition and video super-resolution. In this survey, we comprehensively investigate 33 state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Hongying Liu , Zhubo Ruan , Peng Zhao , Chao Dong , Fanhua Shang , Yuanyuan Liu , Linlin Yang , Radu Timofte

Video frame interpolation(VFI) has witnessed great progress in recent years. While existing VFI models still struggle to achieve a good trade-off between accuracy and efficiency: fast models often have inferior accuracy; accurate models…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Ban Chen , Xin Jin , Youxin Chen , Longhai Wu , Jie Chen , Jayoon Koo , Cheul-hee Hahm

Video frame interpolation (VFI) aims to improve the temporal resolution of a video sequence. Most of the existing deep learning based VFI methods adopt off-the-shelf optical flow algorithms to estimate the bidirectional flows and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Tao Yang , Peiran Ren , Xuansong Xie , Xiansheng Hua , Lei Zhang

Video frame interpolation (VFI) enables many important applications that might involve the temporal domain, such as slow motion playback, or the spatial domain, such as stop motion sequences. We are focusing on the former task, where one of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Uğur Çoğalan , Mojtaba Bemana , Hans-Peter Seidel , Karol Myszkowski

This paper focuses on increasing the resolution of depth maps obtained from 3D cameras using structured light technology. Two deep learning models FDSR and DKN are modified to work with high-resolution data, and data pre-processing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Martin Melicherčík , Lukáš Gajdošech , Viktor Kocur , Martin Madaras

Recent years have seen considerable research activities devoted to video enhancement that simultaneously increases temporal frame rate and spatial resolution. However, the existing methods either fail to explore the intrinsic relationship…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Zhihao Shi , Xiaohong Liu , Chengqi Li , Linhui Dai , Jun Chen , Timothy N. Davidson , Jiying Zhao

Single image super-resolution (SR) is extremely difficult if the upscaling factors of image pairs are unknown and different from each other, which is common in real image SR. To tackle the difficulty, we develop two multi-scale deep neural…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Shangqi Gao , Xiahai Zhuang

Deep Neural Networks are increasingly used in video frame interpolation tasks such as frame rate changes as well as generating fake face videos. Our project aims to apply recent advances in Deep video interpolation to increase the temporal…

Image and Video Processing · Electrical Eng. & Systems 2020-05-15 Rohit Saha , Abenezer Teklemariam , Ian Hsu , Alan M. Moses

In this paper, we consider the task of space-time video super-resolution (ST-VSR), which can increase the spatial resolution and frame rate for a given video simultaneously. Despite the remarkable progress of recent methods, most of them…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Yuantong Zhang , Huairui Wang , Han Zhu , Zhenzhong Chen

Video super-resolution (VSR) seeks to reconstruct high-resolution frames from low-resolution inputs. While diffusion-based methods have substantially improved perceptual quality, extending them to video remains challenging for two reasons:…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jintong Hu , Bin Chen , Zhenyu Hu , Jiayue Liu , Guo Wang , Lu Qi

We present a deep neural network (DNN) that uses both sensor data (gyroscope) and image content (optical flow) to stabilize videos through unsupervised learning. The network fuses optical flow with real/virtual camera pose histories into a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Zhenmei Shi , Fuhao Shi , Wei-Sheng Lai , Chia-Kai Liang , Yingyu Liang

Recently, image super-resolution has been widely studied and achieved significant progress by leveraging the power of deep convolutional neural networks. However, there has been limited advancement in video super-resolution (VSR) due to the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Chao Li , Dongliang He , Xiao Liu , Yukang Ding , Shilei Wen

Video frame interpolation (VFI) is currently a very active research topic, with applications spanning computer vision, post production and video encoding. VFI can be extremely challenging, particularly in sequences containing large motions,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Duolikun Danier , Fan Zhang , David Bull

Video super-resolution (SR) aims at generating a sequence of high-resolution (HR) frames with plausible and temporally consistent details from their low-resolution (LR) counterparts. The key challenge for video SR lies in the effective…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Longguang Wang , Yulan Guo , Li Liu , Zaiping Lin , Xinpu Deng , Wei An

Video super-resolution (VSR) aiming to reconstruct a high-resolution (HR) video from its low-resolution (LR) counterpart has made tremendous progress in recent years. However, it remains challenging to deploy existing VSR methods to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Ruohao Wang , Xiaohui Liu , Zhilu Zhang , Xiaohe Wu , Chun-Mei Feng , Lei Zhang , Wangmeng Zuo

Video super-resolution (VSR) refers to the reconstruction of high-resolution (HR) video from the corresponding low-resolution (LR) video. Recently, VSR has received increasing attention. In this paper, we propose a novel dual dense…

Image and Video Processing · Electrical Eng. & Systems 2022-03-08 Guofang Li , Yonggui Zhu

Video object detection is a tough task due to the deteriorated quality of video sequences captured under complex environments. Currently, this area is dominated by a series of feature enhancement based methods, which distill beneficial…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Lijian Lin , Haosheng Chen , Honglun Zhang , Jun Liang , Yu Li , Ying Shan , Hanzi Wang

This paper presents a new deformable convolution-based video frame interpolation (VFI) method, using a coarse to fine 3D CNN to enhance the multi-flow prediction. This model first extracts spatio-temporal features at multiple scales using a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Duolikun Danier , Fan Zhang , David Bull

Video frame interpolation (VFI) aims to generate predictive frames by warping learnable motions from the bidirectional historical references. Most existing works utilize spatio-temporal semantic information extractor to realize motion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Meiqin Liu , Chenming Xu , Chao Yao , Chunyu Lin , Yao Zhao

Video inpainting aims to fill spatio-temporal holes with plausible content in a video. Despite tremendous progress of deep neural networks for image inpainting, it is challenging to extend these methods to the video domain due to the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Dahun Kim , Sanghyun Woo , Joon-Young Lee , In So Kweon