English
Related papers

Related papers: Deep Frame Interpolation

200 papers

Image interpolation is a special case of image super-resolution, where the low-resolution image is directly down-sampled from its high-resolution counterpart without blurring and noise. Therefore, assumptions adopted in super-resolution…

Image and Video Processing · Electrical Eng. & Systems 2020-10-28 Junchao Zhang

Observations from ground based telescopes are affected by the presence of the Earth atmosphere, which severely perturbs them. The use of adaptive optics techniques has allowed us to partly beat this limitation. However, image selection or…

Instrumentation and Methods for Astrophysics · Physics 2021-02-17 A. Asensio Ramos , N. Olspert

This paper addresses the problem of interpolating visual textures. We formulate this problem by requiring (1) by-example controllability and (2) realistic and smooth interpolation among an arbitrary number of texture samples. To solve it we…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Ning Yu , Connelly Barnes , Eli Shechtman , Sohrab Amirghodsi , Michal Lukac

Video inpainting aims to fill spatio-temporal "corrupted" regions with plausible content. To achieve this goal, it is necessary to find correspondences from neighbouring frames to faithfully hallucinate the unknown content. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Xueyan Zou , Linjie Yang , Ding Liu , Yong Jae Lee

Lossy compression introduces complex compression artifacts, particularly blocking artifacts, ringing effects and blurring. Existing algorithms either focus on removing blocking artifacts and produce blurred output, or restore sharpened…

Computer Vision and Pattern Recognition · Computer Science 2016-08-10 Ke Yu , Chao Dong , Chen Change Loy , Xiaoou Tang

We propose a novel DNN based framework called the Enhanced Correlation Matching based Video Frame Interpolation Network to support high resolution like 4K, which has a large scale of motion and occlusion. Considering the extensibility of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Sungho Lee , Narae Choi , Woong Il Choi

Although deep convolutional neural network has been proved to efficiently eliminate coding artifacts caused by the coarse quantization of traditional codec, it's difficult to train any neural network in front of the encoder for gradient's…

Computer Vision and Pattern Recognition · Computer Science 2018-01-17 Lijun Zhao , Huihui Bai , Anhong Wang , Yao Zhao

Pixelwise annotation of image sequences can be very tedious for humans. Interactive video object segmentation aims to utilize automatic methods to speed up the process and reduce the workload of the annotators. Most contemporary approaches…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Viktor Varga , András Lőrincz

Video inpainting, which aims at filling in missing regions of a video, remains challenging due to the difficulty of preserving the precise spatial and temporal coherence of video contents. In this work we propose a novel flow-guided video…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Rui Xu , Xiaoxiao Li , Bolei Zhou , Chen Change Loy

Deep convolutional networks have recently achieved great success in video recognition, yet their practical realization remains a challenge due to the large amount of computational resources required to achieve robust recognition. Motivated…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Ximeng Sun , Rameswar Panda , Chun-Fu Chen , Aude Oliva , Rogerio Feris , Kate Saenko

Existing deep learning based image inpainting methods use a standard convolutional network over the corrupted image, using convolutional filter responses conditioned on both valid pixels as well as the substitute values in the masked holes…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Guilin Liu , Fitsum A. Reda , Kevin J. Shih , Ting-Chun Wang , Andrew Tao , Bryan Catanzaro

Deep learning techniques have been successfully applied in many areas of computer vision, including low-level image restoration problems. For image super-resolution, several models based on deep neural networks have been recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2015-10-16 Zhaowen Wang , Ding Liu , Jianchao Yang , Wei Han , Thomas Huang

Face verification and recognition problems have seen rapid progress in recent years, however recognition from small size images remains a challenging task that is inherently intertwined with the task of face super-resolution. Tackling this…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 E. Ustinova , V. Lempitsky

This paper presents a new deformable convolution-based video frame interpolation (VFI) method, using a coarse to fine 3D CNN to enhance the multi-flow prediction. This model first extracts spatio-temporal features at multiple scales using a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Duolikun Danier , Fan Zhang , David Bull

Although deep learning has made significant impact on image/video restoration and super-resolution, learned deinterlacing has so far received less attention in academia or industry. This is despite deinterlacing is well-suited for…

Image and Video Processing · Electrical Eng. & Systems 2024-04-22 Ronglei Ji , A. Murat Tekalp

In this paper, we present a new inpainting framework for recovering missing regions of video frames. Compared with image inpainting, performing this task on video presents new challenges such as how to preserving temporal consistency and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Yifan Ding , Chuan Wang , Haibin Huang , Jiaming Liu , Jue Wang , Liqiang Wang

Video super-resolution (VSR) and frame interpolation (FI) are traditional computer vision problems, and the performance have been improving by incorporating deep learning recently. In this paper, we investigate the problem of jointly…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Jaeyeon Kang , Younghyun Jo , Seoung Wug Oh , Peter Vajda , Seon Joo Kim

Image decomposition is a crucial subject in the field of image processing. It can extract salient features from the source image. We propose a new image decomposition method based on convolutional neural network. This method can be applied…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Yu Fu , Xiao-Jun Wu , Josef Kittler

We present a new data-driven video inpainting method for recovering missing regions of video frames. A novel deep learning architecture is proposed which contains two sub-networks: a temporal structure inference network and a spatial detail…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Chuan Wang , Haibin Huang , Xiaoguang Han , Jue Wang

This paper considers the problem of temporal video interpolation, where the goal is to synthesize a new video frame given its two neighbors. We propose Cross-Video Neural Representation (CURE) as the first video interpolation method based…

Image and Video Processing · Electrical Eng. & Systems 2022-03-02 Wentao Shangguan , Yu Sun , Weijie Gan , Ulugbek S. Kamilov