English
Related papers

Related papers: Texture-aware Video Frame Interpolation

200 papers

Video frame interpolation, which aims to synthesize non-exist intermediate frames in a video sequence, is an important research topic in computer vision. Existing video frame interpolation methods have achieved remarkable results under…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Youjian Zhang , Chaoyue Wang , Dacheng Tao

Research on video frame interpolation has made significant progress in recent years. However, existing methods mostly use off-the-shelf metrics to measure the quality of interpolation results with the exception of a few methods that employ…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Qiqi Hou , Abhijay Ghildyal , Feng Liu

Video frame interpolation is a challenging problem because there are different scenarios for each video depending on the variety of foreground and background motion, frame rate, and occlusion. It is therefore difficult for a single network…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Myungsub Choi , Janghoon Choi , Sungyong Baik , Tae Hyun Kim , Kyoung Mu Lee

Video frame interpolation has been actively studied with the development of convolutional neural networks. However, due to the intrinsic limitations of kernel weight sharing in convolution, the interpolated frame generated by it may lose…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Pan Gao , Haoyue Tian , Jie Qin

Video frame interpolation typically involves two steps: motion estimation and pixel synthesis. Such a two-step approach heavily depends on the quality of motion estimation. This paper presents a robust video frame interpolation method that…

Computer Vision and Pattern Recognition · Computer Science 2017-03-23 Simon Niklaus , Long Mai , Feng Liu

Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be roughly divided…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Zhihao Shi , Xiaohong Liu , Kangdi Shi , Linhui Dai , Jun Chen

Video prediction is an extrapolation task that predicts future frames given past frames, and video frame interpolation is an interpolation task that estimates intermediate frames between two frames. We have witnessed the tremendous…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Yue Wu , Qiang Wen , Qifeng Chen

Existing methods for video interpolation heavily rely on deep convolution neural networks, and thus suffer from their intrinsic limitations, such as content-agnostic kernel weights and restricted receptive field. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhihao Shi , Xiangyu Xu , Xiaohong Liu , Jun Chen , Ming-Hsuan Yang

Video interpolation is an important problem in computer vision, which helps overcome the temporal limitation of camera sensors. Existing video interpolation methods usually assume uniform motion between consecutive frames and use linear…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Xiangyu Xu , Li Siyao , Wenxiu Sun , Qian Yin , Ming-Hsuan Yang

Recent advances in high refresh rate displays as well as the increased interest in high rate of slow motion and frame up-conversion fuel the demand for efficient and cost-effective multi-frame video interpolation solutions. To that regard,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Zhixiang Chi , Rasoul Mohammadi Nasiri , Zheng Liu , Juwei Lu , Jin Tang , Konstantinos N Plataniotis

Frame interpolation is an essential video processing technique that adjusts the temporal resolution of an image sequence. While deep learning has brought great improvements to the area of video frame interpolation, techniques that make use…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Simon Niklaus , Ping Hu , Jiawen Chen

This paper addresses the problem of interpolating visual textures. We formulate this problem by requiring (1) by-example controllability and (2) realistic and smooth interpolation among an arbitrary number of texture samples. To solve it we…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Ning Yu , Connelly Barnes , Eli Shechtman , Sohrab Amirghodsi , Michal Lukac

Video stabilization is a fundamental and important technique for higher quality videos. Prior works have extensively explored video stabilization, but most of them involve cropping of the frame boundaries and introduce moderate levels of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Jinsoo Choi , In So Kweon

We present a frame interpolation algorithm that synthesizes multiple intermediate frames from two input images with large in-between motion. Recent methods use multiple networks to estimate optical flow or depth and a separate network…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Fitsum Reda , Janne Kontkanen , Eric Tabellion , Deqing Sun , Caroline Pantofaru , Brian Curless

Video frame interpolation, the synthesis of novel views in time, is an increasingly popular research direction with many new papers further advancing the state of the art. But as each new method comes with a host of variables that affect…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Simon Niklaus , Long Mai , Oliver Wang

The problem of video frame interpolation is to increase the temporal resolution of a low frame-rate video, by interpolating novel frames between existing temporally sparse frames. This paper presents a self-supervised approach to video…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Ziang Cheng , Shihao Jiang , Hongdong Li

Standard video frame interpolation methods first estimate optical flow between input frames and then synthesize an intermediate frame guided by motion. Recent approaches merge these two steps into a single convolution process by convolving…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Simon Niklaus , Long Mai , Feng Liu

Traditional approaches to interpolate/extrapolate frames in a video sequence require accurate pixel correspondences between images, e.g., using optical flow. Their results stem on the accuracy of optical flow estimation, and could generate…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Zhe Hu , Yinglan Ma , Lizhuang Ma

We propose the first deep learning solution to video frame inpainting, a challenging instance of the general video inpainting problem with applications in video editing, manipulation, and forensics. Our task is less ambiguous than frame…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ximeng Sun , Ryan Szeto , Jason J. Corso

Video Frame Interpolation synthesizes non-existent images between adjacent frames, with the aim of providing a smooth and consistent visual experience. Two approaches for solving this challenging task are optical flow based and kernel-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Xi Li , Meng Cao , Yingying Tang , Scott Johnston , Zhendong Hong , Huimin Ma , Jiulong Shan
‹ Prev 1 2 3 10 Next ›