English
Related papers

Related papers: Context-aware Synthesis for Video Frame Interpolat…

200 papers

Video frame interpolation, the synthesis of novel views in time, is an increasingly popular research direction with many new papers further advancing the state of the art. But as each new method comes with a host of variables that affect…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Simon Niklaus , Long Mai , Oliver Wang

Prevailing video frame interpolation algorithms, that generate the intermediate frames from consecutive inputs, typically rely on complex model architectures with heavy parameters or large delay, hindering them from diverse real-time…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Lingtong Kong , Boyuan Jiang , Donghao Luo , Wenqing Chu , Xiaoming Huang , Ying Tai , Chengjie Wang , Jie Yang

Frame interpolation attempts to synthesise frames given one or more consecutive video frames. In recent years, deep learning approaches, and notably convolutional neural networks, have succeeded at tackling low- and high-level computer…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Joost van Amersfoort , Wenzhe Shi , Alejandro Acosta , Francisco Massa , Johannes Totz , Zehan Wang , Jose Caballero

Video frame interpolation (VFI) aims to synthesize an intermediate frame between two consecutive frames. State-of-the-art approaches usually adopt a two-step solution, which includes 1) generating locally-warped pixels by flow-based motion…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Chengxu Liu , Huan Yang , Jianlong Fu , Xueming Qian

Differentiable image sampling in the form of backward warping has seen broad adoption in tasks like depth estimation and optical flow prediction. In contrast, how to perform forward warping has seen less attention, partly due to additional…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Simon Niklaus , Feng Liu

Video frame interpolation is an important low-level vision task, which can increase frame rate for more fluent visual experience. Existing methods have achieved great success by employing advanced motion models and synthesis networks.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Lingtong Kong , Boyuan Jiang , Donghao Luo , Wenqing Chu , Ying Tai , Chengjie Wang , Jie Yang

Video frame interpolation is a challenging task due to the ever-changing real-world scene. Previous methods often calculate the bi-directional optical flows and then predict the intermediate optical flows under the linear motion…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Song Wu , Kaichao You , Weihua He , Chen Yang , Yang Tian , Yaoyuan Wang , Ziyang Zhang , Jianxing Liao

Video interpolation increases the temporal resolution of a video sequence by synthesizing intermediate frames between two consecutive frames. We propose a novel deep-learning-based video interpolation algorithm based on bilateral motion…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Junheum Park , Keunsoo Ko , Chul Lee , Chang-Su Kim

Video interpolation is an important problem in computer vision, which helps overcome the temporal limitation of camera sensors. Existing video interpolation methods usually assume uniform motion between consecutive frames and use linear…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Xiangyu Xu , Li Siyao , Wenxiu Sun , Qian Yin , Ming-Hsuan Yang

This work presents a supervised learning based approach to the computer vision problem of frame interpolation. The presented technique could also be used in the cartoon animations since drawing each individual frame consumes a noticeable…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Vladislav Samsonov

Recently, flow-based frame interpolation methods have achieved great success by first modeling optical flow between target and input frames, and then building synthesis network for target frame generation. However, above cascaded…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Lingtong Kong , Jinfeng Liu , Jie Yang

We propose a novel video frame interpolation algorithm based on asymmetric bilateral motion estimation (ABME), which synthesizes an intermediate frame between two input frames. First, we predict symmetric bilateral motion fields to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Junheum Park , Chul Lee , Chang-Su Kim

Recently, video frame interpolation using a combination of frame- and event-based cameras has surpassed traditional image-based methods both in terms of performance and memory efficiency. However, current methods still suffer from (i)…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Stepan Tulyakov , Alfredo Bochicchio , Daniel Gehrig , Stamatios Georgoulis , Yuanyou Li , Davide Scaramuzza

Video frame interpolation, which aims to synthesize non-exist intermediate frames in a video sequence, is an important research topic in computer vision. Existing video frame interpolation methods have achieved remarkable results under…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Youjian Zhang , Chaoyue Wang , Dacheng Tao

We propose the first deep learning solution to video frame inpainting, a challenging instance of the general video inpainting problem with applications in video editing, manipulation, and forensics. Our task is less ambiguous than frame…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ximeng Sun , Ryan Szeto , Jason J. Corso

Video frame interpolation can up-convert the frame rate and enhance the video quality. In recent years, although the interpolation performance has achieved great success, image blur usually occurs at the object boundaries owing to the large…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Bin Zhao , Xuelong Li

Most approaches for video frame interpolation require accurate dense correspondences to synthesize an in-between frame. Therefore, they do not perform well in challenging scenarios with e.g. lighting changes or motion blur. Recent deep…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Simone Meyer , Abdelaziz Djelouah , Brian McWilliams , Alexander Sorkine-Hornung , Markus Gross , Christopher Schroers

Flow-based frame interpolation methods ensure motion stability through estimated intermediate flow but often introduce severe artifacts in complex motion regions. Recent generative approaches, boosted by large-scale pre-trained video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Guozhen Zhang , Yuhan Zhu , Yutao Cui , Xiaotong Zhao , Kai Ma , Limin Wang

A majority of methods for video frame interpolation compute bidirectional optical flow between adjacent frames of a video, followed by a suitable warping algorithm to generate the output frames. However, approaches relying on optical flow…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Tarun Kalluri , Deepak Pathak , Manmohan Chandraker , Du Tran

Motion-based video frame interpolation commonly relies on optical flow to warp pixels from the inputs to the desired interpolation instant. Yet due to the inherent challenges of motion estimation (e.g. occlusions and discontinuities), most…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Ping Hu , Simon Niklaus , Stan Sclaroff , Kate Saenko