English
Related papers

Related papers: Meta-Interpolation: Time-Arbitrary Frame Interpola…

200 papers

Standard video frame interpolation methods first estimate optical flow between input frames and then synthesize an intermediate frame guided by motion. Recent approaches merge these two steps into a single convolution process by convolving…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Simon Niklaus , Long Mai , Feng Liu

Video frame interpolation typically involves two steps: motion estimation and pixel synthesis. Such a two-step approach heavily depends on the quality of motion estimation. This paper presents a robust video frame interpolation method that…

Computer Vision and Pattern Recognition · Computer Science 2017-03-23 Simon Niklaus , Long Mai , Feng Liu

Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be roughly divided…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Zhihao Shi , Xiaohong Liu , Kangdi Shi , Linhui Dai , Jun Chen

Video frame interpolation is a challenging problem because there are different scenarios for each video depending on the variety of foreground and background motion, frame rate, and occlusion. It is therefore difficult for a single network…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Myungsub Choi , Janghoon Choi , Sungyong Baik , Tae Hyun Kim , Kyoung Mu Lee

Given two consecutive frames, video interpolation aims at generating intermediate frame(s) to form both spatially and temporally coherent video sequences. While most existing methods focus on single-frame interpolation, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Huaizu Jiang , Deqing Sun , Varun Jampani , Ming-Hsuan Yang , Erik Learned-Miller , Jan Kautz

Video frame interpolation has been actively studied with the development of convolutional neural networks. However, due to the intrinsic limitations of kernel weight sharing in convolution, the interpolated frame generated by it may lose…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Pan Gao , Haoyue Tian , Jie Qin

Video frame interpolation, the synthesis of novel views in time, is an increasingly popular research direction with many new papers further advancing the state of the art. But as each new method comes with a host of variables that affect…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Simon Niklaus , Long Mai , Oliver Wang

Video frame interpolation algorithms typically estimate optical flow or its variations and then use it to guide the synthesis of an intermediate frame between two consecutive original frames. To handle challenges like occlusion,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Simon Niklaus , Feng Liu

Video Frame Interpolation synthesizes non-existent images between adjacent frames, with the aim of providing a smooth and consistent visual experience. Two approaches for solving this challenging task are optical flow based and kernel-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Xi Li , Meng Cao , Yingying Tang , Scott Johnston , Zhendong Hong , Huimin Ma , Jiulong Shan

Video frame interpolation task has recently become more and more prevalent in the computer vision field. At present, a number of researches based on deep learning have achieved great success. Most of them are either based on optical flow…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Haoyue Tian , Pan Gao , Xiaojiang Peng

Video frame interpolation aims to synthesize nonexistent frames in-between the original frames. While significant advances have been made from the recent deep convolutional neural networks, the quality of interpolation is often reduced due…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Wenbo Bao , Wei-Sheng Lai , Chao Ma , Xiaoyun Zhang , Zhiyong Gao , Ming-Hsuan Yang

We propose the first deep learning solution to video frame inpainting, a challenging instance of the general video inpainting problem with applications in video editing, manipulation, and forensics. Our task is less ambiguous than frame…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ximeng Sun , Ryan Szeto , Jason J. Corso

This work presents a supervised learning based approach to the computer vision problem of frame interpolation. The presented technique could also be used in the cartoon animations since drawing each individual frame consumes a noticeable…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Vladislav Samsonov

Video frame interpolation, which aims to synthesize non-exist intermediate frames in a video sequence, is an important research topic in computer vision. Existing video frame interpolation methods have achieved remarkable results under…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Youjian Zhang , Chaoyue Wang , Dacheng Tao

Video frame interpolation aims to synthesize realistic intermediate frames between given endpoints while adhering to specific motion semantics. While recent generative models have improved visual fidelity, they predominantly operate in a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Lingyu Liu , Yaxiong Wang , Li Zhu , Zhedong Zheng

Motion estimation (ME) and motion compensation (MC) have been widely used for classical video frame interpolation systems over the past decades. Recently, a number of data-driven frame interpolation methods based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Wenbo Bao , Wei-Sheng Lai , Xiaoyun Zhang , Zhiyong Gao , Ming-Hsuan Yang

Generating non-existing frames from a consecutive video sequence has been an interesting and challenging problem in the video processing field. Typical kernel-based interpolation methods predict pixels with a single convolution process that…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Xianhang Cheng , Zhenzhong Chen

Video frame interpolation aims to synthesize one or multiple frames between two consecutive frames in a video. It has a wide range of applications including slow-motion video generation, frame-rate up-scaling and developing video codecs.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Saikat Dutta , Arulkumar Subramaniam , Anurag Mittal

Frame interpolation is an essential video processing technique that adjusts the temporal resolution of an image sequence. While deep learning has brought great improvements to the area of video frame interpolation, techniques that make use…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Simon Niklaus , Ping Hu , Jiawen Chen

Video interpolation increases the temporal resolution of a video sequence by synthesizing intermediate frames between two consecutive frames. We propose a novel deep-learning-based video interpolation algorithm based on bilateral motion…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Junheum Park , Keunsoo Ko , Chul Lee , Chang-Su Kim
‹ Prev 1 2 3 10 Next ›