English
Related papers

Related papers: Enhanced Deep Animation Video Interpolation

200 papers

Frame interpolation attempts to synthesise frames given one or more consecutive video frames. In recent years, deep learning approaches, and notably convolutional neural networks, have succeeded at tackling low- and high-level computer…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Joost van Amersfoort , Wenzhe Shi , Alejandro Acosta , Francisco Massa , Johannes Totz , Zehan Wang , Jose Caballero

In this work, we propose a new diffusion-based method for video frame interpolation (VFI), in the context of traditional hand-made animation. We introduce three main contributions: The first is that we explicitly handle the interpolation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Victor Fonte Chavez , Claudia Esteves , Jean-Bernard Hayet

Video frame interpolation is a challenging problem because there are different scenarios for each video depending on the variety of foreground and background motion, frame rate, and occlusion. It is therefore difficult for a single network…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Myungsub Choi , Janghoon Choi , Sungyong Baik , Tae Hyun Kim , Kyoung Mu Lee

Video prediction is an extrapolation task that predicts future frames given past frames, and video frame interpolation is an interpolation task that estimates intermediate frames between two frames. We have witnessed the tremendous…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Yue Wu , Qiang Wen , Qifeng Chen

As Deep Neural Networks are becoming more popular, much of the attention is being devoted to Computer Vision problems that used to be solved with more traditional approaches. Video frame interpolation is one of such challenges that has seen…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Mart Kartašev , Carlo Rapisarda , Dominik Fay

In this work, we explore a new problem of frame interpolation for speech videos. Such content today forms the major form of online communication. We try to solve this problem by using several deep learning video generation algorithms to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Aradhya Neeraj Mathur , Devansh Batra , Yaman Kumar , Rajiv Ratn Shah , Roger Zimmermann

Generating intermediate video content of varying lengths based on given first and last frames, along with text prompt information, offers significant research and application potential. However, traditional frame interpolation tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yijia Hong , Jiangning Zhang , Ran Yi , Yuji Wang , Weijian Cao , Xiaobin Hu , Zhucun Xue , Yabiao Wang , Chengjie Wang , Lizhuang Ma

Video Frame Interpolation (VFI) is a crucial technique in various applications such as slow-motion generation, frame rate conversion, video frame restoration etc. This paper introduces an efficient video frame interpolation framework that…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Tong Shen , Dong Li , Ziheng Gao , Lu Tian , Emad Barsoum

The problem of video inter-frame interpolation is an essential task in the field of image processing. Correctly increasing the number of frames in the recording while maintaining smooth movement allows to improve the quality of played video…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Malwina Kubas , Grzegorz Sarwas

Video frame interpolation (VFI) is a fundamental vision task that aims to synthesize several frames between two consecutive original video images. Most algorithms aim to accomplish VFI by using only keyframes, which is an ill-posed problem…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Onur Selim Kılıç , Ahmet Akman , A. Aydın Alatan

Standard video frame interpolation methods first estimate optical flow between input frames and then synthesize an intermediate frame guided by motion. Recent approaches merge these two steps into a single convolution process by convolving…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Simon Niklaus , Long Mai , Feng Liu

Video frame interpolation (VFI) enables many important applications that might involve the temporal domain, such as slow motion playback, or the spatial domain, such as stop motion sequences. We are focusing on the former task, where one of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Uğur Çoğalan , Mojtaba Bemana , Hans-Peter Seidel , Karol Myszkowski

Video Frame Interpolation (VFI) is a core low-level vision task that synthesizes intermediate frames between existing ones while ensuring spatial and temporal coherence. Over the past decades, VFI methodologies have evolved from classical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Dahyeon Kye , Changhyun Roh , Sukhun Ko , Chanho Eom , Jihyong Oh

Hand-drawn 2D animation workflow is typically initiated with the creation of sketch keyframes. Subsequent manual inbetweens are crafted for smoothness, which is a labor-intensive process and the prospect of automatic animation sketch…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Jiaming Shen , Kun Hu , Wei Bao , Chang Wen Chen , Zhiyong Wang

Video frame interpolation methodologies endeavor to create novel frames betwixt extant ones, with the intent of augmenting the video's frame frequency. However, current methods are prone to image blurring and spurious artifacts in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Pengfei Han , Fuhua Zhang , Bin Zhao , Xuelong Li

Recent works have shown the ability of Implicit Neural Representations (INR) to carry meaningful representations of signal derivatives. In this work, we leverage this property to perform Video Frame Interpolation (VFI) by explicitly…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Weihao Zhuang , Tristan Hascoet , Ryoichi Takashima , Tetsuya Takiguchi

Existing video frame interpolation (VFI) methods blindly predict where each object is at a specific timestep t ("time indexing"), which struggles to predict precise object movements. Given two images of a baseball, there are infinitely many…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhihang Zhong , Yiming Zhang , Wei Wang , Xiao Sun , Yu Qiao , Gurunandan Krishnan , Sizhuo Ma , Jian Wang

Video frame interpolation typically involves two steps: motion estimation and pixel synthesis. Such a two-step approach heavily depends on the quality of motion estimation. This paper presents a robust video frame interpolation method that…

Computer Vision and Pattern Recognition · Computer Science 2017-03-23 Simon Niklaus , Long Mai , Feng Liu

In this paper we present a new deep learning-driven approach to image-based synthesis of animations involving humanoid characters. Unlike previous deep approaches to image-based animation our method makes no assumptions on the type of…

Graphics · Computer Science 2019-08-14 John Kanji , David I. W. Levin

Large motion poses a critical challenge in Video Frame Interpolation (VFI) task. Existing methods are often constrained by limited receptive fields, resulting in sub-optimal performance when handling scenarios with large motion. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Chunxu Liu , Guozhen Zhang , Rui Zhao , Limin Wang