English
Related papers

Related papers: Deep Animation Video Interpolation in the Wild

200 papers

Existing learning-based frame interpolation algorithms extract consecutive frames from high-speed natural videos to train the model. Compared to natural videos, cartoon videos are usually in a low frame rate. Besides, the motion between…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Wang Shen , Cheng Ming , Wenbo Bao , Guangtao Zhai , Li Chen , Zhiyong Gao

This work presents a supervised learning based approach to the computer vision problem of frame interpolation. The presented technique could also be used in the cartoon animations since drawing each individual frame consumes a noticeable…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Vladislav Samsonov

Upsampling videos of human activity is an interesting yet challenging task with many potential applications ranging from gaming to entertainment and sports broadcasting. The main difficulty in synthesizing video frames in this setting stems…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Hsuan-I Ho , Xu Chen , Jie Song , Otmar Hilliges

Traditional 2D animation is labor-intensive, often requiring animators to manually draw twelve illustrations per second of movement. While automatic frame interpolation may ease this burden, 2D animation poses additional difficulties…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Shuhong Chen , Matthias Zwicker

Standard video frame interpolation methods first estimate optical flow between input frames and then synthesize an intermediate frame guided by motion. Recent approaches merge these two steps into a single convolution process by convolving…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Simon Niklaus , Long Mai , Feng Liu

We propose a novel framework to produce cartoon videos by fetching the color information from two input keyframes while following the animated motion guided by a user sketch. The key idea of the proposed approach is to estimate the dense…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Xiaoyu Li , Bo Zhang , Jing Liao , Pedro V. Sander

Video frame interpolation typically involves two steps: motion estimation and pixel synthesis. Such a two-step approach heavily depends on the quality of motion estimation. This paper presents a robust video frame interpolation method that…

Computer Vision and Pattern Recognition · Computer Science 2017-03-23 Simon Niklaus , Long Mai , Feng Liu

We aim to address a significant but understudied problem in the anime industry, namely the inbetweening of cartoon line drawings. Inbetweening involves generating intermediate frames between two black-and-white line drawings and is a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Li Siyao , Tianpei Gu , Weiye Xiao , Henghui Ding , Ziwei Liu , Chen Change Loy

The problem of video frame interpolation is to increase the temporal resolution of a low frame-rate video, by interpolating novel frames between existing temporally sparse frames. This paper presents a self-supervised approach to video…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Ziang Cheng , Shihao Jiang , Hongdong Li

Video frame interpolation, which aims to synthesize non-exist intermediate frames in a video sequence, is an important research topic in computer vision. Existing video frame interpolation methods have achieved remarkable results under…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Youjian Zhang , Chaoyue Wang , Dacheng Tao

Video prediction is an extrapolation task that predicts future frames given past frames, and video frame interpolation is an interpolation task that estimates intermediate frames between two frames. We have witnessed the tremendous…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Yue Wu , Qiang Wen , Qifeng Chen

As Deep Neural Networks are becoming more popular, much of the attention is being devoted to Computer Vision problems that used to be solved with more traditional approaches. Video frame interpolation is one of such challenges that has seen…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Mart Kartašev , Carlo Rapisarda , Dominik Fay

Video interpolation is an important problem in computer vision, which helps overcome the temporal limitation of camera sensors. Existing video interpolation methods usually assume uniform motion between consecutive frames and use linear…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Xiangyu Xu , Li Siyao , Wenxiu Sun , Qian Yin , Ming-Hsuan Yang

Frame interpolation is an essential video processing technique that adjusts the temporal resolution of an image sequence. While deep learning has brought great improvements to the area of video frame interpolation, techniques that make use…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Simon Niklaus , Ping Hu , Jiawen Chen

We propose the first deep learning solution to video frame inpainting, a challenging instance of the general video inpainting problem with applications in video editing, manipulation, and forensics. Our task is less ambiguous than frame…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ximeng Sun , Ryan Szeto , Jason J. Corso

Given two consecutive frames, video interpolation aims at generating intermediate frame(s) to form both spatially and temporally coherent video sequences. While most existing methods focus on single-frame interpolation, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Huaizu Jiang , Deqing Sun , Varun Jampani , Ming-Hsuan Yang , Erik Learned-Miller , Jan Kautz

Temporal interpolation has the potential to be a powerful tool for video compression. Existing methods for frame interpolation do not discriminate between video textures and generally invoke a single general model capable of interpolating a…

Image and Video Processing · Electrical Eng. & Systems 2021-08-23 Duolikun Danier , David Bull

Motion in-betweening is one of the most artistically demanding and time consuming stages of 3D animation, where the expressivity and rhythm of motion are defined. The level of creative control it requires makes it a major production…

Graphics · Computer Science 2026-05-05 Anton Raël , Julien Boucher , Antoine Lhermitte

Frame interpolation attempts to synthesise frames given one or more consecutive video frames. In recent years, deep learning approaches, and notably convolutional neural networks, have succeeded at tackling low- and high-level computer…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Joost van Amersfoort , Wenzhe Shi , Alejandro Acosta , Francisco Massa , Johannes Totz , Zehan Wang , Jose Caballero

Video frame interpolation (VFI) is the task that synthesizes the intermediate frame given two consecutive frames. Most of the previous studies have focused on appropriate frame warping operations and refinement modules for the warped…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Sangjin Lee , Hyeongmin Lee , Chajin Shin , Hanbin Son , Sangyoun Lee
‹ Prev 1 2 3 10 Next ›