English
Related papers

Related papers: Long-term Video Frame Interpolation via Feature Pr…

200 papers

Video frame interpolation(VFI) has witnessed great progress in recent years. While existing VFI models still struggle to achieve a good trade-off between accuracy and efficiency: fast models often have inferior accuracy; accurate models…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Ban Chen , Xin Jin , Youxin Chen , Longhai Wu , Jie Chen , Jayoon Koo , Cheul-hee Hahm

With the advancement of AIGC, video frame interpolation (VFI) has become a crucial component in existing video generation frameworks, attracting widespread research interest. For the VFI task, the motion estimation between neighboring…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Zhilin Huang , Yijie Yu , Ling Yang , Chujun Qin , Bing Zheng , Xiawu Zheng , Zikun Zhou , Yaowei Wang , Wenming Yang

Video Frame Interpolation (VFI) aims to synthesize non-existent intermediate frames between existent frames. Flow-based VFI algorithms estimate intermediate motion fields to warp the existent frames. Real-world motions' complexity and the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Chang Zhou , Jie Liu , Jie Tang , Gangshan Wu

In general, deep learning-based video frame interpolation (VFI) methods have predominantly focused on estimating motion vectors between two input frames and warping them to the target time. While this approach has shown impressive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Jaemin Lee , Minseok Seo , Sangwoo Lee , Hyobin Park , Dong-Geol Choi

We present a frame interpolation algorithm that synthesizes multiple intermediate frames from two input images with large in-between motion. Recent methods use multiple networks to estimate optical flow or depth and a separate network…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Fitsum Reda , Janne Kontkanen , Eric Tabellion , Deqing Sun , Caroline Pantofaru , Brian Curless

Large pre-trained video diffusion models excel in video frame interpolation but struggle to generate high fidelity frames due to reliance on intrinsic generative priors, limiting detail preservation from start and end frames. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Ganggui Ding , Hao Chen , Xiaogang Xu

Real-time video frame interpolation (VFI) is very useful in video processing, media players, and display devices. We propose RIFE, a Real-time Intermediate Flow Estimation algorithm for VFI. To realize a high-quality flow-based VFI method,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Zhewei Huang , Tianyuan Zhang , Wen Heng , Boxin Shi , Shuchang Zhou

In this work, we propose a new diffusion-based method for video frame interpolation (VFI), in the context of traditional hand-made animation. We introduce three main contributions: The first is that we explicitly handle the interpolation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Victor Fonte Chavez , Claudia Esteves , Jean-Bernard Hayet

Video frame interpolation (VFI) that leverages the bio-inspired event cameras as guidance has recently shown better performance and memory efficiency than the frame-based methods, thanks to the event cameras' advantages, such as high…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Haoyue Liu , Jinghan Xu , Yi Chang , Hanyu Zhou , Haozhi Zhao , Lin Wang , Luxin Yan

Capitalizing on the rapid development of neural networks, recent video frame interpolation (VFI) methods have achieved notable improvements. However, they still fall short for real-world videos containing large motions. Complex deformation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Changlin Li , Guangyang Wu , Yanan Sun , Xin Tao , Chi-Keung Tang , Yu-Wing Tai

Most approaches for video frame interpolation require accurate dense correspondences to synthesize an in-between frame. Therefore, they do not perform well in challenging scenarios with e.g. lighting changes or motion blur. Recent deep…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Simone Meyer , Abdelaziz Djelouah , Brian McWilliams , Alexander Sorkine-Hornung , Markus Gross , Christopher Schroers

In this paper, we firstly present a dataset (X4K1000FPS) of 4K videos of 1000 fps with the extreme motion to the research community for video frame interpolation (VFI), and propose an extreme VFI network, called XVFI-Net, that first handles…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Hyeonjun Sim , Jihyong Oh , Munchurl Kim

Existing video frame interpolation (VFI) methods often adopt a frame-centric approach, processing videos as independent short segments (e.g., triplets), which leads to temporal inconsistencies and motion artifacts. To overcome this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Xinyu Peng , Han Li , Yuyang Huang , Ziyang Zheng , Yaoming Wang , Xin Chen , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong

Video Frame Interpolation (VFI) is a core low-level vision task that synthesizes intermediate frames between existing ones while ensuring spatial and temporal coherence. Over the past decades, VFI methodologies have evolved from classical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Dahyeon Kye , Changhyun Roh , Sukhun Ko , Chanho Eom , Jihyong Oh

Generating intermediate video content of varying lengths based on given first and last frames, along with text prompt information, offers significant research and application potential. However, traditional frame interpolation tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yijia Hong , Jiangning Zhang , Ran Yi , Yuji Wang , Weijian Cao , Xiaobin Hu , Zhucun Xue , Yabiao Wang , Chengjie Wang , Lizhuang Ma

We present a novel simple yet effective algorithm for motion-based video frame interpolation. Existing motion-based interpolation methods typically rely on a pre-trained optical flow model or a U-Net based pyramid network for motion…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Xin Jin , Longhai Wu , Guotao Shen , Youxin Chen , Jie Chen , Jayoon Koo , Cheul-hee Hahm

Prevailing video frame interpolation algorithms, that generate the intermediate frames from consecutive inputs, typically rely on complex model architectures with heavy parameters or large delay, hindering them from diverse real-time…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Lingtong Kong , Boyuan Jiang , Donghao Luo , Wenqing Chu , Xiaoming Huang , Ying Tai , Chengjie Wang , Jie Yang

Video frame interpolation (VFI) is a fundamental vision task that aims to synthesize several frames between two consecutive original video images. Most algorithms aim to accomplish VFI by using only keyframes, which is an ill-posed problem…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Onur Selim Kılıç , Ahmet Akman , A. Aydın Alatan

Video Frame Interpolation (VFI) aims to synthesize intermediate frames between existing frames to enhance visual smoothness and quality. Beyond the conventional methods based on the reconstruction loss, recent works have employed generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jaihyun Lew , Jooyoung Choi , Chaehun Shin , Dahuin Jung , Sungroh Yoon

Video frame interpolation, the process of synthesizing intermediate frames between sequential video frames, has made remarkable progress with the use of event cameras. These sensors, with microsecond-level temporal resolution, fill…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yuhan Liu , Yongjian Deng , Hao Chen , Bochen Xie , Youfu Li , Zhen Yang