English
Related papers

Related papers: A Multi-In-Single-Out Network for Video Frame Inte…

200 papers

Video frame interpolation (VFI) aims to synthesize an intermediate frame between two consecutive frames. State-of-the-art approaches usually adopt a two-step solution, which includes 1) generating locally-warped pixels by flow-based motion…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Chengxu Liu , Huan Yang , Jianlong Fu , Xueming Qian

The quality of frames is significant for both research and application of video frame interpolation (VFI). In recent VFI studies, the methods of full-reference image quality assessment have generally been used to evaluate the quality of VFI…

Image and Video Processing · Electrical Eng. & Systems 2023-12-27 Jinliang Han , Xiongkuo Min , Yixuan Gao , Jun Jia , Lei Sun , Zuowei Cao , Yonglin Luo , Guangtao Zhai

Video frame interpolation (VFI) is a fundamental vision task that aims to synthesize several frames between two consecutive original video images. Most algorithms aim to accomplish VFI by using only keyframes, which is an ill-posed problem…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Onur Selim Kılıç , Ahmet Akman , A. Aydın Alatan

Effectively extracting inter-frame motion and appearance information is important for video frame interpolation (VFI). Previous works either extract both types of information in a mixed way or elaborate separate modules for each type of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Guozhen Zhang , Yuhan Zhu , Haonan Wang , Youxin Chen , Gangshan Wu , Limin Wang

In this paper, we firstly present a dataset (X4K1000FPS) of 4K videos of 1000 fps with the extreme motion to the research community for video frame interpolation (VFI), and propose an extreme VFI network, called XVFI-Net, that first handles…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Hyeonjun Sim , Jihyong Oh , Munchurl Kim

Video frame interpolation(VFI) has witnessed great progress in recent years. While existing VFI models still struggle to achieve a good trade-off between accuracy and efficiency: fast models often have inferior accuracy; accurate models…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Ban Chen , Xin Jin , Youxin Chen , Longhai Wu , Jie Chen , Jayoon Koo , Cheul-hee Hahm

Video frame interpolation, which aims to synthesize non-exist intermediate frames in a video sequence, is an important research topic in computer vision. Existing video frame interpolation methods have achieved remarkable results under…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Youjian Zhang , Chaoyue Wang , Dacheng Tao

We present a frame interpolation algorithm that synthesizes multiple intermediate frames from two input images with large in-between motion. Recent methods use multiple networks to estimate optical flow or depth and a separate network…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Fitsum Reda , Janne Kontkanen , Eric Tabellion , Deqing Sun , Caroline Pantofaru , Brian Curless

Motion modeling is critical in flow-based Video Frame Interpolation (VFI). Existing paradigms either consider linear combinations of bidirectional flows or directly predict bilateral flows for given timestamps without exploring favorable…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Zujin Guo , Wei Li , Chen Change Loy

In this work, we propose a new diffusion-based method for video frame interpolation (VFI), in the context of traditional hand-made animation. We introduce three main contributions: The first is that we explicitly handle the interpolation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Victor Fonte Chavez , Claudia Esteves , Jean-Bernard Hayet

Video frame interpolation (VFI) is currently a very active research topic, with applications spanning computer vision, post production and video encoding. VFI can be extremely challenging, particularly in sequences containing large motions,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Duolikun Danier , Fan Zhang , David Bull

Real-time video frame interpolation (VFI) is very useful in video processing, media players, and display devices. We propose RIFE, a Real-time Intermediate Flow Estimation algorithm for VFI. To realize a high-quality flow-based VFI method,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Zhewei Huang , Tianyuan Zhang , Wen Heng , Boxin Shi , Shuchang Zhou

Video frame interpolation~(VFI) algorithms have improved considerably in recent years due to unprecedented progress in both data-driven algorithms and their implementations. Recent research has introduced advanced motion estimation or novel…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zhixiang Chi , Rasoul Mohammadi Nasiri , Zheng Liu , Yuanhao Yu , Juwei Lu , Jin Tang , Konstantinos N Plataniotis

With the advancement of AIGC, video frame interpolation (VFI) has become a crucial component in existing video generation frameworks, attracting widespread research interest. For the VFI task, the motion estimation between neighboring…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Zhilin Huang , Yijie Yu , Ling Yang , Chujun Qin , Bing Zheng , Xiawu Zheng , Zikun Zhou , Yaowei Wang , Wenming Yang

Given two consecutive frames, video interpolation aims at generating intermediate frame(s) to form both spatially and temporally coherent video sequences. While most existing methods focus on single-frame interpolation, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Huaizu Jiang , Deqing Sun , Varun Jampani , Ming-Hsuan Yang , Erik Learned-Miller , Jan Kautz

Video frame interpolation (VFI) enables many important applications that might involve the temporal domain, such as slow motion playback, or the spatial domain, such as stop motion sequences. We are focusing on the former task, where one of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Uğur Çoğalan , Mojtaba Bemana , Hans-Peter Seidel , Karol Myszkowski

Video frame interpolation (VFI) that leverages the bio-inspired event cameras as guidance has recently shown better performance and memory efficiency than the frame-based methods, thanks to the event cameras' advantages, such as high…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Haoyue Liu , Jinghan Xu , Yi Chang , Hanyu Zhou , Haozhi Zhao , Lin Wang , Luxin Yan

Video Frame Interpolation (VFI) is a fundamental yet challenging task in computer vision, particularly under conditions involving large motion, occlusion, and lighting variation. Recent advancements in event cameras have opened up new…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Hanle Zheng , Xujie Han , Zegang Peng , Shangbin Zhang , Guangxun Du , Zhuo Zou , Xilin Wang , Jibin Wu , Hao Guo , Lei Deng

Large pre-trained video diffusion models excel in video frame interpolation but struggle to generate high fidelity frames due to reliance on intrinsic generative priors, limiting detail preservation from start and end frames. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Ganggui Ding , Hao Chen , Xiaogang Xu

Due to large pixel movement and high computational cost, estimating the motion of high-resolution frames is challenging. Thus, most flow-based Video Frame Interpolation (VFI) methods first predict bidirectional flows at low resolution and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Chenyang Wu , Jiayi Fu , Chun-Le Guo , Shuhao Han , Chongyi Li