English
Related papers

Related papers: Arbitrary Generative Video Interpolation

200 papers

We propose a novel video frame interpolation algorithm based on asymmetric bilateral motion estimation (ABME), which synthesizes an intermediate frame between two input frames. First, we predict symmetric bilateral motion fields to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Junheum Park , Chul Lee , Chang-Su Kim

Large motion poses a critical challenge in Video Frame Interpolation (VFI) task. Existing methods are often constrained by limited receptive fields, resulting in sub-optimal performance when handling scenarios with large motion. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Chunxu Liu , Guozhen Zhang , Rui Zhao , Limin Wang

Generative inbetweening aims to generate intermediate frame sequences by utilizing two key frames as input. Although remarkable progress has been made in video generation models, generative inbetweening still faces challenges in maintaining…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Tianyi Zhu , Dongwei Ren , Qilong Wang , Xiaohe Wu , Wangmeng Zuo

Video Frame Interpolation aims to recover realistic missing frames between observed frames, generating a high-frame-rate video from a low-frame-rate video. However, without additional guidance, the large motion between frames makes this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jingxi Chen , Brandon Y. Feng , Haoming Cai , Tianfu Wang , Levi Burner , Dehao Yuan , Cornelia Fermuller , Christopher A. Metzler , Yiannis Aloimonos

Video frame interpolation (VFI) serves as a useful tool for many video processing applications. Recently, it has also been applied in the video compression domain for enhancing both conventional video codecs and learning-based compression…

Image and Video Processing · Electrical Eng. & Systems 2023-06-23 Duolikun Danier , Fan Zhang , David Bull

Video frame interpolation (VFI) that leverages the bio-inspired event cameras as guidance has recently shown better performance and memory efficiency than the frame-based methods, thanks to the event cameras' advantages, such as high…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Haoyue Liu , Jinghan Xu , Yi Chang , Hanyu Zhou , Haozhi Zhao , Lin Wang , Luxin Yan

Video frame interpolation (VFI) aims to generate predictive frames by warping learnable motions from the bidirectional historical references. Most existing works utilize spatio-temporal semantic information extractor to realize motion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Meiqin Liu , Chenming Xu , Chao Yao , Chunyu Lin , Yao Zhao

Inter-frame modeling is pivotal in generating intermediate frames for video frame interpolation (VFI). Current approaches predominantly rely on convolution or attention-based models, which often either lack sufficient receptive fields or…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Guozhen Zhang , Chunxu Liu , Yutao Cui , Xiaotong Zhao , Kai Ma , Limin Wang

Video Frame Interpolation (VFI) is a crucial technique in various applications such as slow-motion generation, frame rate conversion, video frame restoration etc. This paper introduces an efficient video frame interpolation framework that…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Tong Shen , Dong Li , Ziheng Gao , Lu Tian , Emad Barsoum

Video frame interpolation (VFI) enables many important applications that might involve the temporal domain, such as slow motion playback, or the spatial domain, such as stop motion sequences. We are focusing on the former task, where one of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Uğur Çoğalan , Mojtaba Bemana , Hans-Peter Seidel , Karol Myszkowski

Exposure-agnostic video frame interpolation (VFI) is a challenging task that aims to recover sharp, high-frame-rate videos from blurry, low-frame-rate inputs captured under unknown and dynamic exposure conditions. Event cameras are sensors…

Image and Video Processing · Electrical Eng. & Systems 2025-10-28 Junsik Jung , Yoonki Cho , Woo Jae Kim , Lin Wang , Sune-eui Yoon

We present Video Motion Graphs, a system designed to generate realistic human motion videos. Using a reference video and conditional signals such as music or motion tags, the system synthesizes new videos by first retrieving video clips…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Haiyang Liu , Zhan Xu , Fa-Ting Hong , Hsin-Ping Huang , Yi Zhou , Yang Zhou

Video frame interpolation has long been challenged by limited controllability and interactivity, especially in scenarios involving fast, highly non-linear, and fine-grained motion. Although recent interactive interpolation methods have made…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Yuchen Deng , Xiuyang Wu , Hai-Tao Zheng , Jie Wang , Feidiao Yang , Yuxing Han

Recent advances in high refresh rate displays as well as the increased interest in high rate of slow motion and frame up-conversion fuel the demand for efficient and cost-effective multi-frame video interpolation solutions. To that regard,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Zhixiang Chi , Rasoul Mohammadi Nasiri , Zheng Liu , Juwei Lu , Jin Tang , Konstantinos N Plataniotis

Video Frame Interpolation (VFI) aims to synthesize non-existent intermediate frames between existent frames. Flow-based VFI algorithms estimate intermediate motion fields to warp the existent frames. Real-world motions' complexity and the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Chang Zhou , Jie Liu , Jie Tang , Gangshan Wu

Frame interpolation attempts to synthesise frames given one or more consecutive video frames. In recent years, deep learning approaches, and notably convolutional neural networks, have succeeded at tackling low- and high-level computer…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Joost van Amersfoort , Wenzhe Shi , Alejandro Acosta , Francisco Massa , Johannes Totz , Zehan Wang , Jose Caballero

Video frame interpolation (VFI) is a fundamental vision task that aims to synthesize several frames between two consecutive original video images. Most algorithms aim to accomplish VFI by using only keyframes, which is an ill-posed problem…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Onur Selim Kılıç , Ahmet Akman , A. Aydın Alatan

Video frame interpolation(VFI) has witnessed great progress in recent years. While existing VFI models still struggle to achieve a good trade-off between accuracy and efficiency: fast models often have inferior accuracy; accurate models…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Ban Chen , Xin Jin , Youxin Chen , Longhai Wu , Jie Chen , Jayoon Koo , Cheul-hee Hahm

With the advancement of AIGC, video frame interpolation (VFI) has become a crucial component in existing video generation frameworks, attracting widespread research interest. For the VFI task, the motion estimation between neighboring…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Zhilin Huang , Yijie Yu , Ling Yang , Chujun Qin , Bing Zheng , Xiawu Zheng , Zikun Zhou , Yaowei Wang , Wenming Yang

Previous methods for Video Frame Interpolation (VFI) have encountered challenges, notably the manifestation of blur and ghosting effects. These issues can be traced back to two pivotal factors: unavoidable motion errors and misalignment in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Guangyang Wu , Xin Tao , Changlin Li , Wenyi Wang , Xiaohong Liu , Qingqing Zheng