English
Related papers

Related papers: Event-based Video Frame Interpolation with Edge Gu…

200 papers

Real-time video frame interpolation (VFI) is very useful in video processing, media players, and display devices. We propose RIFE, a Real-time Intermediate Flow Estimation algorithm for VFI. To realize a high-quality flow-based VFI method,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Zhewei Huang , Tianyuan Zhang , Wen Heng , Boxin Shi , Shuchang Zhou

Motion estimation (ME) and motion compensation (MC) have been widely used for classical video frame interpolation systems over the past decades. Recently, a number of data-driven frame interpolation methods based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Wenbo Bao , Wei-Sheng Lai , Xiaoyun Zhang , Zhiyong Gao , Ming-Hsuan Yang

Video frame interpolation (VFI), which generates intermediate frames from given start and end frames, has become a fundamental function in video generation applications. However, existing generative VFI methods are constrained to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Guozhen Zhang , Haiguang Wang , Chunyu Wang , Yuan Zhou , Qinglin Lu , Limin Wang

Effective video frame interpolation hinges on the adept handling of motion in the input scene. Prior work acknowledges asynchronous event information for this, but often overlooks whether motion induces blur in the video, limiting its scope…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Lei Sun , Daniel Gehrig , Christos Sakaridis , Mathias Gehrig , Jingyun Liang , Peng Sun , Zhijie Xu , Kaiwei Wang , Luc Van Gool , Davide Scaramuzza

Recording fast motion in a high FPS (frame-per-second) requires expensive high-speed cameras. As an alternative, interpolating low-FPS videos from commodity cameras has attracted significant attention. If only low-FPS videos are available,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Weihua He , Kaichao You , Zhendong Qiao , Xu Jia , Ziyang Zhang , Wenhui Wang , Huchuan Lu , Yaoyuan Wang , Jianxing Liao

Video frame interpolation is a challenging problem because there are different scenarios for each video depending on the variety of foreground and background motion, frame rate, and occlusion. It is therefore difficult for a single network…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Myungsub Choi , Janghoon Choi , Sungyong Baik , Tae Hyun Kim , Kyoung Mu Lee

Existing video frame interpolation (VFI) methods often adopt a frame-centric approach, processing videos as independent short segments (e.g., triplets), which leads to temporal inconsistencies and motion artifacts. To overcome this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Xinyu Peng , Han Li , Yuyang Huang , Ziyang Zheng , Yaoming Wang , Xin Chen , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong

In autonomous driving, relying solely on frame-based cameras can lead to inaccuracies caused by factors like long exposure times, high-speed motion, and challenging lighting conditions. To address these issues, we introduce a bio-inspired…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Hu Cao , Jiong Liu , Xingzhuo Yan , Rui Song , Yan Xia , Walter Zimmer , Guang Chen , Alois Knoll

Frame interpolation attempts to synthesise frames given one or more consecutive video frames. In recent years, deep learning approaches, and notably convolutional neural networks, have succeeded at tackling low- and high-level computer…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Joost van Amersfoort , Wenzhe Shi , Alejandro Acosta , Francisco Massa , Johannes Totz , Zehan Wang , Jose Caballero

Existing Video Frame interpolation (VFI) models tend to suffer from time-to-location ambiguity when trained with video of non-uniform motions, such as accelerating, decelerating, and changing directions, which often yield blurred…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Wonyong Seo , Jihyong Oh , Munchurl Kim

Video frame interpolation typically involves two steps: motion estimation and pixel synthesis. Such a two-step approach heavily depends on the quality of motion estimation. This paper presents a robust video frame interpolation method that…

Computer Vision and Pattern Recognition · Computer Science 2017-03-23 Simon Niklaus , Long Mai , Feng Liu

Models optimized for accuracy on single images are often prohibitively slow to run on each frame in a video. Recent work exploits the use of optical flow to warp image features forward from select keyframes, as a means to conserve…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Samvit Jain , Joseph E. Gonzalez

Event-based semantic segmentation explores the potential of event cameras, which offer high dynamic range and fine temporal resolution, to achieve robust scene understanding in challenging environments. Despite these advantages, the task…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Zhijiang Li , Haoran He

The problem of video inter-frame interpolation is an essential task in the field of image processing. Correctly increasing the number of frames in the recording while maintaining smooth movement allows to improve the quality of played video…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Malwina Kubas , Grzegorz Sarwas

Video frame extrapolation is a task to predict future frames when the past frames are given. Unlike previous studies that usually have been focused on the design of modules or construction of networks, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Sangjin Lee , Hyeongmin Lee , Taeoh Kim , Sangyoun Lee

Event cameras have emerged as a promising sensing modality for autonomous navigation systems, owing to their high temporal resolution, high dynamic range and negligible motion blur. To process the asynchronous temporal event streams from…

Machine Learning · Computer Science 2024-03-26 Shrihari Sridharan , Surya Selvam , Kaushik Roy , Anand Raghunathan

Recently, flow-based methods have achieved promising success in video frame interpolation. However, electron microscopic (EM) images suffer from unstable image quality, low PSNR, and disorderly deformation. Existing flow-based interpolation…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Zejin Wang , Guodong Sun , Lina Zhang , Guoqing Li , Hua Han

Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored. Due to the selective transmission of light by polarized filters, longer exposure times are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Feng Huang , Xin Zhang , Yixuan Xu , Xuesong Wang , Xianyu Wu

Large pre-trained video diffusion models excel in video frame interpolation but struggle to generate high fidelity frames due to reliance on intrinsic generative priors, limiting detail preservation from start and end frames. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Ganggui Ding , Hao Chen , Xiaogang Xu

Massive frame redundancy and limited context window make efficient frame selection crucial for long-video understanding with large vision-language models (LVLMs). Prevailing approaches, however, adopt a flat sampling paradigm which treats…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Wang Chen , Yongdong Luo , Yuhui Zeng , Luojun Lin , Tianyu Xie , Fei Chao , Rongrong Ji , Xiawu Zheng