English
Related papers

Related papers: Event-based Video Frame Interpolation with Edge Gu…

200 papers

Slow shutter speed and long exposure time of frame-based cameras often cause visual blur and loss of inter-frame information, degenerating the overall quality of captured videos. To this end, we present a unified framework of event-based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Xiang Zhang , Lei Yu

Capitalizing on the rapid development of neural networks, recent video frame interpolation (VFI) methods have achieved notable improvements. However, they still fall short for real-world videos containing large motions. Complex deformation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Changlin Li , Guangyang Wu , Yanan Sun , Xin Tao , Chi-Keung Tang , Yu-Wing Tai

With the advancement of AIGC, video frame interpolation (VFI) has become a crucial component in existing video generation frameworks, attracting widespread research interest. For the VFI task, the motion estimation between neighboring…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Zhilin Huang , Yijie Yu , Ling Yang , Chujun Qin , Bing Zheng , Xiawu Zheng , Zikun Zhou , Yaowei Wang , Wenming Yang

With the prosperity of digital video industry, video frame interpolation has arisen continuous attention in computer vision community and become a new upsurge in industry. Many learning-based methods have been proposed and achieved…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Yihao Liu , Liangbin Xie , Li Siyao , Wenxiu Sun , Yu Qiao , Chao Dong

Video frame interpolation aims to synthesize nonexistent frames in-between the original frames. While significant advances have been made from the recent deep convolutional neural networks, the quality of interpolation is often reduced due…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Wenbo Bao , Wei-Sheng Lai , Chao Ma , Xiaoyun Zhang , Zhiyong Gao , Ming-Hsuan Yang

Handling complex or nonlinear motion patterns has long posed challenges for video frame interpolation. Although recent advances in diffusion-based methods offer improvements over traditional optical flow-based approaches, they still…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Zihao Zhang , Haoran Chen , Haoyu Zhao , Guansong Lu , Yanwei Fu , Hang Xu , Zuxuan Wu

Video Frame Interpolation (VFI) remains a cornerstone in video enhancement, enabling temporal upscaling for tasks like slow-motion rendering, frame rate conversion, and video restoration. While classical methods rely on optical flow and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Priyansh Srivastava , Romit Chatterjee , Abir Sen , Aradhana Behura , Ratnakar Dash

Video frame interpolation(VFI) has witnessed great progress in recent years. While existing VFI models still struggle to achieve a good trade-off between accuracy and efficiency: fast models often have inferior accuracy; accurate models…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Ban Chen , Xin Jin , Youxin Chen , Longhai Wu , Jie Chen , Jayoon Koo , Cheul-hee Hahm

The key to video inpainting is to use correlation information from as many reference frames as possible. Existing flow-based propagation methods split the video synthesis process into multiple steps: flow completion -> pixel propagation ->…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jaeyeon Kang , Seoung Wug Oh , Seon Joo Kim

Existing works on video frame interpolation (VFI) mostly employ deep neural networks that are trained by minimizing the L1, L2, or deep feature space distance (e.g. VGG loss) between their outputs and ground-truth frames. However, recent…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Duolikun Danier , Fan Zhang , David Bull

In this work, we propose a new diffusion-based method for video frame interpolation (VFI), in the context of traditional hand-made animation. We introduce three main contributions: The first is that we explicitly handle the interpolation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Victor Fonte Chavez , Claudia Esteves , Jean-Bernard Hayet

Video Frame Interpolation (VFI) is important for video enhancement, frame rate up-conversion, and slow-motion generation. The introduction of event cameras, which capture per-pixel brightness changes asynchronously, has significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Ziran Zhang , Yongrui Ma , Yueting Chen , Feng Zhang , Jinwei Gu , Tianfan Xue , Shi Guo

Fast neuromorphic event-based vision sensors (Dynamic Vision Sensor, DVS) can be combined with slower conventional frame-based sensors to enable higher-quality inter-frame interpolation than traditional methods relying on fixed motion…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Adam Radomski , Andreas Georgiou , Thomas Debrunner , Chenghan Li , Luca Longinotti , Minwon Seo , Moosung Kwak , Chang-Woo Shin , Paul K. J. Park , Hyunsurk Eric Ryu , Kynan Eng

Flow-based frame interpolation methods ensure motion stability through estimated intermediate flow but often introduce severe artifacts in complex motion regions. Recent generative approaches, boosted by large-scale pre-trained video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Guozhen Zhang , Yuhan Zhu , Yutao Cui , Xiaotong Zhao , Kai Ma , Limin Wang

Large motion poses a critical challenge in Video Frame Interpolation (VFI) task. Existing methods are often constrained by limited receptive fields, resulting in sub-optimal performance when handling scenarios with large motion. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Chunxu Liu , Guozhen Zhang , Rui Zhao , Limin Wang

Event cameras provide robust visual signals under fast motion and challenging illumination conditions thanks to their microsecond latency and high dynamic range. However, their unique sensing characteristics and limited labeled data make it…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Jianwen Cao , Jiaxu Xing , Nico Messikommer , Davide Scaramuzza

In general, deep learning-based video frame interpolation (VFI) methods have predominantly focused on estimating motion vectors between two input frames and warping them to the target time. While this approach has shown impressive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Jaemin Lee , Minseok Seo , Sangwoo Lee , Hyobin Park , Dong-Geol Choi

Video Frame Interpolation (VFI) aims to synthesize non-existent intermediate frames between existent frames. Flow-based VFI algorithms estimate intermediate motion fields to warp the existent frames. Real-world motions' complexity and the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Chang Zhou , Jie Liu , Jie Tang , Gangshan Wu

Video prediction is an extrapolation task that predicts future frames given past frames, and video frame interpolation is an interpolation task that estimates intermediate frames between two frames. We have witnessed the tremendous…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Yue Wu , Qiang Wen , Qifeng Chen

Blurry video frame interpolation (BVFI) aims to generate high-frame-rate clear videos from low-frame-rate blurry videos, is a challenging but important topic in the computer vision community. Blurry videos not only provide spatial and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Pengcheng Lei , Zaoming Yan , Tingting Wang , Faming Fang , Guixu Zhang