English
Related papers

Related papers: Error-Aware Spatial Ensembles for Video Frame Inte…

200 papers

Video frame interpolation (VFI) aims to improve the temporal resolution of a video sequence. Most of the existing deep learning based VFI methods adopt off-the-shelf optical flow algorithms to estimate the bidirectional flows and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Tao Yang , Peiran Ren , Xuansong Xie , Xiansheng Hua , Lei Zhang

Real-time video frame interpolation (VFI) is very useful in video processing, media players, and display devices. We propose RIFE, a Real-time Intermediate Flow Estimation algorithm for VFI. To realize a high-quality flow-based VFI method,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Zhewei Huang , Tianyuan Zhang , Wen Heng , Boxin Shi , Shuchang Zhou

The stereo event-intensity camera setup is widely applied to leverage the advantages of both event cameras with low latency and intensity cameras that capture accurate brightness and texture information. However, such a setup commonly…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Chao Ding , Mingyuan Lin , Haijian Zhang , Jianzhuang Liu , Lei Yu

Video Frame Interpolation (VFI) is a crucial technique in various applications such as slow-motion generation, frame rate conversion, video frame restoration etc. This paper introduces an efficient video frame interpolation framework that…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Tong Shen , Dong Li , Ziheng Gao , Lu Tian , Emad Barsoum

Previous methods for Video Frame Interpolation (VFI) have encountered challenges, notably the manifestation of blur and ghosting effects. These issues can be traced back to two pivotal factors: unavoidable motion errors and misalignment in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Guangyang Wu , Xin Tao , Changlin Li , Wenyi Wang , Xiaohong Liu , Qingqing Zheng

Video frame interpolation, the task of synthesizing new frames in between two or more given ones, is becoming an increasingly popular research target. However, the current evaluation of frame interpolation techniques is not ideal. Due to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Simon Kiefhaber , Simon Niklaus , Feng Liu , Simone Schaub-Meyer

Video Frame Interpolation (VFI) aims to generate intermediate video frames between consecutive input frames. Since the event cameras are bio-inspired sensors that only encode brightness changes with a micro-second temporal resolution,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Taewoo Kim , Yujeong Chae , Hyun-Kurl Jang , Kuk-Jin Yoon

Video frame interpolation (VFI) aims to generate predictive frames by warping learnable motions from the bidirectional historical references. Most existing works utilize spatio-temporal semantic information extractor to realize motion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Meiqin Liu , Chenming Xu , Chao Yao , Chunyu Lin , Yao Zhao

In general, deep learning-based video frame interpolation (VFI) methods have predominantly focused on estimating motion vectors between two input frames and warping them to the target time. While this approach has shown impressive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Jaemin Lee , Minseok Seo , Sangwoo Lee , Hyobin Park , Dong-Geol Choi

Deep learning based video frame interpolation (VIF) method, aiming to synthesis the intermediate frames to enhance video quality, have been highly developed in the past few years. This paper investigates the adversarial robustness of VIF…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Junpei Liao , Zhikai Chen , Liang Yi , Wenyuan Yang , Baoyuan Wu , Xiaochun Cao

With the advancement of AIGC, video frame interpolation (VFI) has become a crucial component in existing video generation frameworks, attracting widespread research interest. For the VFI task, the motion estimation between neighboring…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Zhilin Huang , Yijie Yu , Ling Yang , Chujun Qin , Bing Zheng , Xiawu Zheng , Zikun Zhou , Yaowei Wang , Wenming Yang

Video prediction is an extrapolation task that predicts future frames given past frames, and video frame interpolation is an interpolation task that estimates intermediate frames between two frames. We have witnessed the tremendous…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Yue Wu , Qiang Wen , Qifeng Chen

Video frame interpolation can up-convert the frame rate and enhance the video quality. In recent years, although the interpolation performance has achieved great success, image blur usually occurs at the object boundaries owing to the large…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Bin Zhao , Xuelong Li

The problem of video inter-frame interpolation is an essential task in the field of image processing. Correctly increasing the number of frames in the recording while maintaining smooth movement allows to improve the quality of played video…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Malwina Kubas , Grzegorz Sarwas

Utilization of event-based cameras is expected to improve the visual quality of video frame interpolation solutions. We introduce a learning-based method to exploit moving region boundaries in a video sequence to increase the overall…

Image and Video Processing · Electrical Eng. & Systems 2023-03-06 Ahmet Akman , Onur Selim Kılıç , A. Aydın Alatan

Capitalizing on the rapid development of neural networks, recent video frame interpolation (VFI) methods have achieved notable improvements. However, they still fall short for real-world videos containing large motions. Complex deformation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Changlin Li , Guangyang Wu , Yanan Sun , Xin Tao , Chi-Keung Tang , Yu-Wing Tai

Existing video frame interpolation (VFI) methods often adopt a frame-centric approach, processing videos as independent short segments (e.g., triplets), which leads to temporal inconsistencies and motion artifacts. To overcome this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Xinyu Peng , Han Li , Yuyang Huang , Ziyang Zheng , Yaoming Wang , Xin Chen , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong

Recently, video frame interpolation using a combination of frame- and event-based cameras has surpassed traditional image-based methods both in terms of performance and memory efficiency. However, current methods still suffer from (i)…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Stepan Tulyakov , Alfredo Bochicchio , Daniel Gehrig , Stamatios Georgoulis , Yuanyou Li , Davide Scaramuzza

Video frame interpolation (VFI) is currently a very active research topic, with applications spanning computer vision, post production and video encoding. VFI can be extremely challenging, particularly in sequences containing large motions,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Duolikun Danier , Fan Zhang , David Bull

Video frame interpolation (VFI) is one of the fundamental research areas in video processing and there has been extensive research on novel and enhanced interpolation algorithms. The same is not true for quality assessment of the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Duolikun Danier , Fan Zhang , David Bull