English
Related papers

Related papers: E-VFIA : Event-Based Video Frame Interpolation wit…

200 papers

Video Frame Interpolation (VFI) aims to synthesize intermediate frames between existing frames to enhance visual smoothness and quality. Beyond the conventional methods based on the reconstruction loss, recent works have employed generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jaihyun Lew , Jooyoung Choi , Chaehun Shin , Dahuin Jung , Sungroh Yoon

This paper presents a new deformable convolution-based video frame interpolation (VFI) method, using a coarse to fine 3D CNN to enhance the multi-flow prediction. This model first extracts spatio-temporal features at multiple scales using a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Duolikun Danier , Fan Zhang , David Bull

Dynamic vision sensors or event cameras provide rich complementary information for video frame interpolation. Existing state-of-the-art methods follow the paradigm of combining both synthesis-based and warping networks. However, few of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jiaben Chen , Yichen Zhu , Dongze Lian , Jiaqi Yang , Yifu Wang , Renrui Zhang , Xinhang Liu , Shenhan Qian , Laurent Kneip , Shenghua Gao

State-of-the-art frame interpolation methods generate intermediate frames by inferring object motions in the image from consecutive key-frames. In the absence of additional information, first-order approximations, i.e. optical flow, must be…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Stepan Tulyakov , Daniel Gehrig , Stamatios Georgoulis , Julius Erbach , Mathias Gehrig , Yuanyou Li , Davide Scaramuzza

In this paper, we firstly present a dataset (X4K1000FPS) of 4K videos of 1000 fps with the extreme motion to the research community for video frame interpolation (VFI), and propose an extreme VFI network, called XVFI-Net, that first handles…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Hyeonjun Sim , Jihyong Oh , Munchurl Kim

Video frame interpolation (VFI) aims to improve the temporal resolution of a video sequence. Most of the existing deep learning based VFI methods adopt off-the-shelf optical flow algorithms to estimate the bidirectional flows and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Tao Yang , Peiran Ren , Xuansong Xie , Xiansheng Hua , Lei Zhang

Deep learning based video frame interpolation (VIF) method, aiming to synthesis the intermediate frames to enhance video quality, have been highly developed in the past few years. This paper investigates the adversarial robustness of VIF…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Junpei Liao , Zhikai Chen , Liang Yi , Wenyuan Yang , Baoyuan Wu , Xiaochun Cao

Large pre-trained video diffusion models excel in video frame interpolation but struggle to generate high fidelity frames due to reliance on intrinsic generative priors, limiting detail preservation from start and end frames. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Ganggui Ding , Hao Chen , Xiaogang Xu

Video frame interpolation typically involves two steps: motion estimation and pixel synthesis. Such a two-step approach heavily depends on the quality of motion estimation. This paper presents a robust video frame interpolation method that…

Computer Vision and Pattern Recognition · Computer Science 2017-03-23 Simon Niklaus , Long Mai , Feng Liu

Video frame interpolation aims to synthesize nonexistent frames in-between the original frames. While significant advances have been made from the recent deep convolutional neural networks, the quality of interpolation is often reduced due…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Wenbo Bao , Wei-Sheng Lai , Chao Ma , Xiaoyun Zhang , Zhiyong Gao , Ming-Hsuan Yang

Standard video frame interpolation methods first estimate optical flow between input frames and then synthesize an intermediate frame guided by motion. Recent approaches merge these two steps into a single convolution process by convolving…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Simon Niklaus , Long Mai , Feng Liu

Frame-based cameras with extended exposure times often produce perceptible visual blurring and information loss between frames, significantly degrading video quality. To address this challenge, we introduce EVDI++, a unified self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Chi Zhang , Xiang Zhang , Chenxu Jiang , Gui-Song Xia , Lei Yu

Recently, video frame interpolation using a combination of frame- and event-based cameras has surpassed traditional image-based methods both in terms of performance and memory efficiency. However, current methods still suffer from (i)…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Stepan Tulyakov , Alfredo Bochicchio , Daniel Gehrig , Stamatios Georgoulis , Yuanyou Li , Davide Scaramuzza

Video frame interpolation has been actively studied with the development of convolutional neural networks. However, due to the intrinsic limitations of kernel weight sharing in convolution, the interpolated frame generated by it may lose…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Pan Gao , Haoyue Tian , Jie Qin

Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored. Due to the selective transmission of light by polarized filters, longer exposure times are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Feng Huang , Xin Zhang , Yixuan Xu , Xuesong Wang , Xianyu Wu

Video frame interpolation, the synthesis of novel views in time, is an increasingly popular research direction with many new papers further advancing the state of the art. But as each new method comes with a host of variables that affect…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Simon Niklaus , Long Mai , Oliver Wang

Video frame interpolation (VFI) offers a way to generate intermediate frames between consecutive frames of a video sequence. Although the development of advanced frame interpolation algorithms has received increased attention in recent…

Image and Video Processing · Electrical Eng. & Systems 2025-09-19 Conall Daly , Darren Ramsook , Anil Kokaram

Existing methods for video interpolation heavily rely on deep convolution neural networks, and thus suffer from their intrinsic limitations, such as content-agnostic kernel weights and restricted receptive field. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhihao Shi , Xiangyu Xu , Xiaohong Liu , Jun Chen , Ming-Hsuan Yang

Visual Deformation Measurement (VDM) aims to recover dense deformation fields by tracking surface motion from camera observations. Traditional image-based methods rely on minimal inter-frame motion to constrain the correspondence search…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yuliang Wu , Wei Zhai , Yuxin Cui , Tiesong Zhao , Yang Cao , Zheng-Jun Zha

Slow shutter speed and long exposure time of frame-based cameras often cause visual blur and loss of inter-frame information, degenerating the overall quality of captured videos. To this end, we present a unified framework of event-based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Xiang Zhang , Lei Yu