English
Related papers

Related papers: Enhancing Deformable Convolution based Video Frame…

200 papers

Video interpolation aims to generate a non-existent intermediate frame given the past and future frames. Many state-of-the-art methods achieve promising results by estimating the optical flow between the known frames and then generating the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Zhiqi Chen , Ran Wang , Haojie Liu , Yao Wang

Video frame interpolation methodologies endeavor to create novel frames betwixt extant ones, with the intent of augmenting the video's frame frequency. However, current methods are prone to image blurring and spurious artifacts in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Pengfei Han , Fuhua Zhang , Bin Zhao , Xuelong Li

Video frame interpolation, the synthesis of novel views in time, is an increasingly popular research direction with many new papers further advancing the state of the art. But as each new method comes with a host of variables that affect…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Simon Niklaus , Long Mai , Oliver Wang

Video frame interpolation (VFI) works generally predict intermediate frame(s) by first estimating the motion between inputs and then warping the inputs to the target time with the estimated motion. This approach, however, is not optimal…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Dawit Mureja Argaw , In So Kweon

Standard video frame interpolation methods first estimate optical flow between input frames and then synthesize an intermediate frame guided by motion. Recent approaches merge these two steps into a single convolution process by convolving…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Simon Niklaus , Long Mai , Feng Liu

Deep learning methods are powerful tools but often suffer from expensive computation and limited flexibility. An alternative is to combine light-weight models with deep representations. As successful cases exist in several visual problems,…

Computer Vision and Pattern Recognition · Computer Science 2015-09-25 Bin Yang , Junjie Yan , Zhen Lei , Stan Z. Li

Existing video frame interpolation (VFI) methods often adopt a frame-centric approach, processing videos as independent short segments (e.g., triplets), which leads to temporal inconsistencies and motion artifacts. To overcome this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Xinyu Peng , Han Li , Yuyang Huang , Ziyang Zheng , Yaoming Wang , Xin Chen , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong

Currently, one of the major challenges in deep learning-based video frame interpolation (VFI) is the large model sizes and high computational complexity associated with many high performance VFI approaches. In this paper, we present a…

Image and Video Processing · Electrical Eng. & Systems 2023-02-24 Crispian Morris , Duolikun Danier , Fan Zhang , Nantheera Anantrasirichai , David R. Bull

Deep learning has shown great potential in image and video compression tasks. However, it brings bit savings at the cost of significant increases in coding complexity, which limits its potential for implementation within practical…

Image and Video Processing · Electrical Eng. & Systems 2021-05-28 Luka Murn , Saverio Blasi , Alan F. Smeaton , Noel E. O'Connor , Marta Mrak

Video frame interpolation (VFI) is the task that synthesizes the intermediate frame given two consecutive frames. Most of the previous studies have focused on appropriate frame warping operations and refinement modules for the warped…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Sangjin Lee , Hyeongmin Lee , Chajin Shin , Hanbin Son , Sangyoun Lee

Video frame interpolation(VFI) has witnessed great progress in recent years. While existing VFI models still struggle to achieve a good trade-off between accuracy and efficiency: fast models often have inferior accuracy; accurate models…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Ban Chen , Xin Jin , Youxin Chen , Longhai Wu , Jie Chen , Jayoon Koo , Cheul-hee Hahm

To achieve higher coding efficiency, Versatile Video Coding (VVC) includes several novel components, but at the expense of increasing decoder computational complexity. These technologies at a low bit rate often create contouring and ringing…

Image and Video Processing · Electrical Eng. & Systems 2021-05-27 Shiba Kuanar , Dwarikanath Mahapatra , Vassilis Athitsos , K. R Rao

While current multi-frame restoration methods combine information from multiple input images using 2D alignment techniques, recent advances in novel view synthesis are paving the way for a new paradigm relying on volumetric scene…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Thomas Tanay , Aleš Leonardis , Matteo Maggioni

Video frame interpolation aims to generate high-quality intermediate frames from boundary frames and increase frame rate. While existing linear, symmetric and nonlinear models are used to bridge the gap from the lack of inter-frame motion,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Chenyang Shi , Hanxiao Liu , Jing Jin , Wenzhuo Li , Yuzhen Li , Boyi Wei , Yibo Zhang

Video frame interpolation involves the synthesis of new frames from existing ones. Convolutional neural networks (CNNs) have been at the forefront of the recent advances in this field. One popular CNN-based approach involves the application…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Issa Khalifeh , Marc Gorriz Blanch , Ebroul Izquierdo , Marta Mrak

Video frame interpolation (VFI) aims to generate predictive frames by warping learnable motions from the bidirectional historical references. Most existing works utilize spatio-temporal semantic information extractor to realize motion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Meiqin Liu , Chenming Xu , Chao Yao , Chunyu Lin , Yao Zhao

Video Frame Interpolation (VFI) aims to synthesize intermediate frames between existing frames to enhance visual smoothness and quality. Beyond the conventional methods based on the reconstruction loss, recent works have employed generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jaihyun Lew , Jooyoung Choi , Chaehun Shin , Dahuin Jung , Sungroh Yoon

Deep Convolutional Neural Networks (CNNs) are powerful models that have achieved excellent performance on difficult computer vision tasks. Although CNNs perform well whenever large labeled training samples are available, they work badly on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 Zhouyong Liu , Shun Luo , Wubin Li , Jingben Lu , Yufan Wu , Shilei Sun , Chunguo Li , Luxi Yang

Video Frame Interpolation aims to recover realistic missing frames between observed frames, generating a high-frame-rate video from a low-frame-rate video. However, without additional guidance, the large motion between frames makes this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jingxi Chen , Brandon Y. Feng , Haoming Cai , Tianfu Wang , Levi Burner , Dehao Yuan , Cornelia Fermuller , Christopher A. Metzler , Yiannis Aloimonos

Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored. Due to the selective transmission of light by polarized filters, longer exposure times are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Feng Huang , Xin Zhang , Yixuan Xu , Xuesong Wang , Xianyu Wu