English
Related papers

Related papers: FastRIFE: Optimization of Real-Time Intermediate F…

200 papers

Video frame interpolation (VFI) aims to improve the temporal resolution of a video sequence. Most of the existing deep learning based VFI methods adopt off-the-shelf optical flow algorithms to estimate the bidirectional flows and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Tao Yang , Peiran Ren , Xuansong Xie , Xiansheng Hua , Lei Zhang

We propose the first deep learning solution to video frame inpainting, a challenging instance of the general video inpainting problem with applications in video editing, manipulation, and forensics. Our task is less ambiguous than frame…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ximeng Sun , Ryan Szeto , Jason J. Corso

LiDAR point cloud frame interpolation, which synthesizes the intermediate frame between the captured frames, has emerged as an important issue for many applications. Especially for reducing the amounts of point cloud transmission, it is by…

Image and Video Processing · Electrical Eng. & Systems 2021-10-14 Lili Zhao , Zezhi Zhu , Xuhu Lin , Xuezhou Guo , Qian Yin , Wenyi Wang , Jianwen Chen

In this paper, we propose a novel motion-compensated frame rate up-conversion (MC-FRUC) algorithm. The proposed algorithm creates interpolated frames by first estimating motion vectors using unilateral (jointing forward and backward) and…

Image and Video Processing · Electrical Eng. & Systems 2022-03-09 Hanieh Naderi , Mohammad Rahmati

Video frame interpolation (VFI) aims to generate predictive frames by warping learnable motions from the bidirectional historical references. Most existing works utilize spatio-temporal semantic information extractor to realize motion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Meiqin Liu , Chenming Xu , Chao Yao , Chunyu Lin , Yao Zhao

Flow-based frame interpolation methods ensure motion stability through estimated intermediate flow but often introduce severe artifacts in complex motion regions. Recent generative approaches, boosted by large-scale pre-trained video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Guozhen Zhang , Yuhan Zhu , Yutao Cui , Xiaotong Zhao , Kai Ma , Limin Wang

Standard video frame interpolation methods first estimate optical flow between input frames and then synthesize an intermediate frame guided by motion. Recent approaches merge these two steps into a single convolution process by convolving…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Simon Niklaus , Long Mai , Feng Liu

Optical Flow algorithms are of high importance for many applications. Recently, the Flow Field algorithm and its modifications have shown remarkable results, as they have been evaluated with top accuracy on different data sets. In our…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 René Schuster , Christian Bailer , Oliver Wasenmüller , Didier Stricker

Video Frame Interpolation (VFI) remains a cornerstone in video enhancement, enabling temporal upscaling for tasks like slow-motion rendering, frame rate conversion, and video restoration. While classical methods rely on optical flow and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Priyansh Srivastava , Romit Chatterjee , Abir Sen , Aradhana Behura , Ratnakar Dash

There has been a growing trend in compressing and transmitting videos from terminals for machine vision tasks. Nevertheless, most video coding optimization method focus on minimizing distortion according to human perceptual metrics,…

Multimedia · Computer Science 2025-12-18 Fei Zhao , Mengxi Guo , Shijie Zhao , Junlin Li , Li Zhang , Xiaodong Xie

Video frame interpolation algorithms typically estimate optical flow or its variations and then use it to guide the synthesis of an intermediate frame between two consecutive original frames. To handle challenges like occlusion,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Simon Niklaus , Feng Liu

Video Frame Interpolation (VFI) aims to synthesize intermediate frames between existing frames to enhance visual smoothness and quality. Beyond the conventional methods based on the reconstruction loss, recent works have employed generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jaihyun Lew , Jooyoung Choi , Chaehun Shin , Dahuin Jung , Sungroh Yoon

High-refresh rate displays have become very popular in recent years due to the need for superior visual quality in gaming, professional displays and specialized applications like medical imaging. However, high-refresh rate displays alone do…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Akanksha Dixit , Smruti R. Sarangi

Fluorescence microscopy is widely employed for the analysis of living biological samples; however, the utility of the resulting recordings is frequently constrained by noise, temporal variability, and inconsistent visualisation of signals…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Hassan Eshkiki , Sarah Costa , Mostafa Mohammadpour , Farinaz Tanhaei , Christopher H. George , Fabio Caraffini

Generating intermediate video content of varying lengths based on given first and last frames, along with text prompt information, offers significant research and application potential. However, traditional frame interpolation tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yijia Hong , Jiangning Zhang , Ran Yi , Yuji Wang , Weijian Cao , Xiaobin Hu , Zhucun Xue , Yabiao Wang , Chengjie Wang , Lizhuang Ma

Video frame interpolation (VFI) is one of the fundamental research areas in video processing and there has been extensive research on novel and enhanced interpolation algorithms. The same is not true for quality assessment of the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Duolikun Danier , Fan Zhang , David Bull

Video generation has made significant strides with the development of diffusion models; however, achieving high temporal consistency remains a challenging task. Recently, FreeInit identified a training-inference gap and introduced a method…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Chengyu Bai , Yuming Li , Zhongyu Zhao , Jintao Chen , Peidong Jia , Qi She , Ming Lu , Shanghang Zhang

An ever increasing amount of our digital communication, media consumption, and content creation revolves around videos. We share, watch, and archive many aspects of our lives through them, all of which are powered by strong video…

Computer Vision and Pattern Recognition · Computer Science 2018-04-20 Chao-Yuan Wu , Nayan Singhal , Philipp Krähenbühl

In video super-resolution, it is common to use a frame-wise alignment to support the propagation of information over time. The role of alignment is well-studied for low-level enhancement in video, but existing works overlook a critical step…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Kai Xu , Ziwei Yu , Xin Wang , Michael Bi Mi , Angela Yao

Temporal interpolation has the potential to be a powerful tool for video compression. Existing methods for frame interpolation do not discriminate between video textures and generally invoke a single general model capable of interpolating a…

Image and Video Processing · Electrical Eng. & Systems 2021-08-23 Duolikun Danier , David Bull