English
Related papers

Related papers: Quadratic video interpolation

200 papers

State-of-the-art frame interpolation methods generate intermediate frames by inferring object motions in the image from consecutive key-frames. In the absence of additional information, first-order approximations, i.e. optical flow, must be…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Stepan Tulyakov , Daniel Gehrig , Stamatios Georgoulis , Julius Erbach , Mathias Gehrig , Yuanyou Li , Davide Scaramuzza

Video frame interpolation can up-convert the frame rate and enhance the video quality. In recent years, although the interpolation performance has achieved great success, image blur usually occurs at the object boundaries owing to the large…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Bin Zhao , Xuelong Li

In this paper, we propose an algorithm to interpolate between a pair of images of a dynamic scene. While in the past years significant progress in frame interpolation has been made, current approaches are not able to handle images with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Pedro Figueirêdo , Avinash Paliwal , Nima Khademi Kalantari

Research on video frame interpolation has made significant progress in recent years. However, existing methods mostly use off-the-shelf metrics to measure the quality of interpolation results with the exception of a few methods that employ…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Qiqi Hou , Abhijay Ghildyal , Feng Liu

Video frame interpolation is a challenging task due to the ever-changing real-world scene. Previous methods often calculate the bi-directional optical flows and then predict the intermediate optical flows under the linear motion…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Song Wu , Kaichao You , Weihua He , Chen Yang , Yang Tian , Yaoyuan Wang , Ziyang Zhang , Jianxing Liao

Video frame interpolation (VFI) is a challenging task that aims to generate intermediate frames between two consecutive frames in a video. Existing learning-based VFI methods have achieved great success, but they still suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Haoning Wu , Xiaoyun Zhang , Weidi Xie , Ya Zhang , Yanfeng Wang

Video frame interpolation is a challenging problem because there are different scenarios for each video depending on the variety of foreground and background motion, frame rate, and occlusion. It is therefore difficult for a single network…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Myungsub Choi , Janghoon Choi , Sungyong Baik , Tae Hyun Kim , Kyoung Mu Lee

Temporal interpolation has the potential to be a powerful tool for video compression. Existing methods for frame interpolation do not discriminate between video textures and generally invoke a single general model capable of interpolating a…

Image and Video Processing · Electrical Eng. & Systems 2021-08-23 Duolikun Danier , David Bull

The problem of video frame interpolation is to increase the temporal resolution of a low frame-rate video, by interpolating novel frames between existing temporally sparse frames. This paper presents a self-supervised approach to video…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Ziang Cheng , Shihao Jiang , Hongdong Li

Slow shutter speed and long exposure time of frame-based cameras often cause visual blur and loss of inter-frame information, degenerating the overall quality of captured videos. To this end, we present a unified framework of event-based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Xiang Zhang , Lei Yu

Video frame interpolation is a classic and challenging low-level computer vision task. Recently, deep learning based methods have achieved impressive results, and it has been proven that optical flow based methods can synthesize frames with…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jinfeng Liu , Lingtong Kong , Jie Yang

As Deep Neural Networks are becoming more popular, much of the attention is being devoted to Computer Vision problems that used to be solved with more traditional approaches. Video frame interpolation is one of such challenges that has seen…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Mart Kartašev , Carlo Rapisarda , Dominik Fay

Video frame interpolation is an important low-level vision task, which can increase frame rate for more fluent visual experience. Existing methods have achieved great success by employing advanced motion models and synthesis networks.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Lingtong Kong , Boyuan Jiang , Donghao Luo , Wenqing Chu , Ying Tai , Chengjie Wang , Jie Yang

Video frame interpolation and prediction aim to synthesize frames in-between and subsequent to existing frames, respectively. Despite being closely-related, these two tasks are traditionally studied with different model architectures, or…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Xin Jin , Longhai Wu , Jie Chen , Ilhyun Cho , Cheul-Hee Hahm

We propose a novel DNN based framework called the Enhanced Correlation Matching based Video Frame Interpolation Network to support high resolution like 4K, which has a large scale of motion and occlusion. Considering the extensibility of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Sungho Lee , Narae Choi , Woong Il Choi

Motion-based video frame interpolation commonly relies on optical flow to warp pixels from the inputs to the desired interpolation instant. Yet due to the inherent challenges of motion estimation (e.g. occlusions and discontinuities), most…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Ping Hu , Simon Niklaus , Stan Sclaroff , Kate Saenko

Video frame interpolation (VFI), which aims to synthesize intermediate frames of a video, has made remarkable progress with development of deep convolutional networks over past years. Existing methods built upon convolutional networks…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Liying Lu , Ruizheng Wu , Huaijia Lin , Jiangbo Lu , Jiaya Jia

Natural videos captured by consumer cameras often suffer from low framerate and motion blur due to the combination of dynamic scene complexity, lens and sensor imperfection, and less than ideal exposure setting. As a result, computational…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Wei Shang , Dongwei Ren , Yi Yang , Hongzhi Zhang , Kede Ma , Wangmeng Zuo

We present a novel simple yet effective algorithm for motion-based video frame interpolation. Existing motion-based interpolation methods typically rely on a pre-trained optical flow model or a U-Net based pyramid network for motion…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Xin Jin , Longhai Wu , Guotao Shen , Youxin Chen , Jie Chen , Jayoon Koo , Cheul-hee Hahm

Differentiable image sampling in the form of backward warping has seen broad adoption in tasks like depth estimation and optical flow prediction. In contrast, how to perform forward warping has seen less attention, partly due to additional…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Simon Niklaus , Feng Liu