English
Related papers

Related papers: Blurry Video Frame Interpolation

200 papers

Video frame interpolation can up-convert the frame rate and enhance the video quality. In recent years, although the interpolation performance has achieved great success, image blur usually occurs at the object boundaries owing to the large…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Bin Zhao , Xuelong Li

Video frame interpolation (VFI) is a challenging task that aims to generate intermediate frames between two consecutive frames in a video. Existing learning-based VFI methods have achieved great success, but they still suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Haoning Wu , Xiaoyun Zhang , Weidi Xie , Ya Zhang , Yanfeng Wang

We propose a novel video frame interpolation algorithm based on asymmetric bilateral motion estimation (ABME), which synthesizes an intermediate frame between two input frames. First, we predict symmetric bilateral motion fields to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Junheum Park , Chul Lee , Chang-Su Kim

We present a frame interpolation algorithm that synthesizes multiple intermediate frames from two input images with large in-between motion. Recent methods use multiple networks to estimate optical flow or depth and a separate network…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Fitsum Reda , Janne Kontkanen , Eric Tabellion , Deqing Sun , Caroline Pantofaru , Brian Curless

The problem of video frame interpolation is to increase the temporal resolution of a low frame-rate video, by interpolating novel frames between existing temporally sparse frames. This paper presents a self-supervised approach to video…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Ziang Cheng , Shihao Jiang , Hongdong Li

Existing video frame interpolation methods can only interpolate the frame at a given intermediate time-step, e.g. 1/2. In this paper, we aim to explore a more generalized kind of video frame interpolation, that at an arbitrary time-step. To…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Shixing Yu , Yiyang Ma , Wenhan Yang , Wei Xiang , Jiaying Liu

Prevailing video frame interpolation algorithms, that generate the intermediate frames from consecutive inputs, typically rely on complex model architectures with heavy parameters or large delay, hindering them from diverse real-time…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Lingtong Kong , Boyuan Jiang , Donghao Luo , Wenqing Chu , Xiaoming Huang , Ying Tai , Chengjie Wang , Jie Yang

In recent years, consumer-level depth cameras have been adopted for various applications. However, they often produce depth maps at only a moderately high frame rate (approximately 30 frames per second), preventing them from being used for…

Graphics · Computer Science 2018-11-06 Ming-Ze Yuan , Lin Gao , Hongbo Fu , Shihong Xia

Research on video frame interpolation has made significant progress in recent years. However, existing methods mostly use off-the-shelf metrics to measure the quality of interpolation results with the exception of a few methods that employ…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Qiqi Hou , Abhijay Ghildyal , Feng Liu

Learning to synthesize high frame rate videos via interpolation requires large quantities of high frame rate training videos, which, however, are scarce, especially at high resolutions. Here, we propose unsupervised techniques to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Fitsum A. Reda , Deqing Sun , Aysegul Dundar , Mohammad Shoeybi , Guilin Liu , Kevin J. Shih , Andrew Tao , Jan Kautz , Bryan Catanzaro

For the success of video deblurring, it is essential to utilize information from neighboring frames. Most state-of-the-art video deblurring methods adopt motion compensation between video frames to aggregate information from multiple frames…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Hyeongseok Son , Junyong Lee , Jonghyeop Lee , Sunghyun Cho , Seungyong Lee

Natural videos captured by consumer cameras often suffer from low framerate and motion blur due to the combination of dynamic scene complexity, lens and sensor imperfection, and less than ideal exposure setting. As a result, computational…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Wei Shang , Dongwei Ren , Yi Yang , Hongzhi Zhang , Kede Ma , Wangmeng Zuo

We propose the first deep learning solution to video frame inpainting, a challenging instance of the general video inpainting problem with applications in video editing, manipulation, and forensics. Our task is less ambiguous than frame…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ximeng Sun , Ryan Szeto , Jason J. Corso

Video deblurring aims to enhance the quality of restored results in motion-blurred videos by effectively gathering information from adjacent video frames to compensate for the insufficient data in a single blurred frame. However, when faced…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Taewoo Kim , Hoonhee Cho , Kuk-Jin Yoon

Recently, flow-based frame interpolation methods have achieved great success by first modeling optical flow between target and input frames, and then building synthesis network for target frame generation. However, above cascaded…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Lingtong Kong , Jinfeng Liu , Jie Yang

We present a technique for synthesizing a motion blurred image from a pair of unblurred images captured in succession. To build this system we motivate and design a differentiable "line prediction" layer to be used as part of a neural…

Computer Vision and Pattern Recognition · Computer Science 2019-06-21 Tim Brooks , Jonathan T. Barron

For video frame interpolation (VFI), existing deep-learning-based approaches strongly rely on the ground-truth (GT) intermediate frames, which sometimes ignore the non-unique nature of motion judging from the given adjacent frames. As a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Kun Zhou , Wenbo Li , Xiaoguang Han , Jiangbo Lu

Most approaches for video frame interpolation require accurate dense correspondences to synthesize an in-between frame. Therefore, they do not perform well in challenging scenarios with e.g. lighting changes or motion blur. Recent deep…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Simone Meyer , Abdelaziz Djelouah , Brian McWilliams , Alexander Sorkine-Hornung , Markus Gross , Christopher Schroers

Existing video frame interpolation (VFI) methods blindly predict where each object is at a specific timestep t ("time indexing"), which struggles to predict precise object movements. Given two images of a baseball, there are infinitely many…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhihang Zhong , Yiming Zhang , Wei Wang , Xiao Sun , Yu Qiao , Gurunandan Krishnan , Sizhuo Ma , Jian Wang

The problem of video inter-frame interpolation is an essential task in the field of image processing. Correctly increasing the number of frames in the recording while maintaining smooth movement allows to improve the quality of played video…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Malwina Kubas , Grzegorz Sarwas