English
Related papers

Related papers: Motion-blurred Video Interpolation and Extrapolati…

200 papers

Existing video frame interpolation methods can only interpolate the frame at a given intermediate time-step, e.g. 1/2. In this paper, we aim to explore a more generalized kind of video frame interpolation, that at an arbitrary time-step. To…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Shixing Yu , Yiyang Ma , Wenhan Yang , Wei Xiang , Jiaying Liu

Video frame interpolation typically involves two steps: motion estimation and pixel synthesis. Such a two-step approach heavily depends on the quality of motion estimation. This paper presents a robust video frame interpolation method that…

Computer Vision and Pattern Recognition · Computer Science 2017-03-23 Simon Niklaus , Long Mai , Feng Liu

Given two consecutive frames, video interpolation aims at generating intermediate frame(s) to form both spatially and temporally coherent video sequences. While most existing methods focus on single-frame interpolation, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Huaizu Jiang , Deqing Sun , Varun Jampani , Ming-Hsuan Yang , Erik Learned-Miller , Jan Kautz

Blurry video frame interpolation (BVFI) aims to generate high-frame-rate clear videos from low-frame-rate blurry videos, is a challenging but important topic in the computer vision community. Blurry videos not only provide spatial and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Pengcheng Lei , Zaoming Yan , Tingting Wang , Faming Fang , Guixu Zhang

Slow motion videos are becoming increasingly popular, but capturing high-resolution videos at extremely high frame rates requires professional high-speed cameras. To mitigate this problem, current techniques increase the frame rate of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Avinash Paliwal , Nima Khademi Kalantari

We present a simple and effective deep convolutional neural network (CNN) model for video deblurring. The proposed algorithm mainly consists of optical flow estimation from intermediate latent frames and latent frame restoration steps. It…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Jinshan Pan , Haoran Bai , Jinhui Tang

Video Frame Interpolation synthesizes non-existent images between adjacent frames, with the aim of providing a smooth and consistent visual experience. Two approaches for solving this challenging task are optical flow based and kernel-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Xi Li , Meng Cao , Yingying Tang , Scott Johnston , Zhendong Hong , Huimin Ma , Jiulong Shan

Moving objects are frequently seen in daily life and usually appear blurred in images due to their motion. While general object retrieval is a widely explored area in computer vision, it primarily focuses on sharp and static objects, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Rong Zou , Marc Pollefeys , Denys Rozumnyi

We address the novel task of jointly reconstructing the 3D shape, texture, and motion of an object from a single motion-blurred image. While previous approaches address the deblurring problem only in the 2D image domain, our proposed…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Denys Rozumnyi , Martin R. Oswald , Vittorio Ferrari , Marc Pollefeys

In this paper, we present a new inpainting framework for recovering missing regions of video frames. Compared with image inpainting, performing this task on video presents new challenges such as how to preserving temporal consistency and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Yifan Ding , Chuan Wang , Haibin Huang , Jiaming Liu , Jue Wang , Liqiang Wang

We present a technique for synthesizing a motion blurred image from a pair of unblurred images captured in succession. To build this system we motivate and design a differentiable "line prediction" layer to be used as part of a neural…

Computer Vision and Pattern Recognition · Computer Science 2019-06-21 Tim Brooks , Jonathan T. Barron

Recovering sharp video sequence from a motion-blurred image is highly ill-posed due to the significant loss of motion information in the blurring process. For event-based cameras, however, fast motion can be captured as events at high time…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Zhe Jiang , Yu Zhang , Dongqing Zou , Jimmy Ren , Jiancheng Lv , Yebin Liu

Several state-of-the-art video deblurring methods are based on a strong assumption that the captured scenes are static. These methods fail to deblur blurry videos in dynamic scenes. We propose a video deblurring method to deal with general…

Computer Vision and Pattern Recognition · Computer Science 2015-07-10 Tae Hyun Kim , Kyoung Mu Lee

Video frame interpolation, the synthesis of novel views in time, is an increasingly popular research direction with many new papers further advancing the state of the art. But as each new method comes with a host of variables that affect…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Simon Niklaus , Long Mai , Oliver Wang

Most deep learning methods for video frame interpolation consist of three main components: feature extraction, motion estimation, and image synthesis. Existing approaches are mainly distinguishable in terms of how these modules are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Moritz Nottebaum , Stefan Roth , Simone Schaub-Meyer

State-of-the-art frame interpolation methods generate intermediate frames by inferring object motions in the image from consecutive key-frames. In the absence of additional information, first-order approximations, i.e. optical flow, must be…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Stepan Tulyakov , Daniel Gehrig , Stamatios Georgoulis , Julius Erbach , Mathias Gehrig , Yuanyou Li , Davide Scaramuzza

Motion blur from camera shake is a major problem in videos captured by hand-held devices. Unlike single-image deblurring, video-based approaches can take advantage of the abundant information that exists across neighboring frames. As a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-28 Shuochen Su , Mauricio Delbracio , Jue Wang , Guillermo Sapiro , Wolfgang Heidrich , Oliver Wang

In most of computer vision applications, motion blur is regarded as an undesirable artifact. However, it has been shown that motion blur in an image may have practical interests in fundamental computer vision problems. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Dawit Mureja Argaw , Junsik Kim , Francois Rameau , Jae Won Cho , In So Kweon

We present a deblurring method for scenes with occluding objects using a carefully designed layered blur model. Layered blur model is frequently used in the motion deblurring problem to handle locally varying blurs, which is caused by…

Computer Vision and Pattern Recognition · Computer Science 2016-11-30 Byeongjoo Ahn , Tae Hyun Kim , Wonsik Kim , Kyoung Mu Lee

State-of-the-art video deblurring methods cannot handle blurry videos recorded in dynamic scenes, since they are built under a strong assumption that the captured scenes are static. Contrary to the existing methods, we propose a video…

Computer Vision and Pattern Recognition · Computer Science 2016-03-15 Tae Hyun Kim , Seungjun Nah , Kyoung Mu Lee