English
Related papers

Related papers: Video Interpolation using Optical Flow and Laplaci…

200 papers

In recent years, consumer-level depth cameras have been adopted for various applications. However, they often produce depth maps at only a moderately high frame rate (approximately 30 frames per second), preventing them from being used for…

Graphics · Computer Science 2018-11-06 Ming-Ze Yuan , Lin Gao , Hongbo Fu , Shihong Xia

This paper presents a novel architecture for simultaneous estimation of highly accurate optical flows and rigid scene transformations for difficult scenarios where the brightness assumption is violated by strong shading changes. In the case…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Torben Fetzer , Gerd Reis , Didier Stricker

This paper presents a new deformable convolution-based video frame interpolation (VFI) method, using a coarse to fine 3D CNN to enhance the multi-flow prediction. This model first extracts spatio-temporal features at multiple scales using a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Duolikun Danier , Fan Zhang , David Bull

Real-time motion detection in non-stationary scenes is a difficult task due to dynamic background, changing foreground appearance and limited computational resource. These challenges degrade the performance of the existing methods in…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Junjie Huang , Wei Zou , Zheng Zhu , Jiagang Zhu

In this paper, we proposed an unsupervised learning method for estimating the optical flow between video frames, especially to solve the occlusion problem. Occlusion is caused by the movement of an object or the movement of the camera,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Jianfeng Li , Junqiao Zhao , Tiantian Feng , Chen Ye , Lu Xiong

Video frame interpolation is one of the most challenging tasks in video processing research. Recently, many studies based on deep learning have been suggested. Most of these methods focus on finding locations with useful information to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Hyeongmin Lee , Taeoh Kim , Tae-young Chung , Daehyun Pak , Yuseok Ban , Sangyoun Lee

Video frame interpolation (VFI) is a challenging task that aims to generate intermediate frames between two consecutive frames in a video. Existing learning-based VFI methods have achieved great success, but they still suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Haoning Wu , Xiaoyun Zhang , Weidi Xie , Ya Zhang , Yanfeng Wang

We extend the concept of optical flow to a dynamic non-Euclidean setting. Optical flow is traditionally computed from a sequence of flat images. It is the purpose of this paper to introduce variational motion estimation for images that are…

Optimization and Control · Mathematics 2013-05-22 Clemens Kirisits , Lukas F. Lang , Otmar Scherzer

An improved numerical solver for the unified solution of compressible and incompressible fluids involving interfaces is proposed. The present method is based on the CIP-CUP (Cubic Interpolated Propagation / Combined, Unified Procedure)…

Computational Physics · Physics 2007-05-23 Masato Ida

Generating non-existing frames from a consecutive video sequence has been an interesting and challenging problem in the video processing field. Typical kernel-based interpolation methods predict pixels with a single convolution process that…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Xianhang Cheng , Zhenzhong Chen

Optical flow is a powerful tool for the study and analysis of motion in a sequence of images. In this article we study a Horn-Schunck type spatio-temporal regularization functional for image sequences that have a non-Euclidean, time varying…

Numerical Analysis · Mathematics 2014-10-02 Martin Bauer , Markus Grasmair , Clemens Kirisits

Neural implicit surfaces have become an important technique for multi-view 3D reconstruction but their accuracy remains limited. In this paper, we argue that this comes from the difficulty to learn and render high frequency textures with…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 François Darmon , Bénédicte Bascle , Jean-Clément Devaux , Pascal Monasse , Mathieu Aubry

Infrared and visible image fusion aims to generate synthetic images simultaneously containing salient features and rich texture details, which can be used to boost downstream tasks. However, existing fusion methods are suffering from the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Hui Li , Yongbiao Xiao , Chunyang Cheng , Zhongwei Shen , Xiaoning Song

Imposing consistency through proxy tasks has been shown to enhance data-driven learning and enable self-supervision in various tasks. This paper introduces novel and effective consistency strategies for optical flow estimation, a problem…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Jisoo Jeong , Jamie Menjay Lin , Fatih Porikli , Nojun Kwak

Robust surfaces capable of reducing flow drag, controlling heat and mass transfer, and resisting fouling in fluid flows are important for various applications. In this context, textured surfaces impregnated with a liquid lubricant show…

Video denoising aims at removing noise from videos to recover clean ones. Some existing works show that optical flow can help the denoising by exploiting the additional spatial-temporal clues from nearby frames. However, the flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jiezhang Cao , Qin Wang , Jingyun Liang , Yulun Zhang , Kai Zhang , Radu Timofte , Luc Van Gool

State-of-the-art frame interpolation methods generate intermediate frames by inferring object motions in the image from consecutive key-frames. In the absence of additional information, first-order approximations, i.e. optical flow, must be…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Stepan Tulyakov , Daniel Gehrig , Stamatios Georgoulis , Julius Erbach , Mathias Gehrig , Yuanyou Li , Davide Scaramuzza

We present a diffusion-based image morphing approach with perceptually-uniform sampling (IMPUS) that produces smooth, direct and realistic interpolations given an image pair. The embeddings of two images may lie on distinct conditioned…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhaoyuan Yang , Zhengyang Yu , Zhiwei Xu , Jaskirat Singh , Jing Zhang , Dylan Campbell , Peter Tu , Richard Hartley

Reconstructing the 3D shape of a deformable environment from the information captured by a moving depth camera is highly relevant to surgery. The underlying challenge is the fact that simultaneously estimating camera motion and tissue…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Guido Caccianiga , Julian Nubert , Cesar Cadena , Marco Hutter , Katherine J. Kuchenbecker

This paper investigates a variational model for splines in the image metamorphosis model for the smooth interpolation of key frames in the space of images. The Riemannian manifold of images based on the metamorphosis model defines shortest…

Numerical Analysis · Mathematics 2024-02-28 Jorge Justiniano , Marko Rajković , Martin Rumpf