English
Related papers

Related papers: Unsupervised Deep Epipolar Flow for Stationary or …

200 papers

Scene flow estimation has been receiving increasing attention for 3D environment perception. Monocular scene flow estimation -- obtaining 3D structure and 3D motion from two temporally consecutive images -- is a highly ill-posed problem,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Junhwa Hur , Stefan Roth

In recent years, deep neural networks showed their exceeding capabilities in addressing many computer vision tasks including scene flow prediction. However, most of the advances are dependent on the availability of a vast amount of dense…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Katharina Bendig , René Schuster , Didier Stricker

Event cameras such as DAVIS can simultaneously output high temporal resolution events and low frame-rate intensity images, which own great potential in capturing scene motion, such as optical flow estimation. Most of the existing optical…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Zhexiong Wan , Yuchao Dai , Yuxin Mao

Accurate fall detection for the assistance of older people is crucial to reduce incidents of deaths or injuries due to falls. Meanwhile, a vision-based fall detection system has shown some significant results to detect falls. Still,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Sagar Chhetri , Abeer Alsadoon , Thair Al Dala in , P. W. C. Prasad , Tarik A. Rashid , Angelika Maag

We introduce a way to learn to estimate a scene representation from a single image by predicting a low-dimensional subspace of optical flow for each training example, which encompasses the variety of possible camera and object movement.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Richard Strong Bowen , Richard Tucker , Ramin Zabih , Noah Snavely

We propose a new self-supervised approach to image feature learning from motion cue. This new approach leverages recent advances in deep learning in two directions: 1) the success of training deep neural network in estimating optical flow…

Computer Vision and Pattern Recognition · Computer Science 2019-01-10 Bin Ma , Shubao Liu , Yingxuan Zhi , Qi Song

Understanding the flow in 3D space of sparsely sampled points between two consecutive time frames is the core stone of modern geometric-driven systems such as VR/AR, Robotics, and Autonomous driving. The lack of real, non-simulated, labeled…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Bojun Ouyang , Dan Raviv

We address the unsupervised learning of several interconnected problems in low-level vision: single view depth prediction, camera motion estimation, optical flow, and segmentation of a video into the static scene and moving regions. Our key…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Anurag Ranjan , Varun Jampani , Lukas Balles , Kihwan Kim , Deqing Sun , Jonas Wulff , Michael J. Black

We present DistillFlow, a knowledge distillation approach to learning optical flow. DistillFlow trains multiple teacher models and a student model, where challenging transformations are applied to the input of the student model to generate…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Pengpeng Liu , Michael R. Lyu , Irwin King , Jia Xu

Convolutional Neural Networks (CNN) have been found to have great potential in optical flow problems thanks to an abundance of data available for training a deep network. The displacement estimation step in UltraSound Elastography (USE) can…

Image and Video Processing · Electrical Eng. & Systems 2020-07-06 Ali K. Z. Tehrani , Morteza Mirzaei , Hassan Rivaz

We propose a novel approach for optical flow estimation , targeted at large displacements with significant oc-clusions. It consists of two steps: i) dense matching by edge-preserving interpolation from a sparse set of matches; ii)…

Computer Vision and Pattern Recognition · Computer Science 2015-05-20 Jerome Revaud , Philippe Weinzaepfel , Zaid Harchaoui , Cordelia Schmid

Extracting information on fluid motion directly from images is challenging. Fluid flow represents a complex dynamic system governed by the Navier-Stokes equations. General optical flow methods are typically designed for rigid body motion,…

Machine Learning · Computer Science 2022-06-23 Mingrui Zhang , Jianhong Wang , James Tlhomole , Matthew D. Piggott

Self-supervised monocular depth estimation enables robots to learn 3D perception from raw video streams. This scalable approach leverages projective geometry and ego-motion to learn via view synthesis, assuming the world is mostly static.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Vitor Guizilini , Kuan-Hui Lee , Rares Ambrus , Adrien Gaidon

In this work, we propose a method that combines unsupervised deep learning predictions for optical flow and monocular disparity with a model based optimization procedure for instantaneous camera pose. Given the flow and disparity…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Alex Zihao Zhu , Wenxin Liu , Ziyun Wang , Vijay Kumar , Kostas Daniilidis

Self-supervised deep learning-based 3D scene understanding methods can overcome the difficulty of acquiring the densely labeled ground-truth and have made a lot of advances. However, occlusions and moving objects are still some of the major…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Jiaojiao Fang , Guizhong Liu

End-to-end trained convolutional neural networks have led to a breakthrough in optical flow estimation. The most recent advances focus on improving the optical flow estimation by improving the architecture and setting a new benchmark on the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 D. B. de Jong , F. Paredes-Vallés , G. C. H. E. de Croon

We present a novel up-resing technique for generating high-resolution liquids based on scene flow estimation using deep neural networks. Our approach infers and synthesizes small- and large-scale details solely from a low-resolution…

Graphics · Computer Science 2021-12-15 Bruno Roy , Pierre Poulin , Eric Paquette

Computing optical flow is a fundamental problem in computer vision. However, deep learning-based optical flow techniques do not perform well for non-rigid movements such as those found in faces, primarily due to lack of the training data…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Muhannad Alkaddour , Usman Tariq , Abhinav Dhall

We learn to compute optical flow by combining a classical spatial-pyramid formulation with deep learning. This estimates large motions in a coarse-to-fine approach by warping one image of a pair at each pyramid level by the current flow…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Anurag Ranjan , Michael J. Black

Most of the current scene flow methods choose to model scene flow as a per point translation vector without differentiating between static and dynamic components of 3D motion. In this work we present an alternative method for end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Ivan Tishchenko , Sandro Lombardi , Martin R. Oswald , Marc Pollefeys