English
Related papers

Related papers: Self-Supervised Flow Estimation using Geometric Re…

200 papers

In this article, we investigate self-supervised 3D scene flow estimation and class-agnostic motion prediction on point clouds. A realistic scene can be well modeled as a collection of rigidly moving parts, therefore its scene flow can be…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Ruibo Li , Chi Zhang , Zhe Wang , Chunhua Shen , Guosheng Lin

We present a self-supervised learning framework to estimate the individual object motion and monocular depth from video. We model the object motion as a 6 degree-of-freedom rigid-body transformation. The instance segmentation mask is…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Qi Dai , Vaishakh Patil , Simon Hecker , Dengxin Dai , Luc Van Gool , Konrad Schindler

We address unsupervised optical flow estimation for ego-centric motion. We argue that optical flow can be cast as a geometrical warping between two successive video frames and devise a deep architecture to estimate such transformation in…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Stefano Alletto , Davide Abati , Simone Calderara , Rita Cucchiara , Luca Rigazio

The estimation of optical flow and 6-DoF ego-motion, two fundamental tasks in 3D vision, has typically been addressed independently. For neuromorphic vision (e.g., event cameras), however, the lack of robust data association makes solving…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Wenpu Li , Bangyan Liao , Yi Zhou , Qi Xu , Pian Wan , Peidong Liu

We propose a continuous optimization method for solving dense 3D scene flow problems from stereo imagery. As in recent work, we represent the dynamic 3D scene as a collection of rigidly moving planar segments. The scene flow problem then…

Computer Vision and Pattern Recognition · Computer Science 2016-07-28 Zhaoyang Lv , Chris Beall , Pablo F. Alcantarilla , Fuxin Li , Zsolt Kira , Frank Dellaert

The importance and demands of visual scene understanding have been steadily increasing along with the active development of autonomous systems. Consequently, there has been a large amount of research dedicated to semantic segmentation and…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Junhwa Hur , Stefan Roth

When interacting with highly dynamic environments, scene flow allows autonomous systems to reason about the non-rigid motion of multiple independent objects. This is of particular interest in the field of autonomous driving, in which many…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Himangi Mittal , Brian Okorn , David Held

Neural Scene Flow Prior (NSFP) and Fast Neural Scene Flow (FNSF) have shown remarkable adaptability in the context of large out-of-distribution autonomous driving. Despite their success, the underlying reasons for their astonishing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Dongrui Liu , Daqi Liu , Xueqian Li , Sihao Lin , Hongwei xie , Bing Wang , Xiaojun Chang , Lei Chu

Imposing consistency through proxy tasks has been shown to enhance data-driven learning and enable self-supervision in various tasks. This paper introduces novel and effective consistency strategies for optical flow estimation, a problem…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Jisoo Jeong , Jamie Menjay Lin , Fatih Porikli , Nojun Kwak

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based scene flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Rahul Ahuja , Chris Baker , Wilko Schwarting

The computation of 2-D optical flow by means of regularized pel-recursive algorithms raises a host of issues, which include the treatment of outliers, motion discontinuities and occlusion among other problems. We propose a new approach…

Computer Vision and Pattern Recognition · Computer Science 2016-11-07 Vania V. Estrela , Luis A. Rivera , Paulo C. Beggio , Ricardo T. Lopes

Learning scene flow from a monocular camera still remains a challenging task due to its ill-posedness as well as lack of annotated data. Self-supervised methods demonstrate learning scene flow estimation from unlabeled data, yet their…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Bayram Bayramli , Junhwa Hur , Hongtao Lu

Scene flow estimation aims to recover per-point motion from two adjacent LiDAR scans. However, in real-world applications such as autonomous driving, points rarely move independently of others, especially for nearby points belonging to the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Yancong Lin , Shiming Wang , Liangliang Nan , Julian Kooij , Holger Caesar

Motion is a dominant cue in automated driving systems. Optical flow is typically computed to detect moving objects and to estimate depth using triangulation. In this paper, our motivation is to leverage the existing dense optical flow to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Hazem Rashed , Senthil Yogamani , Ahmad El-Sallab , Pavel Krizek , Mohamed El-Helw

Optical flow estimation is a fundamental problem in computer vision, yet the reliance on expensive ground-truth annotations limits the scalability of supervised approaches. Although unsupervised and semi-supervised methods alleviate this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yixuan Luo , Feng Qiao , Zhexiao Xiong , Yanjing Li , Nathan Jacobs

We propose a new self-supervised approach to image feature learning from motion cue. This new approach leverages recent advances in deep learning in two directions: 1) the success of training deep neural network in estimating optical flow…

Computer Vision and Pattern Recognition · Computer Science 2019-01-10 Bin Ma , Shubao Liu , Yingxuan Zhi , Qi Song

We propose a new multi-frame method for efficiently computing scene flow (dense depth and optical flow) and camera ego-motion for a dynamic scene observed from a moving stereo camera rig. Our technique also segments out moving objects from…

Computer Vision and Pattern Recognition · Computer Science 2017-11-29 Tatsunori Taniai , Sudipta N. Sinha , Yoichi Sato

Appearance-based detectors achieve remarkable performance on common scenes, but tend to fail for scenarios lack of training data. Geometric motion segmentation algorithms, however, generalize to novel scenes, but have yet to achieve…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Gengshan Yang , Deva Ramanan

Self-supervised monocular depth estimation enables robots to learn 3D perception from raw video streams. This scalable approach leverages projective geometry and ego-motion to learn via view synthesis, assuming the world is mostly static.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Vitor Guizilini , Kuan-Hui Lee , Rares Ambrus , Adrien Gaidon

For visual estimation of optical flow, a crucial function for many vision tasks, unsupervised learning, using the supervision of view synthesis has emerged as a promising alternative to supervised methods, since ground-truth flow is not…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Zitang Sun , Shin'ya Nishida , Zhengbo Luo