English
Related papers

Related papers: FlowStep3D: Model Unrolling for Self-Supervised Sc…

200 papers

Scene flow estimation predicts the 3D motion at each point in successive LiDAR scans. This detailed, point-level, information can help autonomous vehicles to accurately predict and understand dynamic changes in their surroundings. Current…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Qingwen Zhang , Yi Yang , Peizheng Li , Olov Andersson , Patric Jensfelt

Scene flow estimation is the task of describing 3D motion between temporally successive observations. This thesis aims to build the foundation for building scene flow estimators with two important properties: they are scalable, i.e. they…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Kyle Vedder

The proposed RMS-FlowNet is a novel end-to-end learning-based architecture for accurate and efficient scene flow estimation which can operate on point clouds of high density. For hierarchical scene flow estimation, the existing methods…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Ramy Battrawy , René Schuster , Mohammad-Ali Nikouei Mahani , Didier Stricker

Scene flow estimation has been receiving increasing attention for 3D environment perception. Monocular scene flow estimation -- obtaining 3D structure and 3D motion from two temporally consecutive images -- is a highly ill-posed problem,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Junhwa Hur , Stefan Roth

Self-supervised monocular depth estimation enables robots to learn 3D perception from raw video streams. This scalable approach leverages projective geometry and ego-motion to learn via view synthesis, assuming the world is mostly static.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Vitor Guizilini , Kuan-Hui Lee , Rares Ambrus , Adrien Gaidon

Scene flow represents the motion of points in the 3D space, which is the counterpart of the optical flow that represents the motion of pixels in the 2D image. However, it is difficult to obtain the ground truth of scene flow in the real…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Guangming Wang , Xiaoyu Tian , Ruiqi Ding , Hesheng Wang

Scene flow prediction is a crucial underlying task in understanding dynamic scenes as it offers fundamental motion information. However, contemporary scene flow methods encounter three major challenges. Firstly, flow estimation solely based…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Zhiyang Lu , Qinghan Chen , Ming Cheng

3D scene flow characterizes how the points at the current time flow to the next time in the 3D Euclidean space, which possesses the capacity to infer autonomously the non-rigid motion of all objects in the scene. The previous methods for…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Chaokang Jiang , Guangming Wang , Yanzi Miao , Hesheng Wang

We propose a data-driven scene flow estimation algorithm exploiting the observation that many 3D scenes can be explained by a collection of agents moving as rigid bodies. At the core of our method lies a deep architecture able to reason at…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Zan Gojcic , Or Litany , Andreas Wieser , Leonidas J. Guibas , Tolga Birdal

In this article, we investigate self-supervised 3D scene flow estimation and class-agnostic motion prediction on point clouds. A realistic scene can be well modeled as a collection of rigidly moving parts, therefore its scene flow can be…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Ruibo Li , Chi Zhang , Zhe Wang , Chunhua Shen , Guosheng Lin

This work proposes a metric learning approach for self-supervised scene flow estimation. Scene flow estimation is the task of estimating 3D flow vectors for consecutive 3D point clouds. Such flow vectors are fruitful, \eg for recognizing…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Victor Zuanazzi , Joris van Vugt , Olaf Booij , Pascal Mettes

We present a self-supervised approach to estimate flow in camera image and top-view grid map sequences using fully convolutional neural networks in the domain of automated driving. We extend existing approaches for self-supervised optical…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Sascha Wirges , Johannes Gräter , Qiuhao Zhang , Christoph Stiller

Learning 3D scene flow from LiDAR point clouds presents significant difficulties, including poor generalization from synthetic datasets to real scenes, scarcity of real-world 3D labels, and poor performance on real sparse LiDAR point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Chaokang Jiang , Guangming Wang , Jiuming Liu , Hesheng Wang , Zhuang Ma , Zhenqiang Liu , Zhujin Liang , Yi Shan , Dalong Du

Reconstruction of 3D neural fields from posed images has emerged as a promising method for self-supervised representation learning. The key challenge preventing the deployment of these 3D scene learners on large-scale video data is their…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Cameron Smith , Yilun Du , Ayush Tewari , Vincent Sitzmann

The proposed RMS-FlowNet++ is a novel end-to-end learning-based architecture for accurate and efficient scene flow estimation that can operate on high-density point clouds. For hierarchical scene f low estimation, existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Ramy Battrawy , René Schuster , Didier Stricker

Reconstructing 3D scenes from a single image is a fundamentally ill-posed task due to the severely under-constrained nature of the problem. Consequently, when the scene is rendered from novel camera views, existing single image to 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Sarosij Bose , Arindam Dutta , Sayak Nag , Junge Zhang , Jiachen Li , Konstantinos Karydis , Amit K. Roy Chowdhury

LiDAR scene flow is the task of estimating per-point 3D motion between consecutive point clouds. Recent methods achieve centimeter-level accuracy on popular autonomous vehicle (AV) datasets, but are typically only trained and evaluated on a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Siyi Li , Qingwen Zhang , Ishan Khatri , Kyle Vedder , Eric Eaton , Deva Ramanan , Neehar Peri

Scene flow is the task of estimating 3D motion vectors to individual points of a dynamic 3D scene. Motion vectors have shown to be beneficial for downstream tasks such as action classification and collision avoidance. However, data…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Victor Zuanazzi

Scene flow represents the 3D motion of each point in the scene, which explicitly describes the distance and the direction of each point's movement. Scene flow estimation is used in various applications such as autonomous driving fields,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Guangming Wang , Zhiheng Feng , Chaokang Jiang , Hesheng Wang

An efficient 3D scene flow estimation method called PointFlowHop is proposed in this work. PointFlowHop takes two consecutive point clouds and determines the 3D flow vectors for every point in the first point cloud. PointFlowHop decomposes…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Pranav Kadam , Jiahao Gu , Shan Liu , C. -C. Jay Kuo