English
Related papers

Related papers: What Matters for 3D Scene Flow Network

200 papers

We propose a novel end-to-end deep scene flow model, called PointPWC-Net, on 3D point clouds in a coarse-to-fine fashion. Flow computed at the coarse level is upsampled and warped to a finer level, enabling the algorithm to accommodate for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Wenxuan Wu , Zhiyuan Wang , Zhuwen Li , Wei Liu , Li Fuxin

Understanding the flow in 3D space of sparsely sampled points between two consecutive time frames is the core stone of modern geometric-driven systems such as VR/AR, Robotics, and Autonomous driving. The lack of real, non-simulated, labeled…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Bojun Ouyang , Dan Raviv

Scene flow depicts the dynamics of a 3D scene, which is critical for various applications such as autonomous driving, robot navigation, AR/VR, etc. Conventionally, scene flow is estimated from dense/regular RGB video frames. With the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Haiyan Wang , Jiahao Pang , Muhammad A. Lodhi , Yingli Tian , Dong Tian

An efficient 3D scene flow estimation method called PointFlowHop is proposed in this work. PointFlowHop takes two consecutive point clouds and determines the 3D flow vectors for every point in the first point cloud. PointFlowHop decomposes…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Pranav Kadam , Jiahao Gu , Shan Liu , C. -C. Jay Kuo

Deep neural networks have made significant advancements in accurately estimating scene flow using point clouds, which is vital for many applications like video analysis, action recognition, and navigation. The robustness of these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Haniyeh Ehsani Oskouie , Mohammad-Shahram Moin , Shohreh Kasaei

Scene flow estimation is a long-standing problem in computer vision, where the goal is to find the 3D motion of a scene from its consecutive observations. Recently, there have been efforts to compute the scene flow from 3D point clouds. A…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Itai Lang , Dror Aiger , Forrester Cole , Shai Avidan , Michael Rubinstein

In this paper, we present a new self-supervised scene flow estimation approach for a pair of consecutive point clouds. The key idea of our approach is to represent discrete point clouds as continuous probability density functions using…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Pan He , Patrick Emami , Sanjay Ranka , Anand Rangarajan

This work proposes a metric learning approach for self-supervised scene flow estimation. Scene flow estimation is the task of estimating 3D flow vectors for consecutive 3D point clouds. Such flow vectors are fruitful, \eg for recognizing…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Victor Zuanazzi , Joris van Vugt , Olaf Booij , Pascal Mettes

Learning 3D scene flow from LiDAR point clouds presents significant difficulties, including poor generalization from synthetic datasets to real scenes, scarcity of real-world 3D labels, and poor performance on real sparse LiDAR point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Chaokang Jiang , Guangming Wang , Jiuming Liu , Hesheng Wang , Zhuang Ma , Zhenqiang Liu , Zhujin Liang , Yi Shan , Dalong Du

Scene flow is the task of estimating 3D motion vectors to individual points of a dynamic 3D scene. Motion vectors have shown to be beneficial for downstream tasks such as action classification and collision avoidance. However, data…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Victor Zuanazzi

We address the problem of scene flow: given a pair of stereo or RGB-D video frames, estimate pixelwise 3D motion. We introduce RAFT-3D, a new deep architecture for scene flow. RAFT-3D is based on the RAFT model developed for optical flow…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Zachary Teed , Jia Deng

We study the problem of self-supervised 3D scene flow estimation from real large-scale raw point cloud sequences, which is crucial to various tasks like trajectory prediction or instance segmentation. In the absence of ground truth scene…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Patrik Vacek , David Hurych , Tomáš Svoboda , Karel Zimmermann

Scene flow in 3D point clouds plays an important role in understanding dynamic environments. Although significant advances have been made by deep neural networks, the performance is far from satisfactory as only per-point translational…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Ruibo Li , Guosheng Lin , Tong He , Fayao Liu , Chunhua Shen

Scene flow represents the 3D motion of each point in the scene, which explicitly describes the distance and the direction of each point's movement. Scene flow estimation is used in various applications such as autonomous driving fields,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Guangming Wang , Zhiheng Feng , Chaokang Jiang , Hesheng Wang

In this article, we investigate self-supervised 3D scene flow estimation and class-agnostic motion prediction on point clouds. A realistic scene can be well modeled as a collection of rigidly moving parts, therefore its scene flow can be…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Ruibo Li , Chi Zhang , Zhe Wang , Chunhua Shen , Guosheng Lin

Scene flow prediction is a crucial underlying task in understanding dynamic scenes as it offers fundamental motion information. However, contemporary scene flow methods encounter three major challenges. Firstly, flow estimation solely based…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Zhiyang Lu , Qinghan Chen , Ming Cheng

In recent years, the LiDAR images, as a 2D compact representation of 3D LiDAR point clouds, are widely applied in various tasks, e.g., 3D semantic segmentation, LiDAR point cloud compression (PCC). Among these works, the optical flow…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Xuezhou Guo , Xuhu Lin , Lili Zhao , Zezhi Zhu , Jianwen Chen

Understanding 3D scenes is a critical prerequisite for autonomous agents. Recently, LiDAR and other sensors have made large amounts of data available in the form of temporal sequences of point cloud frames. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Pan He , Patrick Emami , Sanjay Ranka , Anand Rangarajan

Estimating scene flow in RGB-D videos is attracting much interest of the computer vision researchers, due to its potential applications in robotics. The state-of-the-art techniques for scene flow estimation, typically rely on the knowledge…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Ravi Kumar Thakur , Snehasis Mukherjee

We present a novel deep neural network architecture for end-to-end scene flow estimation that directly operates on large-scale 3D point clouds. Inspired by Bilateral Convolutional Layers (BCL), we propose novel DownBCL, UpBCL, and CorrBCL…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Xiuye Gu , Yijie Wang , Chongruo wu , Yong-Jae lee , Panqu Wang