English
Related papers

Related papers: Learning Scene Dynamics from Point Cloud Sequences

200 papers

Scene flow allows autonomous vehicles to reason about the arbitrary motion of multiple independent objects which is the key to long-term mobile autonomy. While estimating the scene flow from LiDAR has progressed recently, it remains largely…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Fangqiang Ding , Zhijun Pan , Yimin Deng , Jianning Deng , Chris Xiaoxuan Lu

3D scene flow estimation from point clouds is a low-level 3D motion perception task in computer vision. Flow embedding is a commonly used technique in scene flow estimation, and it encodes the point motion between two consecutive frames.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Guangming Wang , Yunzhe Hu , Zhe Liu , Yiyang Zhou , Masayoshi Tomizuka , Wei Zhan , Hesheng Wang

In this article, we investigate self-supervised 3D scene flow estimation and class-agnostic motion prediction on point clouds. A realistic scene can be well modeled as a collection of rigidly moving parts, therefore its scene flow can be…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Ruibo Li , Chi Zhang , Zhe Wang , Chunhua Shen , Guosheng Lin

Vehicle detection and localization in complex traffic scenarios pose significant challenges due to the interference of moving objects. Traditional methods often rely on outlier exclusions or semantic segmentations, which suffer from low…

Robotics · Computer Science 2025-01-29 Yinqi Chen , Meiying Zhang , Qi Hao , Guang Zhou

We propose a novel scene flow estimation approach to capture and infer 3D motions from point clouds. Estimating 3D motions for point clouds is challenging, since a point cloud is unordered and its density is significantly non-uniform. Such…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Bing Li , Cheng Zheng , Silvio Giancola , Bernard Ghanem

Many applications in robotics and human-computer interaction can benefit from understanding 3D motion of points in a dynamic environment, widely noted as scene flow. While most previous methods focus on stereo and RGB-D images as input, few…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Xingyu Liu , Charles R. Qi , Leonidas J. Guibas

Point cloud scene flow estimation is of practical importance for dynamic scene navigation in autonomous driving. Since scene flow labels are hard to obtain, current methods train their models on synthetic data and transfer them to real…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Zhao Jin , Yinjie Lei , Naveed Akhtar , Haifeng Li , Munawar Hayat

Scene flow estimation, which extracts point-wise motion between scenes, is becoming a crucial task in many computer vision tasks. However, all of the existing estimation methods utilize only the unidirectional features, restricting the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Wencan Cheng , Jong Hwan Ko

Scene flow estimation aims to generate the 3D motion field of points between two consecutive frames of point clouds, which has wide applications in various fields. Existing point-based methods ignore the irregularity of point clouds and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Xuezhi Xiang , Xi Wang , Lei Zhang , Denis Ombati , Himaloy Himu , Xiantong Zhen

Scene flow prediction is a crucial underlying task in understanding dynamic scenes as it offers fundamental motion information. However, contemporary scene flow methods encounter three major challenges. Firstly, flow estimation solely based…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Zhiyang Lu , Qinghan Chen , Ming Cheng

Scene flow enables an understanding of the motion characteristics of the environment in the 3D world. It gains particular significance in the long-range, where object-based perception methods might fail due to sparse observations far away.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Ajinkya Khoche , Qingwen Zhang , Laura Pereira Sanchez , Aron Asefaw , Sina Sharif Mansouri , Patric Jensfelt

Accurate perception of dynamic traffic scenes is crucial for high-level autonomous driving systems, requiring robust object motion estimation and instance segmentation. However, traditional methods often treat them as separate tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yinqi Chen , Meiying Zhang , Qi Hao , Guang Zhou

Scene flow, which provides the 3D motion field of the first frame from two consecutive point clouds, is vital for dynamic scene perception. However, contemporary scene flow methods face three major challenges. Firstly, they lack global flow…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Zhiyang Lu , Qinghan Chen , Zhimin Yuan , Ming Cheng

Point clouds are naturally sparse, while image pixels are dense. The inconsistency limits feature fusion from both modalities for point-wise scene flow estimation. Previous methods rarely predict scene flow from the entire point clouds of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Chensheng Peng , Guangming Wang , Xian Wan Lo , Xinrui Wu , Chenfeng Xu , Masayoshi Tomizuka , Wei Zhan , Hesheng Wang

Scene flow is the task of estimating 3D motion vectors to individual points of a dynamic 3D scene. Motion vectors have shown to be beneficial for downstream tasks such as action classification and collision avoidance. However, data…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Victor Zuanazzi

3D motion estimation including scene flow and point cloud registration has drawn increasing interest. Inspired by 2D flow estimation, recent methods employ deep neural networks to construct the cost volume for estimating accurate 3D flow.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Xiaodong Gu , Chengzhou Tang , Weihao Yuan , Zuozhuo Dai , Siyu Zhu , Ping Tan

Estimating 3D scene flow from a sequence of monocular images has been gaining increased attention due to the simple, economical capture setup. Owing to the severe ill-posedness of the problem, the accuracy of current methods has been…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Junhwa Hur , Stefan Roth

Scene flow estimation is an extremely important task in computer vision to support the perception of dynamic changes in the scene. For robust scene flow, learning-based approaches have recently achieved impressive results using either…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Rajai Alhimdiat , Ramy Battrawy , René Schuster , Didier Stricker , Wesam Ashour

Point cloud sequences are commonly used to accurately detect 3D objects in applications such as autonomous driving. Current top-performing multi-frame detectors mostly follow a Detect-and-Fuse framework, which extracts features from each…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Chenhang He , Ruihuang Li , Yabin Zhang , Shuai Li , Lei Zhang

We study the problem of self-supervised 3D scene flow estimation from real large-scale raw point cloud sequences, which is crucial to various tasks like trajectory prediction or instance segmentation. In the absence of ground truth scene…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Patrik Vacek , David Hurych , Tomáš Svoboda , Karel Zimmermann