English
Related papers

Related papers: Self-Supervised 3D Scene Flow Estimation and Motio…

200 papers

Estimating the 3D motion of points in a scene, known as scene flow, is a core problem in computer vision. Traditional learning-based methods designed to learn end-to-end 3D flow often suffer from poor generalization. Here we present a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Yair Kittenplon , Yonina C. Eldar , Dan Raviv

This paper investigates indoor point cloud semantic segmentation under scene-level annotation, which is less explored compared to methods relying on sparse point-level labels. In the absence of precise point-level labels, current methods…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Lunhao Duan , Shanshan Zhao , Xingxing Weng , Jing Zhang , Gui-Song Xia

When interacting with highly dynamic environments, scene flow allows autonomous systems to reason about the non-rigid motion of multiple independent objects. This is of particular interest in the field of autonomous driving, in which many…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Himangi Mittal , Brian Okorn , David Held

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based scene flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Rahul Ahuja , Chris Baker , Wilko Schwarting

LiDAR scene flow estimation is essential for autonomous driving, as it provides 3D motion for each point. Self-supervised approaches use static-dynamic classification to mitigate the imbalance between static and dynamic points, deriving…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Youngdong Jang , Gyeongrok Oh , Jong Wook Kim , Hyunju Ryu , Hyung-gun Chi , SeungHyeon Kim , Seungryong Kim , Jonghyun Choi , Sangpil Kim

In the field of autonomous driving, self-training is widely applied to mitigate distribution shifts in LiDAR-based 3D object detectors. This eliminates the need for expensive, high-quality labels whenever the environment changes (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Christian Fruhwirth-Reisinger , Michael Opitz , Horst Possegger , Horst Bischof

Scene flow estimation has been receiving increasing attention for 3D environment perception. Monocular scene flow estimation -- obtaining 3D structure and 3D motion from two temporally consecutive images -- is a highly ill-posed problem,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Junhwa Hur , Stefan Roth

Point cloud scene flow estimation is of practical importance for dynamic scene navigation in autonomous driving. Since scene flow labels are hard to obtain, current methods train their models on synthetic data and transfer them to real…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Zhao Jin , Yinjie Lei , Naveed Akhtar , Haifeng Li , Munawar Hayat

In recent years, deep neural networks showed their exceeding capabilities in addressing many computer vision tasks including scene flow prediction. However, most of the advances are dependent on the availability of a vast amount of dense…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Katharina Bendig , René Schuster , Didier Stricker

Point clouds are naturally sparse, while image pixels are dense. The inconsistency limits feature fusion from both modalities for point-wise scene flow estimation. Previous methods rarely predict scene flow from the entire point clouds of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Chensheng Peng , Guangming Wang , Xian Wan Lo , Xinrui Wu , Chenfeng Xu , Masayoshi Tomizuka , Wei Zhan , Hesheng Wang

The rapid progress in 3D scene understanding has come with growing demand for data; however, collecting and annotating 3D scenes (e.g. point clouds) are notoriously hard. For example, the number of scenes (e.g. indoor rooms) that can be…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Ji Hou , Benjamin Graham , Matthias Nießner , Saining Xie

Scene flow in 3D point clouds plays an important role in understanding dynamic environments. Although significant advances have been made by deep neural networks, the performance is far from satisfactory as only per-point translational…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Ruibo Li , Guosheng Lin , Tong He , Fayao Liu , Chunhua Shen

Manually annotating complex scene point cloud datasets is both costly and error-prone. To reduce the reliance on labeled data, a new model called SnapshotNet is proposed as a self-supervised feature learning approach, which directly works…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Xingye Li , Ling Zhang , Zhigang Zhu

Contemporary point cloud segmentation approaches largely rely on richly annotated 3D training data. However, it is both time-consuming and challenging to obtain consistently accurate annotations for such 3D scene data. Moreover, there is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Jiaxu Liu , Zhengdi Yu , Toby P. Breckon , Hubert P. H. Shum

To date, various 3D scene understanding tasks still lack practical and generalizable pre-trained models, primarily due to the intricate nature of 3D scene understanding tasks and their immense variations introduced by camera views,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Siyuan Huang , Yichen Xie , Song-Chun Zhu , Yixin Zhu

Scene flow represents the motion of points in the 3D space, which is the counterpart of the optical flow that represents the motion of pixels in the 2D image. However, it is difficult to obtain the ground truth of scene flow in the real…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Guangming Wang , Xiaoyu Tian , Ruiqi Ding , Hesheng Wang

Scene flow depicts the dynamics of a 3D scene, which is critical for various applications such as autonomous driving, robot navigation, AR/VR, etc. Conventionally, scene flow is estimated from dense/regular RGB video frames. With the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Haiyan Wang , Jiahao Pang , Muhammad A. Lodhi , Yingli Tian , Dong Tian

Rapid progress in 3D semantic segmentation is inseparable from the advances of deep network models, which highly rely on large-scale annotated data for training. To address the high cost and challenges of 3D point-level labeling, we present…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Li Jiang , Shaoshuai Shi , Zhuotao Tian , Xin Lai , Shu Liu , Chi-Wing Fu , Jiaya Jia

Estimating 3D occupancy and motion at the vehicle's surroundings is essential for autonomous driving, enabling situational awareness in dynamic environments. Existing approaches jointly learn geometry and motion but rely on expensive 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xavier Timoneda , Markus Herb , Fabian Duerr , Daniel Goehring

Reliable 3D dynamic perception requires models that can anticipate motion beyond predefined categories, yet progress is hindered by the scarcity of dense, high-quality motion annotations. While self-supervision on unlabeled real data offers…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Qingwen Zhang , Xiaomeng Zhu , Chenhan Jiang , Patric Jensfelt