English
Related papers

Related papers: Self-Supervised 3D Scene Flow Estimation and Motio…

200 papers

Though a number of point cloud learning methods have been proposed to handle unordered points, most of them are supervised and require labels for training. By contrast, unsupervised learning of point cloud data has received much less…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Jincen Jiang , Xuequan Lu , Wanli Ouyang , Meili Wang

Multi-beam LiDAR sensors, as used on autonomous vehicles and mobile robots, acquire sequences of 3D range scans ("frames"). Each frame covers the scene sparsely, due to limited angular scanning resolution and occlusion. The sparsity…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Shengyu Huang , Zan Gojcic , Jiahui Huang , Andreas Wieser , Konrad Schindler

Understanding motion in dynamic environments is critical for autonomous driving, thereby motivating research on class-agnostic motion prediction. In this work, we investigate weakly and self-supervised class-agnostic motion prediction from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Ruibo Li , Hanyu Shi , Zhe Wang , Guosheng Lin

3D LiDAR scanners are playing an increasingly important role in autonomous driving as they can generate depth information of the environment. However, creating large 3D LiDAR point cloud datasets with point-level labels requires a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Xiangyu Yue , Bichen Wu , Sanjit A. Seshia , Kurt Keutzer , Alberto L. Sangiovanni-Vincentelli

Pre-training on large-scale unlabeled datasets contribute to the model achieving powerful performance on 3D vision tasks, especially when annotations are limited. However, existing rendering-based self-supervised frameworks are…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Hao Liu , Minglin Chen , Yanni Ma , Haihong Xiao , Ying He

We present Seen2Scene, the first flow matching-based approach that trains directly on incomplete, real-world 3D scans for scene completion and generation. Unlike prior methods that rely on complete and hence synthetic 3D data, our approach…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Quan Meng , Yujin Chen , Lei Li , Matthias Nießner , Angela Dai

Deep neural network models have achieved remarkable progress in 3D scene understanding while trained in the closed-set setting and with full labels. However, the major bottleneck is that these models do not have the capacity to recognize…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Kangcheng Liu , Yong-Jin Liu , Baoquan Chen

Scene flow estimation is an extremely important task in computer vision to support the perception of dynamic changes in the scene. For robust scene flow, learning-based approaches have recently achieved impressive results using either…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Rajai Alhimdiat , Ramy Battrawy , René Schuster , Didier Stricker , Wesam Ashour

Self-supervised learning has emerged as a promising approach for acquiring transferable 3D representations from unlabeled 3D point clouds. Unlike 2D images, which are widely accessible, acquiring 3D assets requires specialized expertise or…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Xuweiyi Chen , Zezhou Cheng

Point cloud has been widely used in the field of autonomous driving since it can provide a more comprehensive three-dimensional representation of the environment than 2D images. Point-wise prediction based on point cloud sequence (PCS) is…

Robotics · Computer Science 2021-09-16 Haowen Wang , Zirui Li , Jianwei Gong

Large and rich data is a prerequisite for effective training of deep neural networks. However, the irregularity of point cloud data makes manual annotation time-consuming and laborious. Self-supervised representation learning, which…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Xin Cao , Xinxin Han , Yifan Wang , Mengna Yang , Kang Li

Scene coordinate regression (SCR) models have proven to be powerful implicit scene representations for 3D vision, enabling visual relocalization and structure-from-motion. SCR models are trained specifically for one scene. If training…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Wenjing Bian , Axel Barroso-Laguna , Tommaso Cavallari , Victor Adrian Prisacariu , Eric Brachmann

Recent advances in self-supervised learning (SSL) for point clouds have substantially improved 3D scene understanding without human annotations. Existing approaches emphasize semantic awareness by enforcing feature consistency across…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Bin Yang , Mohamed Abdelsamad , Miao Zhang , Alexandru Paul Condurache

Geometry and color information provided by the point clouds are both crucial for 3D scene understanding. Two pieces of information characterize the different aspects of point clouds, but existing methods lack an elaborate design for the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Guofan Fan , Zekun Qi , Wenkai Shi , Kaisheng Ma

The proposed RMS-FlowNet++ is a novel end-to-end learning-based architecture for accurate and efficient scene flow estimation that can operate on high-density point clouds. For hierarchical scene f low estimation, existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Ramy Battrawy , René Schuster , Didier Stricker

Fluid simulation is an important research topic in computer graphics (CG) and animation in video games. Traditional methods based on Navier-Stokes equations are computationally expensive. In this paper, we treat fluid motion as point cloud…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yu Chen , Shuai Zheng , Nianyi Wang , Menglong Jin , Yan Chang

Labeling LiDAR point clouds is notoriously time-and-energy-consuming, which spurs recent unsupervised 3D representation learning methods to alleviate the labeling burden in LiDAR perception via pretrained weights. Almost all existing work…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Runjian Chen , Hyoungseob Park , Bo Zhang , Wenqi Shao , Ping Luo , Alex Wong

We propose a unified point cloud video self-supervised learning framework for object-centric and scene-centric data. Previous methods commonly conduct representation learning at the clip or frame level and cannot well capture fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao , Longguang Wang , Yulan Guo , Hehe Fan

Understanding foggy image sequence in the driving scenes is critical for autonomous driving, but it remains a challenging task due to the difficulty in collecting and annotating real-world images of adverse weather. Recently, the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Liang Liao , Wenyi Chen , Jing Xiao , Zheng Wang , Chia-Wen Lin , Shin'ichi Satoh

Perceiving and understanding 3D motion is a core technology in fields such as autonomous driving, robots, and motion prediction. This paper proposes a 3D motion perception method called ScaleFlow++ that is easy to generalize. With just a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Han Ling , Yinghui Sun , Quansen Sun , Yuhui Zheng