English
Related papers

Related papers: Visual Point Cloud Forecasting enables Scalable Au…

200 papers

Occluded and long-range objects are ubiquitous and challenging for 3D object detection. Point cloud sequence data provide unique opportunities to improve such cases, as an occluded or distant object can be observed from different viewpoints…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Yingwei Li , Charles R. Qi , Yin Zhou , Chenxi Liu , Dragomir Anguelov

Reducing the quantity of annotations required for supervised training is vital when labels are scarce and costly. This reduction is especially important for semantic segmentation tasks involving 3D datasets that are often significantly…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Andrej Janda , Brandon Wagstaff , Edwin G. Ng , Jonathan Kelly

LiDAR sensors are widely used in autonomous driving due to the reliable 3D spatial information. However, the data of LiDAR is sparse and the frequency of LiDAR is lower than that of cameras. To generate denser point clouds spatially and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Xudong Huang , Chunyu Lin , Haojie Liu , Lang Nie , Yao Zhao

Autonomous vehicles (AVs) are expected to revolutionize transportation by improving efficiency and safety. Their success relies on 3D vision systems that effectively sense the environment and detect traffic agents. Among sensors AVs use to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Amirhesam Aghanouri , Cristina Olaverri-Monreal

In the field of autonomous driving, a variety of sensor data types exist, each representing different modalities of the same scene. Therefore, it is feasible to utilize data from other sensors to facilitate image compression. However, few…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Yiheng Jiang , Haotian Zhang , Li Li , Dong Liu , Zhu Li

LiDAR point cloud semantic segmentation is essential for interpreting 3D environments in applications such as autonomous driving and robotics. Recent methods achieve strong performance by exploiting different point cloud representations or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Simone Mosco , Daniel Fusaro , Wanmeng Li , Emanuele Menegatti , Alberto Pretto

Casting semantic segmentation of outdoor LiDAR point clouds as a 2D problem, e.g., via range projection, is an effective and popular approach. These projection-based methods usually benefit from fast computations and, when combined with…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Angelika Ando , Spyros Gidaris , Andrei Bursuc , Gilles Puy , Alexandre Boulch , Renaud Marlet

The task of 3D semantic scene graph (3DSSG) prediction in the point cloud is challenging since (1) the 3D point cloud only captures geometric structures with limited semantics compared to 2D images, and (2) long-tailed relation distribution…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Ziqin Wang , Bowen Cheng , Lichen Zhao , Dong Xu , Yang Tang , Lu Sheng

Training models to apply linguistic knowledge and visual concepts from 2D images to 3D world understanding is a promising direction that researchers have only recently started to explore. In this work, we design a novel 3D pre-training…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Maria Parelli , Alexandros Delitzas , Nikolas Hars , Georgios Vlassis , Sotirios Anagnostidis , Gregor Bachmann , Thomas Hofmann

Point clouds provide a flexible and natural representation usable in countless applications such as robotics or self-driving cars. Recently, deep neural networks operating on raw point cloud data have shown promising results on supervised…

Machine Learning · Computer Science 2019-06-04 Jonathan Sauder , Bjarne Sievers

Autonomous driving requires forecasting both geometry and semantics over time to effectively reason about future environment states. Existing vision-based occupancy forecasting methods focus on motion-related categories such as static and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Riya Mohan , Juana Valeria Hurtado , Rohit Mohan , Abhinav Valada

As camera and LiDAR sensors capture complementary information used in autonomous driving, great efforts have been made to develop semantic segmentation algorithms through multi-modality data fusion. However, fusion-based approaches require…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Xu Yan , Jiantao Gao , Chaoda Zheng , Chao Zheng , Ruimao Zhang , Shenghui Cui , Zhen Li

We propose a new self-supervised method for pre-training the backbone of deep perception models operating on point clouds. The core idea is to train the model on a pretext task which is the reconstruction of the surface on which the 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Alexandre Boulch , Corentin Sautier , Björn Michele , Gilles Puy , Renaud Marlet

3D vehicle detection based on point cloud is a challenging task in real-world applications such as autonomous driving. Despite significant progress has been made, we observe two aspects to be further improved. First, the semantic context…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Hongwei Yi , Shaoshuai Shi , Mingyu Ding , Jiankai Sun , Kui Xu , Hui Zhou , Zhe Wang , Sheng Li , Guoping Wang

Autonomous driving gained huge traction in recent years, due to its potential to change the way we commute. Much effort has been put into trying to estimate the state of a vehicle. Meanwhile, learning to forecast the state of a vehicle…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Eitan Kosman , Dotan Di Castro

The challenge of navigation in environments with dynamic objects continues to be a central issue in the study of autonomous agents. While predictive methods hold promise, their reliance on precise state information makes them less practical…

Robotics · Computer Science 2024-10-28 Hsuan-Kung Yang , Tsung-Chih Chiang , Ting-Ru Liu , Chun-Wei Huang , Jou-Min Liu , Chun-Yi Lee

Object classification using LiDAR 3D point cloud data is critical for modern applications such as autonomous driving. However, labeling point cloud data is labor-intensive as it requires human annotators to visualize and inspect the 3D data…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Ziwei Wang , Reza Arablouei , Jiajun Liu , Paulo Borges , Greg Bishop-Hurley , Nicholas Heaney

A promising direction for pre-training 3D point clouds is to leverage the massive amount of data in 2D, whereas the domain gap between 2D and 3D creates a fundamental challenge. This paper proposes a novel approach to point-cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Siming Yan , Chen Song , Youkang Kong , Qixing Huang

Understanding motion in dynamic environments is critical for autonomous driving, thereby motivating research on class-agnostic motion prediction. In this work, we investigate weakly and self-supervised class-agnostic motion prediction from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Ruibo Li , Hanyu Shi , Zhe Wang , Guosheng Lin

Segmenting or detecting objects in sparse Lidar point clouds are two important tasks in autonomous driving to allow a vehicle to act safely in its 3D environment. The best performing methods in 3D semantic segmentation or object detection…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Corentin Sautier , Gilles Puy , Spyros Gidaris , Alexandre Boulch , Andrei Bursuc , Renaud Marlet