English
Related papers

Related papers: Visual Point Cloud Forecasting enables Scalable Au…

200 papers

In this paper, we introduce the first large-scale video prediction model in the autonomous driving discipline. To eliminate the restriction of high-cost data collection and empower the generalization ability of our model, we acquire massive…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Jiazhi Yang , Shenyuan Gao , Yihang Qiu , Li Chen , Tianyu Li , Bo Dai , Kashyap Chitta , Penghao Wu , Jia Zeng , Ping Luo , Jun Zhang , Andreas Geiger , Yu Qiao , Hongyang Li

Semantic segmentation of LiDAR point clouds is an important task in autonomous driving. However, training deep models via conventional supervised methods requires large datasets which are costly to label. It is critical to have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Minghua Liu , Yin Zhou , Charles R. Qi , Boqing Gong , Hao Su , Dragomir Anguelov

Generating realistic and diverse LiDAR point clouds is crucial for autonomous driving simulation. Although previous methods achieve LiDAR point cloud generation from user inputs, they struggle to attain high-quality results while enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Haiyun Wei , Fan Lu , Yunwei Zhu , Zehan Zheng , Weiyi Xue , Lin Shao , Xudong Zhang , Ya Wu , Rong Fu , Guang Chen

Understanding the world around us and making decisions about the future is a critical component to human intelligence. As autonomous systems continue to develop, their ability to reason about the future will be the key to their success.…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Adam M. Terwilliger , Garrick Brazil , Xiaoming Liu

Self-supervised learning has made substantial strides in image processing, while visual pre-training for autonomous driving is still in its infancy. Existing methods often focus on learning geometric scene information while neglecting…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Shaoqing Xu , Fang Li , Shengyin Jiang , Ziying Song , Li Liu , Zhi-xin Yang

Current perception models in autonomous driving heavily rely on large-scale labelled 3D data, which is both costly and time-consuming to annotate. This work proposes a solution to reduce the dependence on labelled 3D training data by…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Chen Min , Xinli Xu , Dawei Zhao , Liang Xiao , Yiming Nie , Bin Dai

The goal of open-vocabulary detection is to identify novel objects based on arbitrary textual descriptions. In this paper, we address open-vocabulary 3D point-cloud detection by a dividing-and-conquering strategy, which involves: 1)…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Yuheng Lu , Chenfeng Xu , Xiaobao Wei , Xiaodong Xie , Masayoshi Tomizuka , Kurt Keutzer , Shanghang Zhang

Recent advancements in statistical learning and computational abilities have enabled autonomous vehicle technology to develop at a much faster rate. While many of the architectures previously introduced are capable of operating under highly…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 David Paz , Hengyuan Zhang , Qinru Li , Hao Xiang , Henrik Christensen

Vision-Language-Action (VLA) models have emerged as a promising framework for end-to-end autonomous driving. However, existing VLAs typically rely on sparse action supervision, which underutilizes their powerful scene understanding and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Xiaodong Mei , Diankun Zhang , Hongwei Xie , Guang Chen , Hangjun Ye , Dan Xu

LiDAR's dense, sharp point cloud (PC) representations of the surrounding environment enable accurate perception and significantly improve road safety by offering greater scene awareness and understanding. However, LiDAR's high cost…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 William Muckelroy , Mohammed Alsakabi , John Dolan , Ozan Tonguz

Understanding the real world through point cloud video is a crucial aspect of robotics and autonomous driving systems. However, prevailing methods for 4D point cloud recognition have limitations due to sensor resolution, which leads to a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zhichao Deng , Xiangtai Li , Xia Li , Yunhai Tong , Shen Zhao , Mengyuan Liu

Feed-forward surround-view autonomous driving scene reconstruction offers fast, generalizable inference ability, which faces the core challenge of ensuring generalization while elevating novel view quality. Due to the surround-view with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Junhong Lin , Kangli Wang , Shunzhou Wang , Songlin Fan , Ge Li , Wei Gao

In autonomous driving, accurately estimating the state of surrounding obstacles is critical for safe and robust path planning. However, this perception task is difficult, particularly for generic obstacles/objects, due to appearance and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Kuan-Hui Lee , Matthew Kliemann , Adrien Gaidon , Jie Li , Chao Fang , Sudeep Pillai , Wolfram Burgard

Pseudo-LiDAR point cloud interpolation is a novel and challenging task in the field of autonomous driving, which aims to address the frequency mismatching problem between camera and LiDAR. Previous works represent the 3D spatial motion…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Haojie Liu , Kang Liao , Chunyu Lin , Yao Zhao , Yulan Guo

Interpreting natural-language commands to localize target objects is critical for autonomous driving (AD). Existing visual grounding (VG) methods for autonomous vehicles (AVs) typically struggle with ambiguous, context-dependent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Haicheng Liao , Huanming Shen , Bonan Wang , Yongkang Li , Yihong Tang , Chengyue Wang , Dingyi Zhuang , Kehua Chen , Hai Yang , Chengzhong Xu , Zhenning Li

Autonomous driving is a challenging task that requires perceiving and understanding the surrounding environment for safe trajectory planning. While existing vision-based end-to-end models have achieved promising results, these methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Tengpeng Li , Hanli Wang , Xianfei Li , Wenlong Liao , Tao He , Pai Peng

Nowadays, pre-training big models on large-scale datasets has become a crucial topic in deep learning. The pre-trained models with high representation ability and transferability achieve a great success and dominate many downstream tasks in…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Ziyi Wang , Xumin Yu , Yongming Rao , Jie Zhou , Jiwen Lu

Anticipating the future in a dynamic scene is critical for many fields such as autonomous driving and robotics. In this paper we propose a class of novel neural network architectures to predict future LiDAR frames given previous ones. Since…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 David Deng , Avideh Zakhor

Perception systems play a crucial role in autonomous driving, incorporating multiple sensors and corresponding computer vision algorithms. 3D LiDAR sensors are widely used to capture sparse point clouds of the vehicle's surroundings.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Helin Cao , Sven Behnke

The increased availability of massive point clouds coupled with their utility in a wide variety of applications such as robotics, shape synthesis, and self-driving cars has attracted increased attention from both industry and academia.…

Machine Learning · Computer Science 2020-09-30 Charu Sharma , Manohar Kaul