English
Related papers

Related papers: Gaussian Based Adaptive Multi-Modal 3D Semantic Oc…

200 papers

Self-supervised 3D occupancy prediction offers a promising solution for understanding complex driving scenes without requiring costly 3D annotations. However, training dense occupancy decoders to capture fine-grained geometry and semantics…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Fengyi Zhang , Xiangyu Sun , Huitong Yang , Zheng Zhang , Zi Huang , Yadan Luo

3D occupancy prediction is critical for comprehensive scene understanding in vision-centric autonomous driving. Recent advances have explored utilizing 3D semantic Gaussians to model occupancy while reducing computational overhead, but they…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Xiaoyang Yan , Muleilan Pei , Shaojie Shen

Accurate 3D perception is essential for understanding the environment in autonomous driving. Recent advancements in 3D semantic occupancy prediction have leveraged camera-LiDAR fusion to improve robustness and accuracy. However, current…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Minjae Seong , Jisong Kim , Geonho Bang , Hawook Jeong , Jun Won Choi

Multi-sensor fusion using LiDAR and RGB cameras significantly enhances 3D object detection task. However, conventional LiDAR sensors perform dense, stateless scans, ignoring the strong temporal continuity in real-world scenes. This leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Sara Shoouri , Morteza Tavakoli Taba , Hun-Seok Kim

Localization and mapping are critical tasks for various applications such as autonomous vehicles and robotics. The challenges posed by outdoor environments present particular complexities due to their unbounded characteristics. In this…

Robotics · Computer Science 2024-04-08 Chenyang Wu , Yifan Duan , Xinran Zhang , Yu Sheng , Jianmin Ji , Yanyong Zhang

Fusing LiDAR and camera information is essential for achieving accurate and reliable 3D object detection in autonomous driving systems. This is challenging due to the difficulty of combining multi-granularity geometric and semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Jiao , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang

Compared with voxel-based grid prediction, in the field of 3D semantic occupation prediction for autonomous driving, GaussianFormer proposed using 3D Gaussian to describe scenes with sparse 3D semantic Gaussian based on objects is another…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Ziyue Zhao , Qining Qi , Jianfa Ma

Collaborative perception in automated vehicles leverages the exchange of information between agents, aiming to elevate perception results. Previous camera-based collaborative 3D perception methods typically employ 3D bounding boxes or…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Rui Song , Chenwei Liang , Hu Cao , Zhiran Yan , Walter Zimmer , Markus Gross , Andreas Festag , Alois Knoll

With the prevalence of multimodal learning, camera-LiDAR fusion has gained popularity in 3D object detection. Although multiple fusion approaches have been proposed, they can be classified into either sparse-only or dense-only fashion based…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Yulu Gao , Chonghao Sima , Shaoshuai Shi , Shangzhe Di , Si Liu , Hongyang Li

3D semantic occupancy prediction has become a crucial perception task for comprehensive scene understanding in autonomous driving. While recent advances have explored 3D Gaussian splatting for occupancy modeling to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Xiaoyang Yan , Muleilan Pei , Shaojie Shen

The LiDAR 3D object detector that strikes a balance between accuracy and speed is crucial for achieving real-time perception in autonomous driving. However, many existing LiDAR detection models depend on complex feature transformations,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Rui Yu , Runkai Zhao , Jiagen Li , Qingsong Zhao , HuaiCheng Yan , Meng Wang

Vision-based 3D occupancy prediction has become a popular research task due to its versatility and affordability. Nowadays, conventional methods usually project the image-based vision features to 3D space and learn the geometric information…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Yubo Cui , Zhiheng Li , Jiaqiang Wang , Zheng Fang

Camera and LiDAR serve as informative sensors for accurate and robust autonomous driving systems. However, these sensors often exhibit heterogeneous natures, resulting in distributional modality gaps that present significant challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yiran Yang , Xu Gao , Tong Wang , Xin Hao , Yifeng Shi , Xiao Tan , Xiaoqing Ye , Jingdong Wang

3D semantic occupancy prediction is a pivotal task in the field of autonomous driving. Recent approaches have made great advances in 3D semantic occupancy predictions on a single modality. However, multi-modal semantic occupancy prediction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Jingyi Pan , Zipeng Wang , Lin Wang

Capturing 4D spatiotemporal surroundings is crucial for the safe and reliable operation of robots in dynamic environments. However, most existing methods address only one side of the problem: they either provide coarse geometric tracking…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Maximilian Luz , Rohit Mohan , Thomas Nürnberg , Yakov Miron , Daniele Cattaneo , Abhinav Valada

This paper addresses the limitations of existing 3D Gaussian Splatting (3DGS) methods, particularly their reliance on adaptive density control, which can lead to floating artifacts and inefficient resource usage. We propose a novel densify…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Phurtivilai Patt , Leyang Huang , Yinqiang Zhang , Yang Lei

Vision-based autonomous driving shows great potential due to its satisfactory performance and low costs. Most existing methods adopt dense representations (e.g., bird's eye view) or sparse representations (e.g., instance boxes) for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Wenzhao Zheng , Junjie Wu , Yao Zheng , Sicheng Zuo , Zixun Xie , Longchao Yang , Yong Pan , Zhihui Hao , Peng Jia , Xianpeng Lang , Shanghang Zhang

LiDAR-based sparse 3D object detection plays a crucial role in autonomous driving applications due to its computational efficiency advantages. Existing methods either use the features of a single central voxel as an object proxy, or treat…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Lin Liu , Ziying Song , Qiming Xia , Feiyang Jia , Caiyan Jia , Lei Yang , Hongyu Pan

3D occupancy prediction is important for autonomous driving due to its comprehensive perception of the surroundings. To incorporate sequential inputs, most existing methods fuse representations from previous frames to infer the current 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Sicheng Zuo , Wenzhao Zheng , Yuanhui Huang , Jie Zhou , Jiwen Lu

LiDAR-camera fusion can enhance the performance of 3D object detection by utilizing complementary information between depth-aware LiDAR points and semantically rich images. Existing voxel-based methods face significant challenges when…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Ziying Song , Guoxin Zhang , Jun Xie , Lin Liu , Caiyan Jia , Shaoqing Xu , Zhepeng Wang