English
Related papers

Related papers: GaussianOcc3D: A Gaussian-Based Adaptive Multi-mod…

200 papers

Recent diffusion models have demonstrated remarkable performance in both 3D scene generation and perception tasks. Nevertheless, existing methods typically separate these two processes, acting as a data augmenter to generate synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Bohan Li , Xin Jin , Jianan Wang , Yukai Shi , Yasheng Sun , Xiaofeng Wang , Zhuang Ma , Baao Xie , Chao Ma , Xiaokang Yang , Wenjun Zeng

TL;DR: Gaussian Splatting is a widely adopted approach for 3D scene representation, offering efficient, high-quality reconstruction and rendering. A key reason for its success is the simplicity of representing scenes with sets of Gaussians,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jiahuan Cheng , Jan-Nico Zaech , Luc Van Gool , Danda Pani Paudel

Autonomous driving has the potential to significantly enhance productivity and provide numerous societal benefits. Ensuring robustness in these safety-critical systems is essential, particularly when vehicles must navigate adverse weather…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Severin Heidrich , Till Beemelmanns , Alexey Nekrasov , Bastian Leibe , Lutz Eckstein

Learning 3D scene geometry and semantics from images is a core challenge in computer vision and a key capability for autonomous driving. Since large-scale 3D annotation is prohibitively expensive, recent work explores self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Adam Lilja , Ji Lan , Junsheng Fu , Lars Hammarstrand

Recent advancements in 3D scene understanding have made significant strides in enabling interaction with scenes using open-vocabulary queries, particularly for VR/AR and robotic applications. Nevertheless, existing methods are hindered by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Dianyi Yang , Xihan Wang , Yu Gao , Shiyang Liu , Bohan Ren , Yufeng Yue , Yi Yang

3D occupancy prediction is an important task for the robustness of vision-centric autonomous driving, which aims to predict whether each point is occupied in the surrounding 3D space. Existing methods usually require 3D occupancy labels to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Yuanhui Huang , Wenzhao Zheng , Borui Zhang , Jie Zhou , Jiwen Lu

Open-vocabulary 3D scene understanding is crucial for applications requiring natural language-driven spatial interpretation, such as robotics and augmented reality. While 3D Gaussian Splatting (3DGS) offers a powerful representation for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Wei Sun , Yanzhao Zhou , Jianbin Jiao , Yuan Li

4D millimeter-wave radar is a promising sensing modality for autonomous driving, yet effective 3D object detection from 4D radar and monocular images remains challenging. Existing fusion approaches either rely on instance proposals lacking…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xiaokai Bai , Chenxu Zhou , Lianqing Zheng , Si-Yuan Cao , Jianan Liu , Xiaohan Zhang , Yiming Li , Zhengzhuang Zhang , Hui-liang Shen

Accurately predicting 3D occupancy grids from visual inputs is critical for autonomous driving, but current discriminative methods struggle with noisy data, incomplete observations, and the complex structures inherent in 3D scenes. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Yunshen Wang , Yicheng Liu , Tianyuan Yuan , Yingshi Liang , Xiuyu Yang , Honggang Zhang , Hang Zhao

Understanding how the surrounding environment changes is crucial for performing downstream tasks safely and reliably in autonomous driving applications. Recent occupancy estimation techniques using only camera images as input can provide…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Junyi Ma , Xieyuanli Chen , Jiawei Huang , Jingyi Xu , Zhen Luo , Jintao Xu , Weihao Gu , Rui Ai , Hesheng Wang

Fusing LiDAR and camera information is essential for achieving accurate and reliable 3D object detection in autonomous driving systems. This is challenging due to the difficulty of combining multi-granularity geometric and semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Jiao , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang

Efficient data utilization is crucial for advancing 3D scene understanding in autonomous driving, where reliance on heavily human-annotated LiDAR point clouds challenges fully supervised methods. Addressing this, our study extends into…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Lingdong Kong , Xiang Xu , Jiawei Ren , Wenwei Zhang , Liang Pan , Kai Chen , Wei Tsang Ooi , Ziwei Liu

Vision-Language Models (VLMs) have shown significant progress in open-set challenges. However, the limited availability of 3D datasets hinders their effective application in 3D scene understanding. We propose LOC, a general language-guided…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yuhang Gao , Xiang Xiang , Sheng Zhong , Guoyou Wang

The significance of informative and robust point representations has been widely acknowledged for 3D scene understanding. Despite existing self-supervised pre-training counterparts demonstrating promising performance, the model collapse and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Lei Yao , Yi Wang , Yi Zhang , Moyun Liu , Lap-Pui Chau

Predicting future trajectories of traffic agents in highly interactive environments is an essential and challenging problem for the safe operation of autonomous driving systems. On the basis of the fact that self-driving vehicles are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chiho Choi , Joon Hee Choi , Jiachen Li , Srikanth Malla

Predicting future trajectories of traffic agents in highly interactive environments is an essential and challenging problem for the safe operation of autonomous driving systems. On the basis of the fact that self-driving vehicles are…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Chiho Choi , Joon Hee Choi , Srikanth Malla , Jiachen Li

Recent advancements in 3D Gaussian Splatting(3DGS) have significantly improved semantic scene understanding, enabling natural language queries to localize objects within a scene. However, existing methods primarily focus on embedding…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Xihan Wang , Dianyi Yang , Yu Gao , Yufeng Yue , Yi Yang , Mengyin Fu

Self-supervised learning has made substantial strides in image processing, while visual pre-training for autonomous driving is still in its infancy. Existing methods often focus on learning geometric scene information while neglecting…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Shaoqing Xu , Fang Li , Shengyin Jiang , Ziying Song , Li Liu , Zhi-xin Yang

Crucial for autonomous exploration, online 3D occupancy prediction and mapping incrementally constructs dense spatial representations on the fly. However, recent Gaussian-centric methods struggle with structural boundary fidelity and rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ruoyu Wang , Yong Liu , Sheng Tao , Yuhang Lin , Yukai Ma

Vision-based 3D occupancy prediction is significantly challenged by the inherent limitations of monocular vision in depth estimation. This paper introduces CVT-Occ, a novel approach that leverages temporal fusion through the geometric…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Zhangchen Ye , Tao Jiang , Chenfeng Xu , Yiming Li , Hang Zhao