English
Related papers

Related papers: GaussRender: Learning 3D Occupancy with Gaussian R…

200 papers

3D occupancy prediction provides a comprehensive description of the surrounding scenes and has become an essential task for 3D perception. Most existing methods focus on offline perception from one or a few views and cannot be applied to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yuqi Wu , Wenzhao Zheng , Sicheng Zuo , Yuanhui Huang , Jie Zhou , Jiwen Lu

Human driver can easily describe the complex traffic scene by visual system. Such an ability of precise perception is essential for driver's planning. To achieve this, a geometry-aware representation that quantizes the physical 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Chonghao Sima , Wenwen Tong , Tai Wang , Li Chen , Silei Wu , Hanming Deng , Yi Gu , Lewei Lu , Ping Luo , Dahua Lin , Hongyang Li

Occupancy prediction reconstructs 3D structures of surrounding environments. It provides detailed information for autonomous driving planning and navigation. However, most existing methods heavily rely on the LiDAR point clouds to generate…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Chubin Zhang , Juncheng Yan , Yi Wei , Jiaxin Li , Li Liu , Yansong Tang , Yueqi Duan , Jiwen Lu

3D Gaussian Splatting has shown impressive novel view synthesis results; nonetheless, it is vulnerable to dynamic objects polluting the input data of an otherwise static scene, so called distractors. Distractors have severe impact on the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Paul Ungermann , Armin Ettenhofer , Matthias Nießner , Barbara Roessle

3D Gaussians have recently emerged as an effective scene representation for real-time splatting and accurate novel-view synthesis, motivating several works to adapt multi-view structure prediction networks to regress per-pixel 3D Gaussians…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Mehdi Hosseinzadeh , Shin-Fang Chng , Yi Xu , Simon Lucey , Ian Reid , Ravi Garg

3D Gaussian Splatting has recently emerged as an efficient solution for high-quality and real-time novel view synthesis. However, its capability for accurate surface reconstruction remains underexplored. Due to the discrete and unstructured…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Qing Li , Huifang Feng , Xun Gong , Yu-Shen Liu

Relying on in-domain annotations and precise sensor-rig priors, existing 3D occupancy prediction methods are limited in both scalability and out-of-domain generalization. While recent visual geometry foundation models exhibit strong…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Anh-Quan Cao , Tuan-Hung Vu

Accurate and realistic 3D scene reconstruction enables the lifelike creation of autonomous driving simulation environments. With advancements in 3D Gaussian Splatting (3DGS), previous studies have applied it to reconstruct complex dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Yedong Shen , Xinran Zhang , Yifan Duan , Shiqi Zhang , Heng Li , Yilong Wu , Jianmin Ji , Yanyong Zhang

A comprehensive understanding of 3D scenes is crucial in autonomous vehicles (AVs), and recent models for 3D semantic occupancy prediction have successfully addressed the challenge of describing real-world objects with varied shapes and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Zhenxing Ming , Julie Stephany Berrio , Mao Shan , Stewart Worrall

Single-image 3D scene reconstruction presents significant challenges due to its inherently ill-posed nature and limited input constraints. Recent advances have explored two promising directions: multiview generative models that train on 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Junlin Hao , Peiheng Wang , Haoyang Wang , Xinggong Zhang , Zongming Guo

Vision-based autonomous driving shows great potential due to its satisfactory performance and low costs. Most existing methods adopt dense representations (e.g., bird's eye view) or sparse representations (e.g., instance boxes) for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Wenzhao Zheng , Junjie Wu , Yao Zheng , Sicheng Zuo , Zixun Xie , Longchao Yang , Yong Pan , Zhihui Hao , Peng Jia , Xianpeng Lang , Shanghang Zhang

We propose a method to enhance 3D Gaussian Splatting (3DGS)~\cite{Kerbl2023}, addressing challenges in initialization, optimization, and density control. Gaussian Splatting is an alternative for rendering realistic images while supporting…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Xingjun Wang , Lianlei Shan

Occupancy estimation has become a prominent task in 3D computer vision, particularly within the autonomous driving community. In this paper, we present a novel approach to occupancy estimation, termed GaussianFlowOcc, which is inspired by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Simon Boeder , Fabian Gigengack , Benjamin Risse

3D occupancy prediction based on multi-sensor fusion,crucial for a reliable autonomous driving system, enables fine-grained understanding of 3D scenes. Previous fusion-based 3D occupancy predictions relied on depth estimation for processing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ji Zhang , Yiran Ding , Zixin Liu

Constructing an occupancy representation of the environment is a fundamental problem for robot autonomy. Many accurate and efficient methods exist that address this problem but most assume that the occupancy states of different elements in…

Robotics · Computer Science 2018-01-24 Ke Sun , Kelsey Saulnier , Nikolay Atanasov , George J. Pappas , Vijay Kumar

Online 3D occupancy prediction provides a comprehensive spatial understanding of embodied environments. While the innovative EmbodiedOcc framework utilizes 3D semantic Gaussians for progressive indoor occupancy prediction, it overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Hao Wang , Xiaobao Wei , Xiaoan Zhang , Jianing Li , Chengyu Bai , Ying Li , Ming Lu , Wenzhao Zheng , Shanghang Zhang

3D occupancy prediction has recently emerged as a new paradigm for holistic 3D scene understanding and provides valuable information for downstream planning in autonomous driving. Most existing methods, however, are computationally…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Yunxiao Shi , Hong Cai , Amin Ansari , Fatih Porikli

Future 3D semantic occupancy forecasting and motion planning are central to autonomous driving, as they require models to reason about how surrounding scenes evolve and how the ego vehicle should act. Existing occupancy world models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Cheng Chen , Hao Huang , Saurabh Bagchi

This paper tackles the intricate challenge of object removal to update the radiance field using the 3D Gaussian Splatting. The main challenges of this task lie in the preservation of geometric consistency and the maintenance of texture…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yuxin Wang , Qianyi Wu , Guofeng Zhang , Dan Xu

3D occupancy prediction is an important task for the robustness of vision-centric autonomous driving, which aims to predict whether each point is occupied in the surrounding 3D space. Existing methods usually require 3D occupancy labels to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Yuanhui Huang , Wenzhao Zheng , Borui Zhang , Jie Zhou , Jiwen Lu