English
Related papers

Related papers: Real-time Semantic 3D Dense Occupancy Mapping with…

200 papers

3D semantic maps have played an increasingly important role in high-precision robot localization and scene understanding. However, real-time construction of semantic maps requires mobile edge devices with extremely high computing power,…

Robotics · Computer Science 2024-12-03 Jiaxing Zhang , Luosong Guo , Kun Zhu , Houming Qiu

Semantic occupancy perception is essential for autonomous driving, as automated vehicles require a fine-grained perception of the 3D urban structures. However, existing relevant benchmarks lack diversity in urban scenes, and they only…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Xiaofeng Wang , Zheng Zhu , Wenbo Xu , Yunpeng Zhang , Yi Wei , Xu Chi , Yun Ye , Dalong Du , Jiwen Lu , Xingang Wang

This paper focuses on online occupancy mapping and real-time collision checking onboard an autonomous robot navigating in a large unknown environment. Commonly used voxel and octree map representations can be easily maintained in a small…

Robotics · Computer Science 2021-07-13 Thai Duong , Michael Yip , Nikolay Atanasov

With the aim of bridging the gap between high quality reconstruction and mobile robot motion planning, we propose an efficient system that leverages the concept of adaptive-resolution volumetric mapping, which naturally integrates with the…

Real-time scene reconstruction from depth data inevitably suffers from occlusion, thus leading to incomplete 3D models. Partial reconstructions, in turn, limit the performance of algorithms that leverage them for applications in the context…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Shun-Cheng Wu , Keisuke Tateno , Nassir Navab , Federico Tombari

Occupancy prediction infers fine-grained 3D geometry and semantics from camera images of the surrounding environment, making it a critical perception task for autonomous driving. Existing methods either adopt dense grids as scene…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Yunxiao Shi , Yinhao Zhu , Shizhong Han , Jisoo Jeong , Amin Ansari , Hong Cai , Fatih Porikli

We present a novel 3D mapping method leveraging the recent progress in neural implicit representation for 3D reconstruction. Most existing state-of-the-art neural implicit representation methods are limited to object-level reconstructions…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Stefan Lionar , Lukas Schmid , Cesar Cadena , Roland Siegwart , Andrei Cramariuc

Occupancy mapping is a fundamental component of robotic systems to reason about the unknown and known regions of the environment. This article presents an efficient occupancy mapping framework for high-resolution LiDAR sensors, termed…

Robotics · Computer Science 2023-10-06 Yixi Cai , Fanze Kong , Yunfan Ren , Fangcheng Zhu , Jiarong Lin , Fu Zhang

In this paper, we explore a novel point representation for 3D occupancy prediction from multi-view images, which is named Occupancy as Set of Points. Existing camera-based methods tend to exploit dense volume-based representation to predict…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yiang Shi , Tianheng Cheng , Qian Zhang , Wenyu Liu , Xinggang Wang

In this paper we provide an overview of a new framework for robot perception, real-world modelling, and navigation that uses a stochastic tesselated representation of spatial information called the Occupancy Grid. The Occupancy Grid is a…

Robotics · Computer Science 2013-04-05 A. Elfes

Semantic occupancy prediction aims to infer dense geometry and semantics of surroundings for an autonomous agent to operate safely in the 3D environment. Existing occupancy prediction methods are almost entirely trained on human-annotated…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhiyu Tan , Zichao Dong , Cheng Zhang , Weikun Zhang , Hang Ji , Hao Li

Occupancy prediction reconstructs 3D structures of surrounding environments. It provides detailed information for autonomous driving planning and navigation. However, most existing methods heavily rely on the LiDAR point clouds to generate…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Chubin Zhang , Juncheng Yan , Yi Wei , Jiaxin Li , Li Liu , Yansong Tang , Yueqi Duan , Jiwen Lu

3D semantic occupancy prediction is an important task for robust vision-centric autonomous driving, which predicts fine-grained geometry and semantics of the surrounding scene. Most existing methods leverage dense grid-based scene…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Yuanhui Huang , Amonnut Thammatadatrakoon , Wenzhao Zheng , Yunpeng Zhang , Dalong Du , Jiwen Lu

A metric-accurate semantic 3D representation is essential for many robotic tasks. This work proposes a simple, yet powerful, way to integrate the 2D embeddings of a Vision-Language Model in a metric-accurate 3D representation at real-time.…

Robotics · Computer Science 2025-08-11 Christian Rauch , Björn Ellensohn , Linus Nwankwo , Vedant Dave , Elmar Rueckert

While 2D occupancy maps commonly used in mobile robotics enable safe navigation in indoor environments, in order for robots to understand and interact with their environment and its inhabitants representing 3D geometry and semantic…

Robotics · Computer Science 2025-01-09 Krishnananda Prabhu Sivananda , Francesco Verdoja , Ville Kyrki

When exploring new areas, robotic systems generally exclusively plan and execute controls over geometry that has been directly measured. When entering space that was previously obstructed from view such as turning corners in hallways or…

Robotics · Computer Science 2024-03-19 Alec Reed , Brendan Crowe , Doncey Albin , Lorin Achey , Bradley Hayes , Christoffer Heckman

3D semantic occupancy prediction has emerged as a critical perception task for autonomous driving due to its ability to offer voxel-level semantic and geometric understanding of the environment. However, such a refined representation for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Hanlin Wu , Pengfei Lin , Ehsan Javanmardi , Naren Bao , Bo Qian , Hao Si , Manabu Tsukada

Robotic perception is currently at a cross-roads between modern methods, which operate in an efficient latent space, and classical methods, which are mathematically founded and provide interpretable, trustworthy results. In this paper, we…

3D semantic occupancy prediction is an essential part of autonomous driving, focusing on capturing the geometric details of scenes. Off-road environments are rich in geometric information, therefore it is suitable for 3D semantic occupancy…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Heng Zhai , Jilin Mei , Chen Min , Liang Chen , Fangzhou Zhao , Yu Hu

The availability of real-time semantics greatly improves the core geometric functionality of SLAM systems, enabling numerous robotic and AR/VR applications. We present a new methodology for real-time semantic mapping from RGB-D sequences…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Jingwen Wang , Juan Tarrio , Lourdes Agapito , Pablo F. Alcantarilla , Alexander Vakhitov