English
Related papers

Related papers: Flow-guided Motion Prediction with Semantics and D…

200 papers

Semantic 3D mapping can be used for many applications such as robot navigation and virtual interaction. In recent years, there has been great progress in semantic segmentation and geometric 3D mapping. However, it is still challenging to…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Shichao Yang , Yulan Huang , Sebastian Scherer

Effective robotic autonomy in unknown environments demands proactive exploration and precise understanding of both geometry and semantics. In this paper, we propose ActiveSGM, an active semantic mapping framework designed to predict the…

Robotics · Computer Science 2025-11-14 Liyan Chen , Huangying Zhan , Hairong Yin , Yi Xu , Philippos Mordohai

The autonomous driving field has seen remarkable advancements in various topics, such as object recognition, trajectory prediction, and motion planning. However, current approaches face limitations in effectively comprehending the complex…

Computation and Language · Computer Science 2025-03-25 Hongkuan Zhou , Stefan Schmid , Yicong Li , Lavdim Halilaj , Xiangtong Yao , Wei cao

Occupancy grid maps (OGMs) are fundamental to most systems for autonomous robotic navigation. However, CPU-based implementations struggle to keep up with data rates from modern 3D lidar sensors, and provide little capacity for modern…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Kazys Stepanas , Jason Williams , Emili Hernández , Fabio Ruetz , Thomas Hines

In autonomous vehicles, understanding the surrounding 3D environment of the ego vehicle in real-time is essential. A compact way to represent scenes while encoding geometric distances and semantic object information is via 3D semantic…

Robotics · Computer Science 2024-05-21 Samuel Sze , Lars Kunze

Estimating 3D occupancy and motion at the vehicle's surroundings is essential for autonomous driving, enabling situational awareness in dynamic environments. Existing approaches jointly learn geometry and motion but rely on expensive 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xavier Timoneda , Markus Herb , Fabian Duerr , Daniel Goehring

Existing solutions for 3D semantic occupancy prediction typically treat the task as a one-shot 3D voxel-wise segmentation perception problem. These discriminative methods focus on learning the mapping between the inputs and occupancy map in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Guoqing Wang , Zhongdao Wang , Pin Tang , Jilai Zheng , Xiangxuan Ren , Bailan Feng , Chao Ma

Occupancy grid mapping is an important component in road scene understanding for autonomous driving. It encapsulates information of the drivable area, road obstacles and enables safe autonomous driving. Radars are an emerging sensor in…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Liat Sless , Gilad Cohen , Bat El Shlomo , Shaul Oron

Drivable free space information is vital for autonomous vehicles that have to plan evasive maneuvers in real-time. In this paper, we present a new efficient method for environmental free space detection with laser scanner based on 2D…

Robotics · Computer Science 2020-07-01 Hesham M. Eraqi , Jens Honer , Sebastian Zuther

3D semantic occupancy prediction is one of the crucial tasks of autonomous driving. It enables precise and safe interpretation and navigation in complex environments. Reliable predictions rely on effective sensor fusion, as different…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Tomislav Pavković , Mohammad-Ali Nikouei Mahani , Johannes Niedermayer , Johannes Betz

Predicting the trajectories of surrounding agents is an essential ability for autonomous vehicles navigating through complex traffic scenes. The future trajectories of agents can be inferred using two important cues: the locations and past…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Kaouther Messaoud , Nachiket Deo , Mohan M. Trivedi , Fawzi Nashashibi

Environment modeling in autonomous driving is realized by two fundamental approaches, grid-based and feature-based approach. Both methods interpret the environment differently and show some situation-dependent beneficial realizations. In…

Robotics · Computer Science 2019-12-06 Nils Rexin , Marcel Musch , Klaus Dietmayer

In order to plan a safe maneuver an autonomous vehicle must accurately perceive its environment, and understand the interactions among traffic participants. In this paper, we aim to learn scene-consistent motion forecasts of complex urban…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Sergio Casas , Cole Gulino , Simon Suo , Katie Luo , Renjie Liao , Raquel Urtasun

Automated driving fundamentally requires knowledge about the surrounding geometry of the scene. Modern approaches use only captured images to predict occupancy maps that represent the geometry. Training these approaches requires accurate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Jonas Kälble , Sascha Wirges , Maxim Tatarchenko , Eddy Ilg

In autonomous driving, an accurate understanding of environment, e.g., the vehicle-to-vehicle and vehicle-to-lane interactions, plays a critical role in many driving tasks such as trajectory prediction and motion planning. Environment…

Robotics · Computer Science 2023-06-01 Zihao Wen , Yifan Zhang , Xinhong Chen , Jianping Wang

3D occupancy prediction based on multi-sensor fusion,crucial for a reliable autonomous driving system, enables fine-grained understanding of 3D scenes. Previous fusion-based 3D occupancy predictions relied on depth estimation for processing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ji Zhang , Yiran Ding , Zixin Liu

We propose an architecture and training scheme to predict video frames by explicitly modeling dis-occlusions and capturing the evolution of semantically consistent regions in the video. The scene layout (semantic map) and motion (optical…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Xinzhu Bei , Yanchao Yang , Stefano Soatto

Occupancy grids are the most common framework when it comes to creating a map of the environment using a robot. This paper studies occupancy grids from the motion planning perspective and proposes a mapping method that provides richer data…

Robotics · Computer Science 2016-09-20 Ali-akbar Agha-mohammadi

3D occupancy prediction is critical for comprehensive scene understanding in vision-centric autonomous driving. Recent advances have explored utilizing 3D semantic Gaussians to model occupancy while reducing computational overhead, but they…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Xiaoyang Yan , Muleilan Pei , Shaojie Shen

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based scene flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Rahul Ahuja , Chris Baker , Wilko Schwarting