English
Related papers

Related papers: Uncertainty-aware LiDAR Panoptic Segmentation

200 papers

Reliable LiDAR panoptic segmentation (LPS), including both semantic and instance segmentation, is vital for many robotic applications, such as autonomous driving. This work proposes a new LPS framework named PANet to eliminate the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Jianbiao Mei , Yu Yang , Mengmeng Wang , Xiaojun Hou , Laijian Li , Yong Liu

Panoptic segmentation aims to address semantic and instance segmentation simultaneously in a unified framework. However, an efficient solution of panoptic segmentation in applications like autonomous driving is still an open research…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Enxu Li , Ryan Razani , Yixuan Xu , Liu Bingbing

To assure that an autonomous car is driving safely on public roads, its object detection module should not only work correctly, but show its prediction confidence as well. Previous object detectors driven by deep learning do not explicitly…

Robotics · Computer Science 2018-09-10 Di Feng , Lars Rosenbaum , Klaus Dietmayer

Construction sites are challenging environments for autonomous systems due to their unstructured nature and the presence of dynamic actors, such as workers and machinery. This work presents a comprehensive panoptic scene understanding…

Robotics · Computer Science 2024-10-08 Lorenzo Terenzi , Julian Nubert , Pol Eyschen , Pascal Roth , Simin Fei , Edo Jelavic , Marco Hutter

Scene understanding is a pivotal task for autonomous vehicles to safely navigate in the environment. Recent advances in deep learning enable accurate semantic reconstruction of the surroundings from LiDAR data. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Borna Bešić , Nikhil Gosala , Daniele Cattaneo , Abhinav Valada

Semantic segmentation of LiDAR point clouds has been widely studied in recent years, with most existing methods focusing on tackling this task using a single scan of the environment. However, leveraging the temporal stream of observations…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Enxu Li , Sergio Casas , Raquel Urtasun

Panoptic segmentation, which combines instance and semantic segmentation, has gained a lot of attention in autonomous vehicles, due to its comprehensive representation of the scene. This task can be applied for cameras and LiDAR sensors,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Fardin Ayar , Ehsan Javanmardi , Manabu Tsukada , Mahdi Javanmardi , Mohammad Rahmati

Estimating the uncertainty of a neural network plays a fundamental role in safety-critical settings. In perception for autonomous driving, measuring the uncertainty means providing additional calibrated information to downstream tasks, such…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Stefano Gasperini , Jan Haug , Mohammad-Ali Nikouei Mahani , Alvaro Marcos-Ramiro , Nassir Navab , Benjamin Busam , Federico Tombari

Semantic segmentation of LiDAR point clouds is an important task in autonomous driving. However, training deep models via conventional supervised methods requires large datasets which are costly to label. It is critical to have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Minghua Liu , Yin Zhou , Charles R. Qi , Boqing Gong , Hao Su , Dragomir Anguelov

This work presents a probabilistic deep neural network that combines LiDAR point clouds and RGB camera images for robust, accurate 3D object detection. We explicitly model uncertainties in the classification and regression tasks, and…

Robotics · Computer Science 2020-02-04 Di Feng , Yifan Cao , Lars Rosenbaum , Fabian Timm , Klaus Dietmayer

As a rising task, panoptic segmentation is faced with challenges in both semantic segmentation and instance segmentation. However, in terms of speed and accuracy, existing LiDAR methods in the field are still limited. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Jinke Li , Xiao He , Yang Wen , Yuan Gao , Xiaoqiang Cheng , Dan Zhang

LiDAR (Light Detection and Ranging) has become an essential part of the remote sensing toolbox used for biosphere monitoring. In particular, LiDAR provides the opportunity to map forest leaf area with unprecedented accuracy, while leaf area…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Yuchen Bai , Jean-Baptiste Durand , Grégoire Vincent , Florence Forbes

Traversability estimation in rugged, unstructured environments remains a challenging problem in field robotics. Often, the need for precise, accurate traversability estimation is in direct opposition to the limited sensing and compute…

Robotics · Computer Science 2024-07-12 Samuel Triest , David D. Fan , Sebastian Scherer , Ali-Akbar Agha-Mohammadi

Panoptic segmentation is a scene parsing task which unifies semantic segmentation and instance segmentation into one single task. However, the current state-of-the-art studies did not take too much concern on inference time. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Chia-Yuan Chang , Shuo-En Chang , Pei-Yung Hsiao , Li-Chen Fu

Semantic scene understanding, including the perception and classification of moving agents, is essential to enabling safe and robust driving behaviours of autonomous vehicles. Cameras and LiDARs are commonly used for semantic scene…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Matthias Zeller , Daniel Casado Herraez , Bengisu Ayan , Jens Behley , Michael Heidingsfeld , Cyrill Stachniss

Autonomous vehicles need to have a semantic understanding of the three-dimensional world around them in order to reason about their environment. State of the art methods use deep neural networks to predict semantic classes for each point in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Larissa T. Triess , David Peter , Christoph B. Rist , J. Marius Zöllner

Autonomous driving requires the inference of actionable information such as detecting and classifying objects, and determining the drivable space. To this end, we present Multi-View LidarNet (MVLidarNet), a two-stage deep neural network for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Ke Chen , Ryan Oldja , Nikolai Smolyanskiy , Stan Birchfield , Alexander Popov , David Wehr , Ibrahim Eden , Joachim Pehserl

Temporal semantic scene understanding is critical for self-driving cars or robots operating in dynamic environments. In this paper, we propose 4D panoptic LiDAR segmentation to assign a semantic class and a temporally-consistent instance ID…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Mehmet Aygün , Aljoša Ošep , Mark Weber , Maxim Maximov , Cyrill Stachniss , Jens Behley , Laura Leal-Taixé

State-of-the-art lidar place recognition models exhibit unreliable performance when tested on environments different from their training dataset, which limits their use in complex and evolving environments. To address this issue, we…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Keita Mason , Joshua Knights , Milad Ramezani , Peyman Moghadam , Dimity Miller

In this paper, we develop rotation-equivariant neural networks for 4D panoptic segmentation. 4D panoptic segmentation is a benchmark task for autonomous driving that requires recognizing semantic classes and object instances on the road…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Minghan Zhu , Shizhong Han , Hong Cai , Shubhankar Borse , Maani Ghaffari , Fatih Porikli