English
Related papers

Related papers: Lidar Panoptic Segmentation in an Open World

200 papers

Perception is a key building block of autonomously acting vision systems such as autonomous vehicles. It is crucial that these systems are able to understand their surroundings in order to operate safely and robustly. Additionally,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Matteo Sodano , Federico Magistri , Jens Behley , Cyrill Stachniss

Semantic segmentation models are typically trained on a fixed set of classes, limiting their applicability in open-world scenarios. Class-incremental semantic segmentation aims to update models with emerging new classes while preventing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Julia Hindel , Daniele Cattaneo , Abhinav Valada

Semantic segmentation is a key technique that enables mobile robots to understand and navigate surrounding environments autonomously. However, most existing works focus on segmenting known objects, overlooking the identification of unknown…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Wenbang Deng , Xieyuanli Chen , Qinghua Yu , Yunze He , Junhao Xiao , Huimin Lu

With the rapid advances of autonomous driving, it becomes critical to equip its sensing system with more holistic 3D perception. However, existing works focus on parsing either the objects (e.g. cars and pedestrians) or scenes (e.g. trees…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Fangzhou Hong , Hui Zhou , Xinge Zhu , Hongsheng Li , Ziwei Liu

In autonomous driving, the novel objects and lack of annotations challenge the traditional 3D LiDAR semantic segmentation based on deep learning. Few-shot learning is a feasible way to solve these issues. However, currently few-shot…

Robotics · Computer Science 2023-03-06 Jilin Mei , Junbao Zhou , Yu Hu

3D semantic segmentation is one of the key tasks for autonomous driving system. Recently, deep learning models for 3D semantic segmentation task have been widely researched, but they usually require large amounts of training data. However,…

Robotics · Computer Science 2020-02-24 Yancheng Pan , Biao Gao , Jilin Mei , Sibo Geng , Chengkun Li , Huijing Zhao

Autonomous vehicles need to have a semantic understanding of the three-dimensional world around them in order to reason about their environment. State of the art methods use deep neural networks to predict semantic classes for each point in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Larissa T. Triess , David Peter , Christoph B. Rist , J. Marius Zöllner

We present a self-supervised learning approach for the semantic segmentation of lidar frames. Our method is used to train a deep point cloud segmentation architecture without any human annotation. The annotation process is automated with…

Robotics · Computer Science 2020-12-11 Hugues Thomas , Ben Agro , Mona Gridseth , Jian Zhang , Timothy D. Barfoot

Point cloud semantic segmentation plays an essential role in autonomous driving, providing vital information about drivable surfaces and nearby objects that can aid higher level tasks such as path planning and collision avoidance. While…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Ozan Unal , Luc Van Gool , Dengxin Dai

We address the problem of unsupervised semantic segmentation of outdoor LiDAR point clouds in diverse traffic scenarios. The key idea is to leverage the spatiotemporal nature of a dynamic point cloud sequence and introduce drastically…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Xiao Li , Pan He , Aotian Wu , Sanjay Ranka , Anand Rangarajan

3D panoptic segmentation is a challenging perception task, especially in autonomous driving. It aims to predict both semantic and instance annotations for 3D points in a scene. Although prior 3D panoptic segmentation approaches have…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Zihao Xiao , Longlong Jing , Shangxuan Wu , Alex Zihao Zhu , Jingwei Ji , Chiyu Max Jiang , Wei-Chih Hung , Thomas Funkhouser , Weicheng Kuo , Anelia Angelova , Yin Zhou , Shiwei Sheng

Point cloud segmentation (PCS) is to classify each point in point clouds. The task enables robots to parse their 3D surroundings and run autonomously. According to different point cloud representations, existing PCS models can be roughly…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Bike Chen , Antti Tikanmäki , Juha Röning

3D panoptic segmentation is a challenging perception task that requires both semantic segmentation and instance segmentation. In this task, we notice that images could provide rich texture, color, and discriminative information, which can…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Zhiwei Zhang , Zhizhong Zhang , Qian Yu , Ran Yi , Yuan Xie , Lizhuang Ma

Many top-down architectures for instance segmentation achieve significant success when trained and tested on pre-defined closed-world taxonomy. However, when deployed in the open world, they exhibit notable bias towards seen classes and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Tarun Kalluri , Weiyao Wang , Heng Wang , Manmohan Chandraker , Lorenzo Torresani , Du Tran

Within a perception framework for autonomous mobile and robotic systems, semantic analysis of 3D point clouds typically generated by LiDARs is key to numerous applications, such as object detection and recognition, and scene reconstruction.…

Robotics · Computer Science 2024-10-14 Samir Abou Haidar , Alexandre Chariot , Mehdi Darouich , Cyril Joly , Jean-Emmanuel Deschaud

The ability to deploy robots that can operate safely in diverse environments is crucial for developing embodied intelligent agents. As a community, we have made tremendous progress in within-domain LiDAR semantic segmentation. However, do…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Cristiano Saltori , Aljoša Ošep , Elisa Ricci , Laura Leal-Taixé

The process of segmenting point cloud data into several homogeneous areas with points in the same region having the same attributes is known as 3D segmentation. Segmentation is challenging with point cloud data due to substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Siddiqui Muhammad Yasir , Hyunsik Ahn

We tackle the novel class discovery in point cloud segmentation, which discovers novel classes based on the semantic knowledge of seen classes. Existing work proposes an online point-wise clustering method with a simplified equal class-size…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Ruijie Xu , Chuyu Zhang , Hui Ren , Xuming He

We propose and study a task we name panoptic segmentation (PS). Panoptic segmentation unifies the typically distinct tasks of semantic segmentation (assign a class label to each pixel) and instance segmentation (detect and segment each…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Alexander Kirillov , Kaiming He , Ross Girshick , Carsten Rother , Piotr Dollár

In this study, we present a novel LiDAR-based semantic segmentation framework tailored for autonomous forklifts operating in complex outdoor environments. Central to our approach is the integration of a dual LiDAR system, which combines…

Robotics · Computer Science 2025-05-29 Benjamin Serfling , Hannes Reichert , Lorenzo Bayerlein , Konrad Doll , Kati Radkhah-Lens