English
Related papers

Related papers: Lidar Panoptic Segmentation and Tracking without B…

200 papers

Panoptic segmentation presents a new challenge in exploiting the merits of both detection and segmentation, with the aim of unifying instance segmentation and semantic segmentation in a single framework. However, an efficient solution for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Zixiang Zhou , Yang Zhang , Hassan Foroosh

Panoptic segmentation is a key enabler for robotic perception, as it unifies semantic understanding with object-level reasoning. However, the increasing complexity of state-of-the-art models makes them unsuitable for deployment on…

Robotics · Computer Science 2026-05-19 Calvin Galagain , Martyna Poreba , François Goulette , Cyrill Stachniss

3D panoptic segmentation is a challenging perception task that requires both semantic segmentation and instance segmentation. In this task, we notice that images could provide rich texture, color, and discriminative information, which can…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Zhiwei Zhang , Zhizhong Zhang , Qian Yu , Ran Yi , Yuan Xie , Lizhuang Ma

We present a novel end-to-end single-shot method that segments countable object instances (things) as well as background regions (stuff) into a non-overlapping panoptic segmentation at almost video frame rate. Current state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Mark Weber , Jonathon Luiten , Bastian Leibe

4D panoptic LiDAR segmentation is essential for scene understanding in autonomous driving and robotics, combining semantic and instance segmentation with temporal consistency. Current methods, like 4D-PLS and 4D-STOP, use a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Nirit Alkalay , Roy Orfaig , Ben-Zion Bobrovsky

Panoptic Segmentation aims to provide an understanding of background (stuff) and instances of objects (things) at a pixel level. It combines the separate tasks of semantic segmentation (pixel level classification) and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Sumanth Chennupati , Venkatraman Narayanan , Ganesh Sistu , Senthil Yogamani , Samir A Rawashdeh

Most existing instance segmentation methods only focus on improving performance and are not suitable for real-time scenes such as autonomous driving. This paper proposes a real-time framework that segmenting and detecting 3D objects by…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Shengjie Li , Caiyi Xu , Jianping Xing , Yafei Ning , Yonghong Chen

Panoptic segmentation assigns semantic and instance ID labels to every pixel of an image. As permutations of instance IDs are also valid solutions, the task requires learning of high-dimensional one-to-many mapping. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Ting Chen , Lala Li , Saurabh Saxena , Geoffrey Hinton , David J. Fleet

We focus on the problem of class-agnostic instance segmentation of LiDAR point clouds. We propose an approach that combines graph-theoretic search with data-driven learning: it searches over a set of candidate segmentations and returns one…

Robotics · Computer Science 2019-12-12 Peiyun Hu , David Held , Deva Ramanan

Panoptic segmentation, which combines instance and semantic segmentation, has gained a lot of attention in autonomous vehicles, due to its comprehensive representation of the scene. This task can be applied for cameras and LiDAR sensors,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Fardin Ayar , Ehsan Javanmardi , Manabu Tsukada , Mahdi Javanmardi , Mohammad Rahmati

Open-world Instance Segmentation (OIS) is a challenging task that aims to accurately segment every object instance appearing in the current observation, regardless of whether these instances have been labeled in the training set. This is…

Robotics · Computer Science 2023-03-09 Wenbang Deng , Kaihong Huang , Qinghua Yu , Huimin Lu , Zhiqiang Zheng , Xieyuanli Chen

The ability to detect and segment moving objects in a scene is essential for building consistent maps, making future state predictions, avoiding collisions, and planning. In this paper, we address the problem of moving object segmentation…

Temporal semantic scene understanding is critical for self-driving cars or robots operating in dynamic environments. In this paper, we propose 4D panoptic LiDAR segmentation to assign a semantic class and a temporally-consistent instance ID…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Mehmet Aygün , Aljoša Ošep , Mark Weber , Maxim Maximov , Cyrill Stachniss , Jens Behley , Laura Leal-Taixé

Panoptic segmentation is a complex full scene parsing task requiring simultaneous instance and semantic segmentation at high resolution. Current state-of-the-art approaches cannot run in real-time, and simplifying these architectures to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Rui Hou , Jie Li , Arjun Bhargava , Allan Raventos , Vitor Guizilini , Chao Fang , Jerome Lynch , Adrien Gaidon

3D object detection using LiDAR data is an indispensable component for autonomous driving systems. Yet, only a few LiDAR-based 3D object detection methods leverage segmentation information to further guide the detection process. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Hamidreza Fazlali , Yixuan Xu , Yuan Ren , Bingbing Liu

Low-latency instance segmentation of LiDAR point clouds is crucial in real-world applications because it serves as an initial and frequently-used building block in a robot's perception pipeline, where every task adds further delay.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Andreas Reich , Mirko Maehlisch

Lidar sensors are widely used in various applications, ranging from scientific fields over industrial use to integration in consumer products. With an ever growing number of different driver assistance systems, they have been introduced to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Frederik Hasecke , Lukas Hahn , Anton Kummert

Identifying moving objects is a crucial capability for autonomous navigation, consistent map generation, and future trajectory prediction of objects. In this paper, we propose a novel network that addresses the challenge of segmenting…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Neng Wang , Chenghao Shi , Ruibin Guo , Huimin Lu , Zhiqiang Zheng , Xieyuanli Chen

Panoptic segmentation unifies semantic and instance segmentation and thus delivers a semantic class label and, for so-called thing classes, also an instance label per pixel. The differentiation of distinct objects of the same class with a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Tuan Nguyen , Max Mehltretter , Franz Rottensteiner

Deep learning has led to remarkable strides in scene understanding with panoptic segmentation emerging as a key holistic scene interpretation task. However, the performance of panoptic segmentation is severely impacted in the presence of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Rohit Mohan , Kiran Kumaraswamy , Juana Valeria Hurtado , Kürsat Petek , Abhinav Valada