English
Related papers

Related papers: Towards accurate instance segmentation in large-sc…

200 papers

We present a single network method for panoptic segmentation. This method combines the predictions from a jointly trained semantic and instance segmentation network using heuristics. Joint training is the first step towards an end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Daan de Geus , Panagiotis Meletis , Gijs Dubbelman

The increasing relevance of panoptic segmentation is tied to the advancements in autonomous driving and AR/VR applications. However, the deployment of such models has been limited due to the expensive nature of dense data annotation, giving…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Elham Amin Mansour , Ozan Unal , Suman Saha , Benjamin Bejar , Luc Van Gool

With the rapid advances of autonomous driving, it becomes critical to equip its sensing system with more holistic 3D perception. However, existing works focus on parsing either the objects (e.g. cars and pedestrians) or scenes (e.g. trees…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Fangzhou Hong , Hui Zhou , Xinge Zhu , Hongsheng Li , Ziwei Liu

Panoptic scene understanding and tracking of dynamic agents are essential for robots and automated vehicles to navigate in urban environments. As LiDARs provide accurate illumination-independent geometric depictions of the scene, performing…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Whye Kit Fong , Rohit Mohan , Juana Valeria Hurtado , Lubing Zhou , Holger Caesar , Oscar Beijbom , Abhinav Valada

Deep learning techniques have become the to-go models for most vision-related tasks on 2D images. However, their power has not been fully realised on several tasks in 3D space, e.g., 3D scene understanding. In this work, we jointly address…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Quang-Hieu Pham , Duc Thanh Nguyen , Binh-Son Hua , Gemma Roig , Sai-Kit Yeung

Panoptic segmentation as an integrated task of both static environmental understanding and dynamic object identification, has recently begun to receive broad research interest. In this paper, we propose a new computationally efficient LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Ryan Razani , Ran Cheng , Enxu Li , Ehsan Taghavi , Yuan Ren , Liu Bingbing

Forecasting of a representation is important for safe and effective autonomy. For this, panoptic segmentations have been studied as a compelling representation in recent work. However, recent state-of-the-art on panoptic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Colin Graber , Cyril Jazra , Wenjie Luo , Liangyan Gui , Alexander Schwing

We focus on the problem of class-agnostic instance segmentation of LiDAR point clouds. We propose an approach that combines graph-theoretic search with data-driven learning: it searches over a set of candidate segmentations and returns one…

Robotics · Computer Science 2019-12-12 Peiyun Hu , David Held , Deva Ramanan

We propose a simple yet effective proposal-free architecture for lidar panoptic segmentation. We jointly optimize both semantic segmentation and class-agnostic instance classification in a single network using a pillar-based bird's-eye view…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Qi Chen , Sourabh Vora

Semantic segmentation is a fundamental task for agricultural robots to understand the surrounding environments in natural orchards. The recent development of the LiDAR techniques enables the robot to acquire accurate range measurements of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Hanwen Kang , Xing Wang

The current state-of-the-art methods in 3D instance segmentation typically involve a clustering step, despite the tendency towards heuristics, greedy algorithms, and a lack of robustness to the changes in data statistics. In contrast, we…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Tong He , Wei Yin , Chunhua Shen , Anton van den Hengel

In the field of SLAM (Simultaneous Localization And Mapping) for robot navigation, mapping the environment is an important task. In this regard the Lidar sensor can produce near accurate 3D map of the environment in the format of point…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Aritra Mukherjee , Sourya Dipta Das , Jasorsi Ghosh , Ananda S. Chowdhury , Sanjoy Kumar Saha

Panoptic segmentation aims to perform instance segmentation for foreground instances and semantic segmentation for background stuff simultaneously. The typical top-down pipeline concentrates on two key issues: 1) how to effectively model…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Yifeng Chen , Guangchen Lin , Songyuan Li , Bourahla Omar , Yiming Wu , Fangfang Wang , Junyi Feng , Mingliang Xu , Xi Li

We demonstrate our solution for the 2019 COCO panoptic segmentation task. Our method first performs instance segmentation and semantic segmentation separately, then combines the two to generate panoptic segmentation results. To enhance the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Mehmet Yildirim , Yogesh Langhe

Instance segmentation is an important task for scene understanding. Compared to the fully-developed 2D, 3D instance segmentation for point clouds have much room to improve. In this paper, we present PointGroup, a new end-to-end bottom-up…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Li Jiang , Hengshuang Zhao , Shaoshuai Shi , Shu Liu , Chi-Wing Fu , Jiaya Jia

To autonomously navigate and plan interactions in real-world environments, robots require the ability to robustly perceive and map complex, unstructured surrounding scenes. Besides building an internal representation of the observed scene…

3D panoptic segmentation is a challenging perception task, especially in autonomous driving. It aims to predict both semantic and instance annotations for 3D points in a scene. Although prior 3D panoptic segmentation approaches have…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Zihao Xiao , Longlong Jing , Shangxuan Wu , Alex Zihao Zhu , Jingwei Ji , Chiyu Max Jiang , Wei-Chih Hung , Thomas Funkhouser , Weicheng Kuo , Anelia Angelova , Yin Zhou , Shiwei Sheng

A main bottleneck of learning-based robotic scene understanding methods is the heavy reliance on extensive annotated training data, which often limits their generalization ability. In LiDAR panoptic segmentation, this challenge becomes even…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Ahmet Selim Çanakçı , Niclas Vödisch , Kürsat Petek , Wolfram Burgard , Abhinav Valada

Given the prominence of current 3D sensors, a fine-grained analysis on the basic point cloud data is worthy of further investigation. Particularly, real point cloud scenes can intuitively capture complex surroundings in the real world, but…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Shi Qiu , Saeed Anwar , Nick Barnes

This paper introduces a novel approach to 4D Panoptic LiDAR Segmentation that decouples semantic and instance segmentation, leveraging single-scan semantic predictions as prior information for instance segmentation. Our method D-PLS first…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Maik Steinhauser , Laurenz Reichardt , Nikolas Ebert , Oliver Wasenmüller