English
Related papers

Related papers: LiDAR-Camera Fusion for Video Panoptic Segmentatio…

200 papers

LiDAR-based 3D panoptic segmentation often struggles with the inherent sparsity of data from LiDAR sensors, which makes it challenging to accurately recognize distant or small objects. Recently, a few studies have sought to overcome this…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Yining Pan , Qiongjie Cui , Xulei Yang , Na Zhao

The recently proposed panoptic segmentation task presents a significant challenge of image understanding with computer vision by unifying semantic segmentation and instance segmentation tasks. In this paper we present an efficient and novel…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Yang Liu , Pietro Perona , Markus Meister

End-to-end perception and trajectory prediction from raw sensor data is one of the key capabilities for autonomous driving. Modular pipelines restrict information flow and can amplify upstream errors. Recent query-based, fully…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Matej Halinkovic , Nina Masarykova , Alexey Vinel , Marek Galinski

With the development of AI-assisted driving, numerous methods have emerged for ego-vehicle 3D perception tasks, but there has been limited research on roadside perception. With its ability to provide a global view and a broader sensing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Pei Liu , Nanfang Zheng , Yiqun Li , Junlan Chen , Ziyuan Pu

This work studies the semantic segmentation of 3D LiDAR data in dynamic scenes for autonomous driving applications. A system of semantic segmentation using 3D LiDAR data, including range image segmentation, sample generation, inter-frame…

Robotics · Computer Science 2018-09-05 Jilin Mei , Biao Gao , Donghao Xu , Wen Yao , Xijun Zhao , Huijing Zhao

In self-driving applications, LiDAR data provides accurate information about distances in 3D but lacks the semantic richness of camera data. Therefore, state-of-the-art methods for perception in urban scenes fuse data from both sensor…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Royden Wagner , Marvin Klemp , Carlos Fernandez Lopez

Scene understanding based on LiDAR point cloud is an essential task for autonomous cars to drive safely, which often employs spherical projection to map 3D point cloud into multi-channel 2D images for semantic segmentation. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Aoran Xiao , Xiaofei Yang , Shijian Lu , Dayan Guan , Jiaxing Huang

LiDAR point clouds have become the most common data source in autonomous driving. However, due to the sparsity of point clouds, accurate and reliable detection cannot be achieved in specific scenarios. Because of their complementarity with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Leichao Cui , Xiuxian Li , Min Meng , Xiaoyu Mo

High-resolution LiDAR data plays a critical role in 3D semantic segmentation for autonomous driving, but the high cost of advanced sensors limits large-scale deployment. In contrast, low-cost sensors such as 16-channel LiDAR produce sparse…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Alexandros Gkillas , Nikos Piperigkos , Aris S. Lalos

Unsupervised panoptic segmentation aims to partition an image into semantically meaningful regions and distinct object instances without training on manually annotated data. In contrast to prior work on unsupervised panoptic scene…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Oliver Hahn , Christoph Reich , Nikita Araslanov , Daniel Cremers , Christian Rupprecht , Stefan Roth

Depth-aware panoptic segmentation is an emerging topic in computer vision which combines semantic and geometric understanding for more robust scene interpretation. Recent works pursue unified frameworks to tackle this challenge but mostly…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Junwen He , Yifan Wang , Lijun Wang , Huchuan Lu , Jun-Yan He , Jin-Peng Lan , Bin Luo , Yifeng Geng , Xuansong Xie

In this paper, we propose a novel approach to address the problem of camera and radar sensor fusion for 3D object detection in autonomous vehicle perception systems. Our approach builds on recent advances in deep learning and leverages the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Daniel Dworak , Mateusz Komorkiewicz , Paweł Skruch , Jerzy Baranowski

Fully autonomous driving systems require fast detection and recognition of sensitive objects in the environment. In this context, intelligent vehicles should share their sensor data with computing platforms and/or other vehicles, to detect…

Networking and Internet Architecture · Computer Science 2021-04-27 Valentina Rossi , Paolo Testolina , Marco Giordani , Michele Zorzi

Zero-shot 4D segmentation and recognition of arbitrary objects in Lidar is crucial for embodied navigation, with applications ranging from streaming perception to semantic mapping and localization. However, the primary challenge in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yushan Zhang , Aljoša Ošep , Laura Leal-Taixé , Tim Meinhardt

Panoptic segmentation has become a new standard of visual recognition task by unifying previous semantic segmentation and instance segmentation tasks in concert. In this paper, we propose and explore a new video extension of this task,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Dahun Kim , Sanghyun Woo , Joon-Young Lee , In So Kweon

Understanding the scene in which an autonomous robot operates is critical for its competent functioning. Such scene comprehension necessitates recognizing instances of traffic participants along with general scene semantics which can be…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Rohit Mohan , Abhinav Valada

Panoptic segmentation has recently unified semantic and instance segmentation, previously addressed separately, thus taking a step further towards creating more comprehensive and efficient perception systems. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Stefano Gasperini , Mohammad-Ali Nikouei Mahani , Alvaro Marcos-Ramiro , Nassir Navab , Federico Tombari

This paper introduces a novel approach to 4D Panoptic LiDAR Segmentation that decouples semantic and instance segmentation, leveraging single-scan semantic predictions as prior information for instance segmentation. Our method D-PLS first…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Maik Steinhauser , Laurenz Reichardt , Nikolas Ebert , Oliver Wasenmüller

In this paper, we introduce a novel network that generates semantic, instance, and part segmentation using a shared encoder and effectively fuses them to achieve panoptic-part segmentation. Unifying these three segmentation problems allows…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Sravan Kumar Jagadeesh , René Schuster , Didier Stricker

Panoptic segmentation is the combination of semantic and instance segmentation: assign the points in a 3D point cloud to semantic categories and partition them into distinct object instances. It has many obvious applications for outdoor…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Binbin Xiang , Torben Peters , Theodora Kontogianni , Frawa Vetterli , Stefano Puliti , Rasmus Astrup , Konrad Schindler