English
Related papers

Related papers: EfficientPS: Efficient Panoptic Segmentation

200 papers

Panoptic scene understanding and tracking of dynamic agents are essential for robots and automated vehicles to navigate in urban environments. As LiDARs provide accurate illumination-independent geometric depictions of the scene, performing…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Whye Kit Fong , Rohit Mohan , Juana Valeria Hurtado , Lubing Zhou , Holger Caesar , Oscar Beijbom , Abhinav Valada

Panoptic segmentation as an integrated task of both static environmental understanding and dynamic object identification, has recently begun to receive broad research interest. In this paper, we propose a new computationally efficient LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Ryan Razani , Ran Cheng , Enxu Li , Ehsan Taghavi , Yuan Ren , Liu Bingbing

Panoptic segmentation presents a new challenge in exploiting the merits of both detection and segmentation, with the aim of unifying instance segmentation and semantic segmentation in a single framework. However, an efficient solution for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Zixiang Zhou , Yang Zhang , Hassan Foroosh

Semantic scene understanding is an essential task for self-driving vehicles and mobile robots. In our work, we aim to estimate a semantic segmentation map, in which the foreground objects are removed and semantically inpainted with…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Chenyang Lu , Gijs Dubbelman

In recent years, the concept of artificial intelligence (AI) has become a prominent keyword because it is promising in solving complex tasks. The need for human expertise in specific areas may no longer be needed because machines have…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Ehsan Rassekh

Classic computer vision algorithms, instance segmentation, and semantic segmentation can not provide a holistic understanding of the surroundings for the visually impaired. In this paper, we utilize panoptic segmentation to assist the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Wei Mao , Jiaming Zhang , Kailun Yang , Rainer Stiefelhagen

This paper tackles the problem of real-time semantic segmentation of high definition videos using a hybrid GPU / CPU approach. We propose an Efficient Video Segmentation(EVS) pipeline that combines: (i) On the CPU, a very fast optical flow…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Matthieu Paul , Christoph Mayer , Luc Van Gool , Radu Timofte

The accuracy-speed-memory trade-off is always the priority to consider for several computer vision perception tasks. Previous methods mainly focus on a single or small couple of these tasks, such as creating effective data augmentation,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Xinhao Xiang , Simon Dräger , Jiawei Zhang

Panoptic segmentation aims to perform instance segmentation for foreground instances and semantic segmentation for background stuff simultaneously. The typical top-down pipeline concentrates on two key issues: 1) how to effectively model…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Yifeng Chen , Guangchen Lin , Songyuan Li , Bourahla Omar , Yiming Wu , Fangfang Wang , Junyi Feng , Mingliang Xu , Xi Li

Instance segmentation is an important task for biomedical and biological image analysis. Due to the complicated background components, the high variability of object appearances, numerous overlapping objects, and ambiguous object…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Dongnan Liu , Donghao Zhang , Yang Song , Heng Huang , Weidong Cai

Addressing Lidar Panoptic Segmentation (LPS ) is crucial for safe deployment of autonomous vehicles. LPS aims to recognize and segment lidar points w.r.t. a pre-defined vocabulary of semantic classes, including thing classes of countable…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Anirudh S Chakravarthy , Meghana Reddy Ganesina , Peiyun Hu , Laura Leal-Taixe , Shu Kong , Deva Ramanan , Aljosa Osep

We demonstrate our solution for the 2019 COCO panoptic segmentation task. Our method first performs instance segmentation and semantic segmentation separately, then combines the two to generate panoptic segmentation results. To enhance the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Mehmet Yildirim , Yogesh Langhe

Learning to reliably perceive and understand the scene is an integral enabler for robots to operate in the real-world. This problem is inherently challenging due to the multitude of object types as well as appearance changes caused by…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Abhinav Valada , Rohit Mohan , Wolfram Burgard

Point cloud semantic segmentation plays an essential role in autonomous driving, providing vital information about drivable surfaces and nearby objects that can aid higher level tasks such as path planning and collision avoidance. While…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Ozan Unal , Luc Van Gool , Dengxin Dai

Autonomous vehicles demand high accuracy and robustness of perception algorithms. To develop efficient and scalable perception algorithms, the maximum information should be extracted from the available sensor data. In this work, we present…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Sebastian Huch , Florian Sauerbeck , Johannes Betz

Panoptic segmentation assigns semantic and instance ID labels to every pixel of an image. As permutations of instance IDs are also valid solutions, the task requires learning of high-dimensional one-to-many mapping. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Ting Chen , Lala Li , Saurabh Saxena , Geoffrey Hinton , David J. Fleet

Autonomous driving systems rely on panoptic driving perception that requires both precision and real-time performance. In this work, we propose RMT-PPAD, a real-time, transformer-based multi-task model that jointly performs object…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jiayuan Wang , Q. M. Jonathan Wu , Katsuya Suto , Ning Zhang

With the rapid advances of autonomous driving, it becomes critical to equip its sensing system with more holistic 3D perception. However, existing works focus on parsing either the objects (e.g. cars and pedestrians) or scenes (e.g. trees…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Fangzhou Hong , Hui Zhou , Xinge Zhu , Hongsheng Li , Ziwei Liu

Image Segmentation plays an essential role in computer vision and image processing with various applications from medical diagnosis to autonomous car driving. A lot of segmentation algorithms have been proposed for addressing specific…

Computer Vision and Pattern Recognition · Computer Science 2021-01-18 Yi Liu , Lutao Chu , Guowei Chen , Zewu Wu , Zeyu Chen , Baohua Lai , Yuying Hao

Semantic segmentation is fundamental to vision systems requiring pixel-level scene understanding, yet deploying it on resource-constrained devices demands efficient architectures. Although existing methods achieve real-time inference…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Shi-Chen Zhang , Yunheng Li , Yu-Huan Wu , Qibin Hou , Ming-Ming Cheng