English
Related papers

Related papers: Panoptic-DeepLab: A Simple, Strong, and Fast Basel…

200 papers

Panoptic segmentation of LiDAR point clouds is fundamental to outdoor scene understanding, with autonomous driving being a primary application. While state-of-the-art approaches typically rely on end-to-end deep learning architectures and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Corentin Sautier , Gilles Puy , Alexandre Boulch , Renaud Marlet , Vincent Lepetit

We present a novel end-to-end single-shot method that segments countable object instances (things) as well as background regions (stuff) into a non-overlapping panoptic segmentation at almost video frame rate. Current state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Mark Weber , Jonathon Luiten , Bastian Leibe

Panoptic segmentation, combining semantic and instance segmentation, stands as a cutting-edge computer vision task. Despite recent progress with deep learning models, the dynamic nature of real-world applications necessitates continual…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Beomyoung Kim , Joonsang Yu , Sung Ju Hwang

Segmentation evaluation metrics traditionally rely on binary decision logic: predictions are either correct or incorrect, based on rigid IoU thresholds. Detection--based metrics such as F1 and mAP determine correctness at the object level…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Ranit Karmakar , Simon F. Nørrelykke

In this paper, we tackle an emerging computer vision task, open-vocabulary universal image segmentation, that aims to perform semantic/instance/panoptic segmentation (background semantic labeling + foreground instance segmentation) for…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Zheng Ding , Jieke Wang , Zhuowen Tu

Recently, open-vocabulary image classification by vision language pre-training has demonstrated incredible achievements, that the model can classify arbitrary categories without seeing additional annotated images of that category. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Mengde Xu , Zheng Zhang , Fangyun Wei , Yutong Lin , Yue Cao , Han Hu , Xiang Bai

Panoptic segmentation is a scene parsing task which unifies semantic segmentation and instance segmentation into one single task. However, the current state-of-the-art studies did not take too much concern on inference time. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Chia-Yuan Chang , Shuo-En Chang , Pei-Yung Hsiao , Li-Chen Fu

Panoptic segmentation is an important computer vision task which combines semantic and instance segmentation. It plays a crucial role in domains of medical image analysis, self-driving vehicles, and robotics by providing a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Shourya Verma

Panoptic segmentation is the combination of semantic and instance segmentation: assign the points in a 3D point cloud to semantic categories and partition them into distinct object instances. It has many obvious applications for outdoor…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Binbin Xiang , Torben Peters , Theodora Kontogianni , Frawa Vetterli , Stefano Puliti , Rasmus Astrup , Konrad Schindler

Simultaneous segmentation and classification of nuclei in digital histology play an essential role in computer-assisted cancer diagnosis; however, it remains challenging. The highest achieved binary and multi-class Panoptic Quality (PQ)…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Ibtihaj Ahmad , Syed Muhammad Israr , Zain Ul Islam

A main bottleneck of learning-based robotic scene understanding methods is the heavy reliance on extensive annotated training data, which often limits their generalization ability. In LiDAR panoptic segmentation, this challenge becomes even…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Ahmet Selim Çanakçı , Niclas Vödisch , Kürsat Petek , Wolfram Burgard , Abhinav Valada

In this technical report, we present key details of our winning panoptic segmentation architecture EffPS_b1bs4_RVC. Our network is a lightweight version of our state-of-the-art EfficientPS architecture that consists of our proposed shared…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Rohit Mohan , Abhinav Valada

In this paper, we propose a new approach to applying point-level annotations for weakly-supervised panoptic segmentation. Instead of the dense pixel-level labels used by fully supervised methods, point-level labels only provide a single…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Junsong Fan , Zhaoxiang Zhang , Tieniu Tan

Unsupervised panoptic segmentation aims to partition an image into semantically meaningful regions and distinct object instances without training on manually annotated data. In contrast to prior work on unsupervised panoptic scene…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Oliver Hahn , Christoph Reich , Nikita Araslanov , Daniel Cremers , Christian Rupprecht , Stefan Roth

Panoptic segmentation is an important computer vision task, where the current state-of-the-art solutions require specialized components to perform well. We propose a simple generalist framework based on a deep encoder - shallow decoder…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Nedyalko Prisadnikov , Wouter Van Gansbeke , Danda Pani Paudel , Luc Van Gool

We propose an approach to instance-level image segmentation that is built on top of category-level segmentation. Specifically, for each pixel in a semantic category mask, its corresponding instance bounding box is predicted using a deep…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Zifeng Wu , Chunhua Shen , Anton van den Hengel

Panoptic segmentation unifies semantic and instance segmentation and thus delivers a semantic class label and, for so-called thing classes, also an instance label per pixel. The differentiation of distinct objects of the same class with a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Tuan Nguyen , Max Mehltretter , Franz Rottensteiner

We present a weakly supervised model that jointly performs both semantic- and instance-segmentation -- a particularly relevant problem given the substantial cost of obtaining pixel-perfect annotation for these tasks. In contrast to many…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Qizhu Li , Anurag Arnab , Philip H. S. Torr

Panoptic segmentation requires the simultaneous recognition of countable thing instances and amorphous stuff regions, placing joint demands on long-range context modelling, multi-scale feature representation, and efficient dense prediction.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Qing Cheng , Damiano Bertolini , Wei Zhang , Dong Wang , Niclas Zeller , Daniel Cremers

Panoptic segmentation, which is a novel task of unifying instance segmentation and semantic segmentation, has attracted a lot of attention lately. However, most of the previous methods are composed of multiple pathways with each pathway…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Sukjun Hwang , Seoung Wug Oh , Seon Joo Kim