English
Related papers

Related papers: Panoptic Segmentation with a Joint Semantic and In…

200 papers

Panoptic segmentation is one of the most challenging scene parsing tasks, combining the tasks of semantic segmentation and instance segmentation. While much progress has been made, few works focus on the real-time application of panoptic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Markus Schön , Michael Buchholz , Klaus Dietmayer

Panoptic segmentation aims to perform instance segmentation for foreground instances and semantic segmentation for background stuff simultaneously. The typical top-down pipeline concentrates on two key issues: 1) how to effectively model…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Yifeng Chen , Guangchen Lin , Songyuan Li , Bourahla Omar , Yiming Wu , Fangfang Wang , Junyi Feng , Mingliang Xu , Xi Li

We propose a simple, fast, and flexible framework to generate simultaneously semantic and instance masks for panoptic segmentation. Our method, called PanoNet, incorporates a clean and natural structure design that tackles the problem…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Xia Chen , Jianren Wang , Martial Hebert

Panoptic segmentation assigns semantic and instance ID labels to every pixel of an image. As permutations of instance IDs are also valid solutions, the task requires learning of high-dimensional one-to-many mapping. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Ting Chen , Lala Li , Saurabh Saxena , Geoffrey Hinton , David J. Fleet

Image segmentation for video analysis plays an essential role in different research fields such as smart city, healthcare, computer vision and geoscience, and remote sensing applications. In this regard, a significant effort has been…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Omar Elharrouss , Somaya Al-Maadeed , Nandhini Subramanian , Najmath Ottakath , Noor Almaadeed , Yassine Himeur

Semantic segmentation research has recently witnessed rapid progress, but many leading methods are unable to identify object instances. In this paper, we present Multi-task Network Cascades for instance-aware semantic segmentation. Our…

Computer Vision and Pattern Recognition · Computer Science 2015-12-15 Jifeng Dai , Kaiming He , Jian Sun

Panoptic segmentation is the combination of semantic and instance segmentation: assign the points in a 3D point cloud to semantic categories and partition them into distinct object instances. It has many obvious applications for outdoor…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Binbin Xiang , Torben Peters , Theodora Kontogianni , Frawa Vetterli , Stefano Puliti , Rasmus Astrup , Konrad Schindler

We propose a simple yet effective framework for instance and panoptic segmentation, termed CondInst (conditional convolutions for instance and panoptic segmentation). In the literature, top-performing instance segmentation methods typically…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Zhi Tian , Bowen Zhang , Hao Chen , Chunhua Shen

In recent years, compact and efficient scene understanding representations have gained popularity in increasing situational awareness and autonomy of robotic systems. In this work, we illustrate the concept of a panoptic edge segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Yang Zhou , Giuseppe Loianno

Given an input image and set of class names, panoptic segmentation aims to label each pixel in an image with class labels and instance labels. In comparison, Open Vocabulary Panoptic Segmentation aims to facilitate the segmentation of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Nafis Sadeq , Qingfeng Liu , Mostafa El-Khamy

In this work we introduce a novel, CNN-based architecture that can be trained end-to-end to deliver seamless scene segmentation results. Our goal is to predict consistent semantic segmentation and detection results by means of a panoptic…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Lorenzo Porzi , Samuel Rota Bulò , Aleksander Colovic , Peter Kontschieder

Panoptic segmentation has become a new standard of visual recognition task by unifying previous semantic segmentation and instance segmentation tasks in concert. In this paper, we propose and explore a new video extension of this task,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Dahun Kim , Sanghyun Woo , Joon-Young Lee , In So Kweon

We propose and study a task we name panoptic segmentation (PS). Panoptic segmentation unifies the typically distinct tasks of semantic segmentation (assign a class label to each pixel) and instance segmentation (detect and segment each…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Alexander Kirillov , Kaiming He , Ross Girshick , Carsten Rother , Piotr Dollár

Panoptic segmentation is an important computer vision task, where the current state-of-the-art solutions require specialized components to perform well. We propose a simple generalist framework based on a deep encoder - shallow decoder…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Nedyalko Prisadnikov , Wouter Van Gansbeke , Danda Pani Paudel , Luc Van Gool

Panoptic segmentation unifies semantic and instance segmentation and thus delivers a semantic class label and, for so-called thing classes, also an instance label per pixel. The differentiation of distinct objects of the same class with a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Tuan Nguyen , Max Mehltretter , Franz Rottensteiner

In this technical report, we present key details of our winning panoptic segmentation architecture EffPS_b1bs4_RVC. Our network is a lightweight version of our state-of-the-art EfficientPS architecture that consists of our proposed shared…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Rohit Mohan , Abhinav Valada

Panoptic Part Segmentation (PPS) aims to unify panoptic segmentation and part segmentation into one task. Previous work mainly utilizes separated approaches to handle thing, stuff, and part predictions individually without performing any…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Xiangtai Li , Shilin Xu , Yibo Yang , Guangliang Cheng , Yunhai Tong , Dacheng Tao

Point cloud panoptic segmentation is a challenging task that seeks a holistic solution for both semantic and instance segmentation to predict groupings of coherent points. Previous approaches treat semantic and instance segmentation as…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Shihao Su , Jianyun Xu , Huanyu Wang , Zhenwei Miao , Xin Zhan , Dayang Hao , Xi Li

Instance segmentation and panoptic segmentation is being paid more and more attention in recent years. In comparison with bounding box based object detection and semantic segmentation, instance segmentation can provide more analytical…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Xiaolong Liu , Yuqing Hou , Anbang Yao , Yurong Chen , Keqiang Li

In machine learning and other fields, suggesting a good solution to a problem is usually a harder task than evaluating the quality of such a solution. This asymmetry is the basis for a large number of selection oriented methods that use a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Sagi Eppel , Alan Aspuru-Guzik