English
Related papers

Related papers: Ensembling Instance and Semantic Segmentation for …

200 papers

In this work, we propose a single deep neural network for panoptic segmentation, for which the goal is to provide each individual pixel of an input image with a class label, as in semantic segmentation, as well as a unique identifier for…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Daan de Geus , Panagiotis Meletis , Gijs Dubbelman

Panoptic segmentation assigns semantic and instance ID labels to every pixel of an image. As permutations of instance IDs are also valid solutions, the task requires learning of high-dimensional one-to-many mapping. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Ting Chen , Lala Li , Saurabh Saxena , Geoffrey Hinton , David J. Fleet

Panoptic segmentation, which is a novel task of unifying instance segmentation and semantic segmentation, has attracted a lot of attention lately. However, most of the previous methods are composed of multiple pathways with each pathway…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Sukjun Hwang , Seoung Wug Oh , Seon Joo Kim

Given an input image and set of class names, panoptic segmentation aims to label each pixel in an image with class labels and instance labels. In comparison, Open Vocabulary Panoptic Segmentation aims to facilitate the segmentation of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Nafis Sadeq , Qingfeng Liu , Mostafa El-Khamy

Understanding the scene in which an autonomous robot operates is critical for its competent functioning. Such scene comprehension necessitates recognizing instances of traffic participants along with general scene semantics which can be…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Rohit Mohan , Abhinav Valada

Instance segmentation is an important task for biomedical and biological image analysis. Due to the complicated background components, the high variability of object appearances, numerous overlapping objects, and ambiguous object…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Dongnan Liu , Donghao Zhang , Yang Song , Heng Huang , Weidong Cai

The panoptic segmentation task requires a unified result from semantic and instance segmentation outputs that may contain overlaps. However, current studies widely ignore modeling overlaps. In this study, we aim to model overlap relations…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Yibo Yang , Hongyang Li , Xia Li , Qijie Zhao , Jianlong Wu , Zhouchen Lin

We present a semi-supervised method for panoptic segmentation based on ConsInstancy regularisation, a novel strategy for semi-supervised learning. It leverages completely unlabelled data by enforcing consistency between predicted instance…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Max Coenen , Tobias Schack , Dries Beyer , Christian Heipke , Michael Haist

We present a conceptually simple, flexible, and general framework for object instance segmentation. Our approach efficiently detects objects in an image while simultaneously generating a high-quality segmentation mask for each instance. The…

Computer Vision and Pattern Recognition · Computer Science 2018-01-25 Kaiming He , Georgia Gkioxari , Piotr Dollár , Ross Girshick

Semantic, instance, and panoptic segmentation of 3D point clouds have been addressed using task-specific models of distinct design. Thereby, the similarity of all segmentation tasks and the implicit relationship between them have not been…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Maxim Kolodiazhnyi , Anna Vorontsova , Anton Konushin , Danila Rukhovich

In recent years, instance segmentation has garnered significant attention across various applications. However, training a fully-supervised instance segmentation model requires costly both instance-level and pixel-level annotations. In…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yuchen Shen , Dong Zhang , Zhao Zhang , Liyong Fu , Qiaolin Ye

We present Panoptic-DeepLab, a bottom-up and single-shot approach for panoptic segmentation. Our Panoptic-DeepLab is conceptually simple and delivers state-of-the-art results. In particular, we adopt the dual-ASPP and dual-decoder…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Bowen Cheng , Maxwell D. Collins , Yukun Zhu , Ting Liu , Thomas S. Huang , Hartwig Adam , Liang-Chieh Chen

In this paper, we introduce a novel network that generates semantic, instance, and part segmentation using a shared encoder and effectively fuses them to achieve panoptic-part segmentation. Unifying these three segmentation problems allows…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Sravan Kumar Jagadeesh , René Schuster , Didier Stricker

Semantic and instance segmentation algorithms are two general yet distinct image segmentation solutions powered by Convolution Neural Network. While semantic segmentation benefits extensively from the end-to-end training strategy, instance…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Jianfeng Cao , Hong Yan

In recent decades, the vision community has witnessed remarkable progress in visual recognition, partially owing to advancements in dataset benchmarks. Notably, the established COCO benchmark has propelled the development of modern…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Xueqing Deng , Qihang Yu , Peng Wang , Xiaohui Shen , Liang-Chieh Chen

Image segmentation is about grouping pixels with different semantics, e.g., category or instance membership, where each choice of semantics defines a task. While only the semantics of each task differ, current research focuses on designing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Bowen Cheng , Ishan Misra , Alexander G. Schwing , Alexander Kirillov , Rohit Girdhar

We propose a simple yet effective instance segmentation framework, termed CondInst (conditional convolutions for instance segmentation). Top-performing instance segmentation methods such as Mask R-CNN rely on ROI operations (typically…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Zhi Tian , Chunhua Shen , Hao Chen

A major obstacle in instance segmentation is that existing methods often need many per-pixel labels in order to be effective. These labels require large human effort and for certain applications, such labels are not readily available. To…

Computer Vision and Pattern Recognition · Computer Science 2019-07-03 Issam H. Laradji , David Vazquez , Mark Schmidt

Recently, there is growing attention on one-stage panoptic segmentation methods which aim to segment instances and stuff jointly within a fully convolutional pipeline efficiently. However, most of the existing works directly feed the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Yifeng Chen , Wenqing Chu , Fangfang Wang , Ying Tai , Ran Yi , Zhenye Gan , Liang Yao , Chengjie Wang , Xi Li

Recognizing 3D part instances from a 3D point cloud is crucial for 3D structure and scene understanding. Several learning-based approaches use semantic segmentation and instance center prediction as training tasks and fail to further…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Chunyu Sun , Xin Tong , Yang Liu