English
Related papers

Related papers: Unifying Instance and Panoptic Segmentation with D…

200 papers

The recently introduced panoptic segmentation task has renewed our community's interest in unifying the tasks of instance segmentation (for thing classes) and semantic segmentation (for stuff classes). However, current state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Alexander Kirillov , Ross Girshick , Kaiming He , Piotr Dollár

Panoptic and instance segmentation networks are often trained with specialized object detection modules, complex loss functions, and ad-hoc post-processing steps to manage the permutation-invariance of the instance masks. This work builds…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Wouter Van Gansbeke , Bert De Brabandere

We demonstrate our solution for the 2019 COCO panoptic segmentation task. Our method first performs instance segmentation and semantic segmentation separately, then combines the two to generate panoptic segmentation results. To enhance the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Mehmet Yildirim , Yogesh Langhe

The representative instance segmentation methods mostly segment different object instances with a mask of the fixed resolution, e.g., 28*28 grid. However, a low-resolution mask loses rich details, while a high-resolution mask incurs…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Ruihuang Li , Chenhang He , Shuai Li , Yabin Zhang , Lei Zhang

Panoptic segmentation unifies semantic and instance segmentation and thus delivers a semantic class label and, for so-called thing classes, also an instance label per pixel. The differentiation of distinct objects of the same class with a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Tuan Nguyen , Max Mehltretter , Franz Rottensteiner

In this work, we aim at building a simple, direct, and fast instance segmentation framework with strong performance. We follow the principle of the SOLO method of Wang et al. "SOLO: segmenting objects by locations". Importantly, we take one…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Xinlong Wang , Rufeng Zhang , Tao Kong , Lei Li , Chunhua Shen

The two-stage methods for instance segmentation, e.g. Mask R-CNN, have achieved excellent performance recently. However, the segmented masks are still very coarse due to the downsampling operations in both the feature pyramid and the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Gang Zhang , Xin Lu , Jingru Tan , Jianmin Li , Zhaoxiang Zhang , Quanquan Li , Xiaolin Hu

We propose an approach to instance segmentation from 3D point clouds based on dynamic convolution. This enables it to adapt, at inference, to varying feature and object scales. Doing so avoids some pitfalls of bottom up approaches,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Tong He , Chunhua Shen , Anton van den Hengel

We present a novel end-to-end single-shot method that segments countable object instances (things) as well as background regions (stuff) into a non-overlapping panoptic segmentation at almost video frame rate. Current state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Mark Weber , Jonathon Luiten , Bastian Leibe

Panoptic segmentation, which is a novel task of unifying instance segmentation and semantic segmentation, has attracted a lot of attention lately. However, most of the previous methods are composed of multiple pathways with each pathway…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Sukjun Hwang , Seoung Wug Oh , Seon Joo Kim

Panoptic segmentation has become a new standard of visual recognition task by unifying previous semantic segmentation and instance segmentation tasks in concert. In this paper, we propose and explore a new video extension of this task,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Dahun Kim , Sanghyun Woo , Joon-Young Lee , In So Kweon

We present Panoptic-DeepLab, a bottom-up and single-shot approach for panoptic segmentation. Our Panoptic-DeepLab is conceptually simple and delivers state-of-the-art results. In particular, we adopt the dual-ASPP and dual-decoder…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Bowen Cheng , Maxwell D. Collins , Yukun Zhu , Ting Liu , Thomas S. Huang , Hartwig Adam , Liang-Chieh Chen

We propose a simple, fast, and flexible framework to generate simultaneously semantic and instance masks for panoptic segmentation. Our method, called PanoNet, incorporates a clean and natural structure design that tackles the problem…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Xia Chen , Jianren Wang , Martial Hebert

Recently, there has been a panoptic segmentation task combining semantic and instance segmentation, in which the goal is to classify each pixel with the corresponding instance ID. In this work, we propose a solution to tackle the panoptic…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shuo-En Chang , Yi-Cheng Yang , En-Ting Lin , Pei-Yung Hsiao , Li-Chen Fu

Self-attention is of vital importance in semantic segmentation as it enables modeling of long-range context, which translates into improved performance. We argue that it is equally important to model short-range context, especially to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Hasib Zunair , A. Ben Hamza

In recent years, instance segmentation has garnered significant attention across various applications. However, training a fully-supervised instance segmentation model requires costly both instance-level and pixel-level annotations. In…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yuchen Shen , Dong Zhang , Zhao Zhang , Liyong Fu , Qiaolin Ye

Recent works have made great progress in semantic segmentation by exploiting contextual information in a local or global manner with dilated convolutions, pyramid pooling or self-attention mechanism. In order to avoid potential misleading…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Hanzhe Hu , Deyi Ji , Weihao Gan , Shuai Bai , Wei Wu , Junjie Yan

Semantic and instance segmentation algorithms are two general yet distinct image segmentation solutions powered by Convolution Neural Network. While semantic segmentation benefits extensively from the end-to-end training strategy, instance…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Jianfeng Cao , Hong Yan

Since medical image data sets contain few samples and singular features, lesions are viewed as highly similar to other tissues. The traditional neural network has a limited ability to learn features. Even if a host of feature maps is…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Hongfeng You , Long Yu , Shengwei Tian , Xiang Ma , Yan Xing , Xiaojie Ma

Obtaining precise instance segmentation masks is of high importance in many modern applications such as robotic manipulation and autonomous driving. Currently, many state of the art models are based on the Mask R-CNN framework which, while…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Namdar Homayounfar , Yuwen Xiong , Justin Liang , Wei-Chiu Ma , Raquel Urtasun