English
Related papers

Related papers: Unifying Training and Inference for Panoptic Segme…

200 papers

We present a recurrent model for semantic instance segmentation that sequentially generates binary masks and their associated class probabilities for every object in an image. Our proposed system is trainable end-to-end from an input image…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Amaia Salvador , Miriam Bellver , Victor Campos , Manel Baradad , Ferran Marques , Jordi Torres , Xavier Giro-i-Nieto

In this work, we introduce Panoptic-DeepLab, a simple, strong, and fast system for panoptic segmentation, aiming to establish a solid baseline for bottom-up methods that can achieve comparable performance of two-stage methods while yielding…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Bowen Cheng , Maxwell D. Collins , Yukun Zhu , Ting Liu , Thomas S. Huang , Hartwig Adam , Liang-Chieh Chen

Recent researches on panoptic segmentation resort to a single end-to-end network to combine the tasks of instance segmentation and semantic segmentation. However, prior models only unified the two related tasks at the architectural level…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Yangxin Wu , Gengwei Zhang , Yiming Gao , Xiajun Deng , Ke Gong , Xiaodan Liang , Liang Lin

Boundary-based instance segmentation has drawn much attention since of its attractive efficiency. However, existing methods suffer from the difficulty in long-distance regression. In this paper, we propose a coarse-to-fine module to address…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Feng Luo , Bin-Bin Gao , Jiangpeng Yan , Xiu Li

Panoptic segmentation (PS) is a complex scene understanding task that requires providing high-quality segmentation for both thing objects and stuff regions. Previous methods handle these two classes with semantic and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Naiyu Gao , Yanhu Shan , Xin Zhao , Kaiqi Huang

Object location is fundamental to panoptic segmentation as it is related to all things and stuff in the image scene. Knowing the locations of objects in the image provides clues for segmenting and helps the network better understand the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Qiang Chen , Anda Cheng , Xiangyu He , Peisong Wang , Jian Cheng

Most of the modern instance segmentation approaches fall into two categories: region-based approaches in which object bounding boxes are detected first and later used in cropping and segmenting instances; and keypoint-based approaches in…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Xingqian Xu , Mang Tik Chiu , Thomas S. Huang , Honghui Shi

We present Adaptive Instance Selection network architecture for class-agnostic instance segmentation. Given an input image and a point $(x, y)$, it generates a mask for the object located at $(x, y)$. The network adapts to the input point…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Konstantin Sofiiuk , Olga Barinova , Anton Konushin

We report competitive results on object detection and instance segmentation on the COCO dataset using standard models trained from random initialization. The results are no worse than their ImageNet pre-training counterparts even when using…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Kaiming He , Ross Girshick , Piotr Dollár

We propose an end-to-end learning framework for generating foreground object segmentations. Given a single novel image, our approach produces pixel-level masks for all "object-like" regions---even for object categories never seen during…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Suyog Dutt Jain , Bo Xiong , Kristen Grauman

Instance segmentation is an important task for biomedical and biological image analysis. Due to the complicated background components, the high variability of object appearances, numerous overlapping objects, and ambiguous object…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Dongnan Liu , Donghao Zhang , Yang Song , Heng Huang , Weidong Cai

We introduce a differentiable, end-to-end trainable framework for solving pixel-level grouping problems such as instance segmentation consisting of two novel components. First, we regress pixels into a hyper-spherical embedding space so…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Shu Kong , Charless Fowlkes

In this work we present a novel end-to-end framework for tracking and classifying a robot's surroundings in complex, dynamic and only partially observable real-world environments. The approach deploys a recurrent neural network to filter an…

Machine Learning · Computer Science 2016-04-20 Peter Ondruska , Julie Dequaire , Dominic Zeng Wang , Ingmar Posner

In this paper, we present an algorithm to tackle a video panoptic segmentation problem, a newly emerging area of research. The video panoptic segmentation is a task that unifies the typical task of panoptic segmentation and multi-object…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Jeongwon Ryu , Kwangjin Yoon

This paper introduces a novel segmentation framework that integrates a classifier network with a reverse HRNet architecture for efficient image segmentation. Our approach utilizes a ResNet-50 backbone, pretrained in a semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Anupam Gupta , Ashok Krishnamurthy , Lisa Singh

Semantic segmentation and object detection research have recently achieved rapid progress. However, the former task has no notion of different instances of the same object, and the latter operates at a coarse, bounding-box level. We propose…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Anurag Arnab , Philip H. S Torr

Semantic image segmentation is an essential component of modern autonomous driving systems, as an accurate understanding of the surrounding scene is crucial to navigation and action planning. Current state-of-the-art approaches in semantic…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Tobias Pohlen , Alexander Hermans , Markus Mathias , Bastian Leibe

In this paper, we present a conceptually simple, strong, and efficient framework for panoptic segmentation, called Panoptic FCN. Our approach aims to represent and predict foreground things and background stuff in a unified fully…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Yanwei Li , Hengshuang Zhao , Xiaojuan Qi , Liwei Wang , Zeming Li , Jian Sun , Jiaya Jia

We propose and study a task we name panoptic segmentation (PS). Panoptic segmentation unifies the typically distinct tasks of semantic segmentation (assign a class label to each pixel) and instance segmentation (detect and segment each…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Alexander Kirillov , Kaiming He , Ross Girshick , Carsten Rother , Piotr Dollár

The problem of video object segmentation can become extremely challenging when multiple instances co-exist. While each instance may exhibit large scale and pose variations, the problem is compounded when instances occlude each other causing…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Xiaoxiao Li , Chen Change Loy