English
Related papers

Related papers: Panoptic-DeepLab: A Simple, Strong, and Fast Basel…

200 papers

Panoptic segmentation aims to perform instance segmentation for foreground instances and semantic segmentation for background stuff simultaneously. The typical top-down pipeline concentrates on two key issues: 1) how to effectively model…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Yifeng Chen , Guangchen Lin , Songyuan Li , Bourahla Omar , Yiming Wu , Fangfang Wang , Junyi Feng , Mingliang Xu , Xi Li

Panoptic segmentation has become a new standard of visual recognition task by unifying previous semantic segmentation and instance segmentation tasks in concert. In this paper, we propose and explore a new video extension of this task,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Dahun Kim , Sanghyun Woo , Joon-Young Lee , In So Kweon

Panoptic segmentation involves a combination of joint semantic segmentation and instance segmentation, where image contents are divided into two types: things and stuff. We present Panoptic SegFormer, a general framework for panoptic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Zhiqi Li , Wenhai Wang , Enze Xie , Zhiding Yu , Anima Anandkumar , Jose M. Alvarez , Ping Luo , Tong Lu

Image segmentation for video analysis plays an essential role in different research fields such as smart city, healthcare, computer vision and geoscience, and remote sensing applications. In this regard, a significant effort has been…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Omar Elharrouss , Somaya Al-Maadeed , Nandhini Subramanian , Najmath Ottakath , Noor Almaadeed , Yassine Himeur

We present MaX-DeepLab, the first end-to-end model for panoptic segmentation. Our approach simplifies the current pipeline that depends heavily on surrogate sub-tasks and hand-designed components, such as box detection, non-maximum…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Huiyu Wang , Yukun Zhu , Hartwig Adam , Alan Yuille , Liang-Chieh Chen

We introduce a highly efficient method for panoptic segmentation of large 3D point clouds by redefining this task as a scalable graph clustering problem. This approach can be trained using only local auxiliary tasks, thereby eliminating the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Damien Robert , Hugo Raguet , Loic Landrieu

Panoptic segmentation presents a new challenge in exploiting the merits of both detection and segmentation, with the aim of unifying instance segmentation and semantic segmentation in a single framework. However, an efficient solution for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Zixiang Zhou , Yang Zhang , Hassan Foroosh

Understanding the scene in which an autonomous robot operates is critical for its competent functioning. Such scene comprehension necessitates recognizing instances of traffic participants along with general scene semantics which can be…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Rohit Mohan , Abhinav Valada

In this work we introduce a novel, CNN-based architecture that can be trained end-to-end to deliver seamless scene segmentation results. Our goal is to predict consistent semantic segmentation and detection results by means of a panoptic…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Lorenzo Porzi , Samuel Rota Bulò , Aleksander Colovic , Peter Kontschieder

Dense panoptic prediction is a key ingredient in many existing applications such as autonomous driving, automated warehouses or remote sensing. Many of these applications require fast inference over large input resolutions on affordable or…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Josip Šarić , Marin Oršić , Siniša Šegvić

In this paper, we present a conceptually simple, strong, and efficient framework for fully- and weakly-supervised panoptic segmentation, called Panoptic FCN. Our approach aims to represent and predict foreground things and background stuff…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Yanwei Li , Hengshuang Zhao , Xiaojuan Qi , Yukang Chen , Lu Qi , Liwei Wang , Zeming Li , Jian Sun , Jiaya Jia

We demonstrate our solution for the 2019 COCO panoptic segmentation task. Our method first performs instance segmentation and semantic segmentation separately, then combines the two to generate panoptic segmentation results. To enhance the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Mehmet Yildirim , Yogesh Langhe

Panoptic segmentation is one of the most challenging scene parsing tasks, combining the tasks of semantic segmentation and instance segmentation. While much progress has been made, few works focus on the real-time application of panoptic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Markus Schön , Michael Buchholz , Klaus Dietmayer

As a rising task, panoptic segmentation is faced with challenges in both semantic segmentation and instance segmentation. However, in terms of speed and accuracy, existing LiDAR methods in the field are still limited. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Jinke Li , Xiao He , Yang Wen , Yuan Gao , Xiaoqiang Cheng , Dan Zhang

In this paper, we propose a unified panoptic segmentation network (UPSNet) for tackling the newly proposed panoptic segmentation task. On top of a single backbone residual network, we first design a deformable convolution based semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Yuwen Xiong , Renjie Liao , Hengshuang Zhao , Rui Hu , Min Bai , Ersin Yumer , Raquel Urtasun

Recently, fully-convolutional one-stage networks have shown superior performance comparing to two-stage frameworks for instance segmentation as typically they can generate higher-quality mask predictions with less computation. In addition,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Hao Chen , Chunhua Shen , Zhi Tian

In order to deal with the task of video panoptic segmentation in the wild, we propose a robust integrated video panoptic segmentation solution. In our solution, we regard the video panoptic segmentation task as a segmentation target…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Jinming Su , Wangwang Yang , Junfeng Luo , Xiaolin Wei

Panoptic segmentation, which needs to assign a category label to each pixel and segment each object instance simultaneously, is a challenging topic. Traditionally, the existing approaches utilize two independent models without sharing…

Computer Vision and Pattern Recognition · Computer Science 2019-03-14 Huanyu Liu , Chao Peng , Changqian Yu , Jingbo Wang , Xu Liu , Gang Yu , Wei Jiang

Recently, there has been a panoptic segmentation task combining semantic and instance segmentation, in which the goal is to classify each pixel with the corresponding instance ID. In this work, we propose a solution to tackle the panoptic…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shuo-En Chang , Yi-Cheng Yang , En-Ting Lin , Pei-Yung Hsiao , Li-Chen Fu

3D point cloud panoptic segmentation is the combined task to (i) assign each point to a semantic class and (ii) separate the points in each class into object instances. Recently there has been an increased interest in such comprehensive 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Binbin Xiang , Yuanwen Yue , Torben Peters , Konrad Schindler