English
Related papers

Related papers: Panoptic-PartFormer: Learning a Unified Model for …

200 papers

Panoptic segmentation, which is a novel task of unifying instance segmentation and semantic segmentation, has attracted a lot of attention lately. However, most of the previous methods are composed of multiple pathways with each pathway…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Sukjun Hwang , Seoung Wug Oh , Seon Joo Kim

Panoptic segmentation combines instance and semantic predictions, allowing the detection of "things" and "stuff" simultaneously. Effectively approaching panoptic segmentation in remotely sensed data can be auspicious in many challenging…

Panoptic segmentation is posed as a new popular test-bed for the state-of-the-art holistic scene understanding methods with the requirement of simultaneously segmenting both foreground things and background stuff. The state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Yangxin Wu , Gengwei Zhang , Hang Xu , Xiaodan Liang , Liang Lin

We present a novel end-to-end single-shot method that segments countable object instances (things) as well as background regions (stuff) into a non-overlapping panoptic segmentation at almost video frame rate. Current state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Mark Weber , Jonathon Luiten , Bastian Leibe

In this paper, we propose a unified panoptic segmentation network (UPSNet) for tackling the newly proposed panoptic segmentation task. On top of a single backbone residual network, we first design a deformable convolution based semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Yuwen Xiong , Renjie Liao , Hengshuang Zhao , Rui Hu , Min Bai , Ersin Yumer , Raquel Urtasun

Our goal is to forecast the near future given a set of recent observations. We think this ability to forecast, i.e., to anticipate, is integral for the success of autonomous agents which need not only passively analyze an observation but…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Colin Graber , Grace Tsai , Michael Firman , Gabriel Brostow , Alexander Schwing

LiDAR panoptic segmentation, which jointly performs instance and semantic segmentation for things and stuff classes, plays a fundamental role in LiDAR perception tasks. While most existing methods explicitly separate these two segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Yu Yang , Jianbiao Mei , Liang Liu , Siliang Du , Yilin Xiao , Jongwon Ra , Yong Liu , Xiao Xu , Huifeng Wu

Depth-aware panoptic segmentation is an emerging topic in computer vision which combines semantic and geometric understanding for more robust scene interpretation. Recent works pursue unified frameworks to tackle this challenge but mostly…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Junwen He , Yifan Wang , Lijun Wang , Huchuan Lu , Jun-Yan He , Jin-Peng Lan , Bin Luo , Yifeng Geng , Xuansong Xie

Panoptic segmentation is a key enabler for robotic perception, as it unifies semantic understanding with object-level reasoning. However, the increasing complexity of state-of-the-art models makes them unsuitable for deployment on…

Robotics · Computer Science 2026-05-19 Calvin Galagain , Martyna Poreba , François Goulette , Cyrill Stachniss

We propose a novel solution for the task of video panoptic segmentation, that simultaneously predicts pixel-level semantic and instance segmentation and generates clip-level instance tracks. Our network, named VPS-Transformer, with a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Andra Petrovai , Sergiu Nedevschi

Semantic, instance, and panoptic segmentation of 3D point clouds have been addressed using task-specific models of distinct design. Thereby, the similarity of all segmentation tasks and the implicit relationship between them have not been…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Maxim Kolodiazhnyi , Anna Vorontsova , Anton Konushin , Danila Rukhovich

In this paper, the task of video panoptic segmentation is studied and two different methods to solve the task will be proposed. Video panoptic segmentation (VPS) is a recently introduced computer vision task that requires classifying and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Jake Rap , Panagiotis Meletis

Panoptic segmentation of 3D scenes, involving the segmentation and classification of object instances in a dense 3D reconstruction of a scene, is a challenging problem, especially when relying solely on unposed 2D images. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Lojze Zust , Yohann Cabon , Juliette Marrie , Leonid Antsfeld , Boris Chidlovskii , Jerome Revaud , Gabriela Csurka

Image segmentation for video analysis plays an essential role in different research fields such as smart city, healthcare, computer vision and geoscience, and remote sensing applications. In this regard, a significant effort has been…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Omar Elharrouss , Somaya Al-Maadeed , Nandhini Subramanian , Najmath Ottakath , Noor Almaadeed , Yassine Himeur

Panoptic segmentation has become a new standard of visual recognition task by unifying previous semantic segmentation and instance segmentation tasks in concert. In this paper, we propose and explore a new video extension of this task,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Dahun Kim , Sanghyun Woo , Joon-Young Lee , In So Kweon

Panoptic segmentation is an important computer vision task, where the current state-of-the-art solutions require specialized components to perform well. We propose a simple generalist framework based on a deep encoder - shallow decoder…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Nedyalko Prisadnikov , Wouter Van Gansbeke , Danda Pani Paudel , Luc Van Gool

In this work, we propose a single deep neural network for panoptic segmentation, for which the goal is to provide each individual pixel of an input image with a class label, as in semantic segmentation, as well as a unique identifier for…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Daan de Geus , Panagiotis Meletis , Gijs Dubbelman

Object parts serve as crucial intermediate representations in various downstream tasks, but part-level representation learning still has not received as much attention as other vision tasks. Previous research has established that Vision…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Jiahao Xia , Wenjian Huang , Min Xu , Jianguo Zhang , Haimin Zhang , Ziyu Sheng , Dong Xu

Panoptic segmentation is an important computer vision task which combines semantic and instance segmentation. It plays a crucial role in domains of medical image analysis, self-driving vehicles, and robotics by providing a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Shourya Verma

The use of autonomous robots for assistance tasks in hospitals has the potential to free up qualified staff and im-prove patient care. However, the ubiquity of deformable and transparent objects in hospital settings poses signif-icant…