English
Related papers

Related papers: An End-to-End Trainable Video Panoptic Segmentatio…

200 papers

The task of assigning semantic classes and track identities to every pixel in a video is called video panoptic segmentation. Our work is the first that targets this task in a real-world setting requiring dense interpretation in both spatial…

Panoptic segmentation has become a new standard of visual recognition task by unifying previous semantic segmentation and instance segmentation tasks in concert. In this paper, we propose and explore a new video extension of this task,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Dahun Kim , Sanghyun Woo , Joon-Young Lee , In So Kweon

In this paper, the task of video panoptic segmentation is studied and two different methods to solve the task will be proposed. Video panoptic segmentation (VPS) is a recently introduced computer vision task that requires classifying and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Jake Rap , Panagiotis Meletis

Image segmentation for video analysis plays an essential role in different research fields such as smart city, healthcare, computer vision and geoscience, and remote sensing applications. In this regard, a significant effort has been…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Omar Elharrouss , Somaya Al-Maadeed , Nandhini Subramanian , Najmath Ottakath , Noor Almaadeed , Yassine Himeur

Depth-aware video panoptic segmentation is a promising approach to camera based scene understanding. However, the current state-of-the-art methods require costly video annotations and use a complex training pipeline compared to their…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Kurt Stolle , Gijs Dubbelman

We propose a novel solution for the task of video panoptic segmentation, that simultaneously predicts pixel-level semantic and instance segmentation and generates clip-level instance tracks. Our network, named VPS-Transformer, with a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Andra Petrovai , Sergiu Nedevschi

We present a novel end-to-end single-shot method that segments countable object instances (things) as well as background regions (stuff) into a non-overlapping panoptic segmentation at almost video frame rate. Current state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Mark Weber , Jonathon Luiten , Bastian Leibe

Panoptic segmentation assigns semantic and instance ID labels to every pixel of an image. As permutations of instance IDs are also valid solutions, the task requires learning of high-dimensional one-to-many mapping. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Ting Chen , Lala Li , Saurabh Saxena , Geoffrey Hinton , David J. Fleet

We propose and study a task we name panoptic segmentation (PS). Panoptic segmentation unifies the typically distinct tasks of semantic segmentation (assign a class label to each pixel) and instance segmentation (detect and segment each…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Alexander Kirillov , Kaiming He , Ross Girshick , Carsten Rother , Piotr Dollár

Panoptic segmentation is an important computer vision task which combines semantic and instance segmentation. It plays a crucial role in domains of medical image analysis, self-driving vehicles, and robotics by providing a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Shourya Verma

Existing methods for instance segmentation in videos typically involve multi-stage pipelines that follow the tracking-by-detection paradigm and model a video clip as a sequence of images. Multiple networks are used to detect objects in…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Ali Athar , Sabarinath Mahadevan , Aljoša Ošep , Laura Leal-Taixé , Bastian Leibe

Panoptic segmentation, which needs to assign a category label to each pixel and segment each object instance simultaneously, is a challenging topic. Traditionally, the existing approaches utilize two independent models without sharing…

Computer Vision and Pattern Recognition · Computer Science 2019-03-14 Huanyu Liu , Chao Peng , Changqian Yu , Jingbo Wang , Xu Liu , Gang Yu , Wei Jiang

Panoptic tracking enables pixel-level scene interpretation of videos by integrating instance tracking in panoptic segmentation. This provides robots with a spatio-temporal understanding of the environment, an essential attribute for their…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Juana Valeria Hurtado , Sajad Marvi , Rohit Mohan , Abhinav Valada

Panoptic segmentation, which is a novel task of unifying instance segmentation and semantic segmentation, has attracted a lot of attention lately. However, most of the previous methods are composed of multiple pathways with each pathway…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Sukjun Hwang , Seoung Wug Oh , Seon Joo Kim

Video instance segmentation (VIS) is the task that requires simultaneously classifying, segmenting and tracking object instances of interest in video. Recent methods typically develop sophisticated pipelines to tackle this task. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Yuqing Wang , Zhaoliang Xu , Xinlong Wang , Chunhua Shen , Baoshan Cheng , Hao Shen , Huaxia Xia

We present an end-to-end network to bridge the gap between training and inference pipeline for panoptic segmentation, a task that seeks to partition an image into semantic regions for "stuff" and object instances for "things". In contrast…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Qizhu Li , Xiaojuan Qi , Philip H. S. Torr

This paper presents Video K-Net, a simple, strong, and unified framework for fully end-to-end video panoptic segmentation. The method is built upon K-Net, a method that unifies image segmentation via a group of learnable kernels. We observe…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Xiangtai Li , Wenwei Zhang , Jiangmiao Pang , Kai Chen , Guangliang Cheng , Yunhai Tong , Chen Change Loy

In order to deal with the task of video panoptic segmentation in the wild, we propose a robust integrated video panoptic segmentation solution. In our solution, we regard the video panoptic segmentation task as a segmentation target…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Jinming Su , Wangwang Yang , Junfeng Luo , Xiaolin Wei

Video panoptic segmentation is an advanced task that extends panoptic segmentation by applying its concept to video sequences. In the hope of addressing the challenge of video panoptic segmentation in diverse conditions, We utilize DVIS++…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Ruipu Wu , Jifei Che , Han Li , Chengjing Wu , Ting Liu , Luoqi Liu

Panoptic segmentation combines instance and semantic predictions, allowing the detection of "things" and "stuff" simultaneously. Effectively approaching panoptic segmentation in remotely sensed data can be auspicious in many challenging…

‹ Prev 1 2 3 10 Next ›