English
Related papers

Related papers: Video Panoptic Segmentation

200 papers

Panoptic segmentation is an important computer vision task which combines semantic and instance segmentation. It plays a crucial role in domains of medical image analysis, self-driving vehicles, and robotics by providing a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Shourya Verma

We present a novel end-to-end single-shot method that segments countable object instances (things) as well as background regions (stuff) into a non-overlapping panoptic segmentation at almost video frame rate. Current state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Mark Weber , Jonathon Luiten , Bastian Leibe

Panoptic image segmentation is the computer vision task of finding groups of pixels in an image and assigning semantic classes and object instance identifiers to them. Research in image segmentation has become increasingly popular due to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Jieru Mei , Alex Zihao Zhu , Xinchen Yan , Hang Yan , Siyuan Qiao , Yukun Zhu , Liang-Chieh Chen , Henrik Kretzschmar , Dragomir Anguelov

In this technical report, we present two novel datasets for image scene understanding. Both datasets have annotations compatible with panoptic segmentation and additionally they have part-level labels for selected semantic classes. This…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Panagiotis Meletis , Xiaoxiao Wen , Chenyang Lu , Daan de Geus , Gijs Dubbelman

We present an end-to-end network to bridge the gap between training and inference pipeline for panoptic segmentation, a task that seeks to partition an image into semantic regions for "stuff" and object instances for "things". In contrast…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Qizhu Li , Xiaojuan Qi , Philip H. S. Torr

In this paper, we introduce semi-supervised video object segmentation (VOS) to panoptic wild scenes and present a large-scale benchmark as well as a baseline method for it. Previous benchmarks for VOS with sparse annotations are not…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Yuanyou Xu , Zongxin Yang , Yi Yang

Point cloud panoptic segmentation is a challenging task that seeks a holistic solution for both semantic and instance segmentation to predict groupings of coherent points. Previous approaches treat semantic and instance segmentation as…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Shihao Su , Jianyun Xu , Huanyu Wang , Zhenwei Miao , Xin Zhan , Dayang Hao , Xi Li

Navigational perception for visually impaired people has been substantially promoted by both classic and deep learning based segmentation methods. In classic visual recognition methods, the segmentation models are mostly object-dependent,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Wei Mao , Jiaming Zhang , Kailun Yang , Rainer Stiefelhagen

Temporal correspondence - linking pixels or objects across frames - is a fundamental supervisory signal for the video models. For the panoptic understanding of dynamic scenes, we further extend this concept to every segment. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Sanghyun Woo , Dahun Kim , Joon-Young Lee , In So Kweon

Depth-aware video panoptic segmentation is a promising approach to camera based scene understanding. However, the current state-of-the-art methods require costly video annotations and use a complex training pipeline compared to their…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Kurt Stolle , Gijs Dubbelman

Pursuing more complete and coherent scene understanding towards realistic vision applications drives edge detection from category-agnostic to category-aware semantic level. However, finer delineation of instance-level boundaries still…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Yuan Hu , Yingtian Zou , Jiashi Feng

Panoptic tracking enables pixel-level scene interpretation of videos by integrating instance tracking in panoptic segmentation. This provides robots with a spatio-temporal understanding of the environment, an essential attribute for their…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Juana Valeria Hurtado , Sajad Marvi , Rohit Mohan , Abhinav Valada

Panoptic segmentation unifies semantic segmentation and instance segmentation which has been attracting increasing attention in recent years. However, most existing research was conducted under a supervised learning setup whereas…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Jiaxing Huang , Dayan Guan , Aoran Xiao , Shijian Lu

Instance segmentation is an important task for biomedical and biological image analysis. Due to the complicated background components, the high variability of object appearances, numerous overlapping objects, and ambiguous object…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Dongnan Liu , Donghao Zhang , Yang Song , Heng Huang , Weidong Cai

Depth-aware video panoptic segmentation tackles the inverse projection problem of restoring panoptic 3D point clouds from video sequences, where the 3D points are augmented with semantic classes and temporally consistent instance…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Andra Petrovai , Sergiu Nedevschi

Video Instance Segmentation is a fundamental computer vision task that deals with segmenting and tracking object instances across a video sequence. Most existing methods typically accomplish this task by employing a multi-stage top-down…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Jyoti Kini , Mubarak Shah

Inspired by recent advances of deep learning in instance segmentation and object tracking, we introduce video object segmentation problem as a concept of guided instance segmentation. Our model proceeds on a per-frame basis, guided by the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Anna Khoreva , Federico Perazzi , Rodrigo Benenson , Bernt Schiele , Alexander Sorkine-Hornung

From the autonomous car driving to medical diagnosis, the requirement of the task of image segmentation is everywhere. Segmentation of an image is one of the indispensable tasks in computer vision. This task is comparatively complicated…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Farhana Sultana , Abu Sufian , Paramartha Dutta

Understanding the scene in which an autonomous robot operates is critical for its competent functioning. Such scene comprehension necessitates recognizing instances of traffic participants along with general scene semantics which can be…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Rohit Mohan , Abhinav Valada

Video instance segmentation (VIS) is the task that requires simultaneously classifying, segmenting and tracking object instances of interest in video. Recent methods typically develop sophisticated pipelines to tackle this task. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Yuqing Wang , Zhaoliang Xu , Xinlong Wang , Chunhua Shen , Baoshan Cheng , Hao Shen , Huaxia Xia