English
Related papers

Related papers: Merging Tasks for Video Panoptic Segmentation

200 papers

The Depth-aware Video Panoptic Segmentation (DVPS) is a new challenging vision problem that aims to predict panoptic segmentation and depth in a video simultaneously. The previous work solves this task by extending the existing panoptic…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Haobo Yuan , Xiangtai Li , Yibo Yang , Guangliang Cheng , Jing Zhang , Yunhai Tong , Lefei Zhang , Dacheng Tao

This paper presents a unified framework for depth-aware panoptic segmentation (DPS), which aims to reconstruct 3D scene with instance-level semantics from one single image. Prior works address this problem by simply adding a dense depth…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Naiyu Gao , Fei He , Jian Jia , Yanhu Shan , Haoyang Zhang , Xin Zhao , Kaiqi Huang

Part-aware panoptic segmentation (PPS) requires (a) that each foreground object and background region in an image is segmented and classified, and (b) that all parts within foreground objects are segmented, classified and linked to their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Daan de Geus , Gijs Dubbelman

Video Scene Parsing (VSP) has emerged as a cornerstone in computer vision, facilitating the simultaneous segmentation, recognition, and tracking of diverse visual entities in dynamic scenes. In this survey, we present a holistic review of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Guohuan Xie , Syed Ariff Syed Hesham , Wenya Guo , Bing Li , Ming-Ming Cheng , Guolei Sun , Yun Liu

Panoptic segmentation is a complex full scene parsing task requiring simultaneous instance and semantic segmentation at high resolution. Current state-of-the-art approaches cannot run in real-time, and simplifying these architectures to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Rui Hou , Jie Li , Arjun Bhargava , Allan Raventos , Vitor Guizilini , Chao Fang , Jerome Lynch , Adrien Gaidon

Panoptic segmentation, which is a novel task of unifying instance segmentation and semantic segmentation, has attracted a lot of attention lately. However, most of the previous methods are composed of multiple pathways with each pathway…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Sukjun Hwang , Seoung Wug Oh , Seon Joo Kim

Video segmentation -- partitioning video frames into multiple segments or objects -- plays a critical role in a broad range of practical applications, from enhancing visual effects in movie, to understanding scenes in autonomous driving, to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Tianfei Zhou , Fatih Porikli , David Crandall , Luc Van Gool , Wenguan Wang

Panoptic Segmentation aims to provide an understanding of background (stuff) and instances of objects (things) at a pixel level. It combines the separate tasks of semantic segmentation (pixel level classification) and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Sumanth Chennupati , Venkatraman Narayanan , Ganesh Sistu , Senthil Yogamani , Samir A Rawashdeh

From the autonomous car driving to medical diagnosis, the requirement of the task of image segmentation is everywhere. Segmentation of an image is one of the indispensable tasks in computer vision. This task is comparatively complicated…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Farhana Sultana , Abu Sufian , Paramartha Dutta

Panoptic segmentation is a scene parsing task which unifies semantic segmentation and instance segmentation into one single task. However, the current state-of-the-art studies did not take too much concern on inference time. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Chia-Yuan Chang , Shuo-En Chang , Pei-Yung Hsiao , Li-Chen Fu

Object segmentation and object tracking are fundamental research area in the computer vision community. These two topics are diffcult to handle some common challenges, such as occlusion, deformation, motion blur, and scale variation. The…

Computer Vision and Pattern Recognition · Computer Science 2019-04-29 Rui Yao , Guosheng Lin , Shixiong Xia , Jiaqi Zhao , Yong Zhou

Panoptic Part Segmentation (PPS) unifies panoptic and part segmentation into one task. Previous works utilize separate approaches to handle things, stuff, and part predictions without shared computation and task association. We aim to unify…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xiangtai Li , Shilin Xu , Yibo Yang , Haobo Yuan , Guangliang Cheng , Yunhai Tong , Zhouchen Lin , Ming-Hsuan Yang , Dacheng Tao

In this paper we present a new computer vision task, named video instance segmentation. The goal of this new task is simultaneous detection, segmentation and tracking of instances in videos. In words, it is the first time that the image…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Linjie Yang , Yuchen Fan , Ning Xu

Depth-aware video panoptic segmentation tackles the inverse projection problem of restoring panoptic 3D point clouds from video sequences, where the 3D points are augmented with semantic classes and temporally consistent instance…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Andra Petrovai , Sergiu Nedevschi

Panoptic segmentation, which needs to assign a category label to each pixel and segment each object instance simultaneously, is a challenging topic. Traditionally, the existing approaches utilize two independent models without sharing…

Computer Vision and Pattern Recognition · Computer Science 2019-03-14 Huanyu Liu , Chao Peng , Changqian Yu , Jingbo Wang , Xu Liu , Gang Yu , Wei Jiang

The general domain of video segmentation is currently fragmented into different tasks spanning multiple benchmarks. Despite rapid progress in the state-of-the-art, current methods are overwhelmingly task-specific and cannot conceptually…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Ali Athar , Alexander Hermans , Jonathon Luiten , Deva Ramanan , Bastian Leibe

Recently, there has been a panoptic segmentation task combining semantic and instance segmentation, in which the goal is to classify each pixel with the corresponding instance ID. In this work, we propose a solution to tackle the panoptic…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shuo-En Chang , Yi-Cheng Yang , En-Ting Lin , Pei-Yung Hsiao , Li-Chen Fu

We present the first comprehensive video polyp segmentation (VPS) study in the deep learning era. Over the years, developments in VPS are not moving forward with ease due to the lack of large-scale fine-grained segmentation annotations. To…

Image and Video Processing · Electrical Eng. & Systems 2023-03-03 Ge-Peng Ji , Guobao Xiao , Yu-Cheng Chou , Deng-Ping Fan , Kai Zhao , Geng Chen , Luc Van Gool

Panoptic Part Segmentation (PPS) aims to unify panoptic segmentation and part segmentation into one task. Previous work mainly utilizes separated approaches to handle thing, stuff, and part predictions individually without performing any…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Xiangtai Li , Shilin Xu , Yibo Yang , Guangliang Cheng , Yunhai Tong , Dacheng Tao

We present the \textbf{D}ecoupled \textbf{VI}deo \textbf{S}egmentation (DVIS) framework, a novel approach for the challenging task of universal video segmentation, including video instance segmentation (VIS), video semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Tao Zhang , Xingye Tian , Yikang Zhou , Shunping Ji , Xuebo Wang , Xin Tao , Yuan Zhang , Pengfei Wan , Zhongyuan Wang , Yu Wu