English
Related papers

Related papers: Single-Shot Panoptic Segmentation

200 papers

We introduce the task of open-vocabulary 3D instance segmentation. Current approaches for 3D instance segmentation can typically only recognize object categories from a pre-defined closed set of classes that are annotated in the training…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Ayça Takmaz , Elisabetta Fedele , Robert W. Sumner , Marc Pollefeys , Federico Tombari , Francis Engelmann

Humans can easily segment moving objects without knowing what they are. That objectness could emerge from continuous visual observations motivates us to model grouping and movement concurrently from unlabeled videos. Our premise is that a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Runtao Liu , Zhirong Wu , Stella X. Yu , Stephen Lin

The Segment Anything Model (SAM) has established itself as a powerful zero-shot image segmentation model, enabled by efficient point-centric annotation and prompt-based models. While click and brush interactions are both well explored in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Frano Rajič , Lei Ke , Yu-Wing Tai , Chi-Keung Tang , Martin Danelljan , Fisher Yu

Multiple object video object segmentation is a challenging task, specially for the zero-shot case, when no object mask is given at the initial frame and the model has to find the objects to be segmented along the sequence. In our work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Carles Ventura , Miriam Bellver , Andreu Girbau , Amaia Salvador , Ferran Marques , Xavier Giro-i-Nieto

Panoptic segmentation that unifies instance segmentation and semantic segmentation has recently attracted increasing attention. While most existing methods focus on designing novel architectures, we steer toward a different perspective:…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Gengwei Zhang , Yiming Gao , Hang Xu , Hao Zhang , Zhenguo Li , Xiaodan Liang

We describe an approach for segmenting an image into regions that correspond to surfaces in the scene that are partially surrounded by the medium. It integrates both appearance and motion statistics into a cost functional, that is seeded…

Computer Vision and Pattern Recognition · Computer Science 2011-09-23 Alper Ayvaci , Stefano Soatto

Instance segmentation is one of the actively studied research topics in computer vision in which many objects of interest should be separated individually. While many feed-forward networks produce high-quality segmentation on different…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Tuan Tran Anh , Khoa Nguyen-Tuan , Tran Minh Quan , Won-Ki Jeong

We propose Panoptic Lifting, a novel approach for learning panoptic 3D volumetric representations from images of in-the-wild scenes. Once trained, our model can render color images together with 3D-consistent panoptic segmentation from…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Yawar Siddiqui , Lorenzo Porzi , Samuel Rota Buló , Norman Müller , Matthias Nießner , Angela Dai , Peter Kontschieder

Reliable LiDAR panoptic segmentation (LPS), including both semantic and instance segmentation, is vital for many robotic applications, such as autonomous driving. This work proposes a new LPS framework named PANet to eliminate the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Jianbiao Mei , Yu Yang , Mengmeng Wang , Xiaojun Hou , Laijian Li , Yong Liu

Addressing Lidar Panoptic Segmentation (LPS ) is crucial for safe deployment of autonomous vehicles. LPS aims to recognize and segment lidar points w.r.t. a pre-defined vocabulary of semantic classes, including thing classes of countable…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Anirudh S Chakravarthy , Meghana Reddy Ganesina , Peiyun Hu , Laura Leal-Taixe , Shu Kong , Deva Ramanan , Aljosa Osep

Pursuing more complete and coherent scene understanding towards realistic vision applications drives edge detection from category-agnostic to category-aware semantic level. However, finer delineation of instance-level boundaries still…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Yuan Hu , Yingtian Zou , Jiashi Feng

Panoptic segmentation presents a new challenge in exploiting the merits of both detection and segmentation, with the aim of unifying instance segmentation and semantic segmentation in a single framework. However, an efficient solution for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Zixiang Zhou , Yang Zhang , Hassan Foroosh

This paper introduces panoptica, a versatile and performance-optimized package designed for computing instance-wise segmentation quality metrics from 2D and 3D segmentation maps. panoptica addresses the limitations of existing metrics and…

Video Instance Segmentation is a fundamental computer vision task that deals with segmenting and tracking object instances across a video sequence. Most existing methods typically accomplish this task by employing a multi-stage top-down…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Jyoti Kini , Mubarak Shah

We propose a simple yet effective framework for instance and panoptic segmentation, termed CondInst (conditional convolutions for instance and panoptic segmentation). In the literature, top-performing instance segmentation methods typically…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Zhi Tian , Bowen Zhang , Hao Chen , Chunhua Shen

In this work, we tackle the problem of instance segmentation, the task of simultaneously solving object detection and semantic segmentation. Towards this goal, we present a model, called MaskLab, which produces three outputs: box detection,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Liang-Chieh Chen , Alexander Hermans , George Papandreou , Florian Schroff , Peng Wang , Hartwig Adam

Understanding 3D scenes from a single image is fundamental to a wide variety of tasks, such as for robotics, motion planning, or augmented reality. Existing works in 3D perception from a single RGB image tend to focus on geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Manuel Dahnert , Ji Hou , Matthias Nießner , Angela Dai

Instance segmentation is an important task for biomedical and biological image analysis. Due to the complicated background components, the high variability of object appearances, numerous overlapping objects, and ambiguous object…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Dongnan Liu , Donghao Zhang , Yang Song , Heng Huang , Weidong Cai

In this paper, we introduce an anchor-box free and single shot instance segmentation method, which is conceptually simple, fully convolutional and can be used as a mask prediction module for instance segmentation, by easily embedding it…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Enze Xie , Peize Sun , Xiaoge Song , Wenhai Wang , Ding Liang , Chunhua Shen , Ping Luo

This study is concerned with few-shot segmentation, i.e., segmenting the region of an unseen object class in a query image, given support image(s) of its instances. The current methods rely on the pretrained CNN features of the support and…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Zhijie Wang , Masanori Suganuma , Takayuki Okatani