English
Related papers

Related papers: A Simple and Generalist Approach for Panoptic Segm…

200 papers

Our goal is to forecast the near future given a set of recent observations. We think this ability to forecast, i.e., to anticipate, is integral for the success of autonomous agents which need not only passively analyze an observation but…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Colin Graber , Grace Tsai , Michael Firman , Gabriel Brostow , Alexander Schwing

In this work, we introduce panoramic panoptic segmentation as the most holistic scene understanding both in terms of field of view and image level understanding for standard camera based input. A complete surrounding understanding provides…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Alexander Jaus , Kailun Yang , Rainer Stiefelhagen

We present an end-to-end network to bridge the gap between training and inference pipeline for panoptic segmentation, a task that seeks to partition an image into semantic regions for "stuff" and object instances for "things". In contrast…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Qizhu Li , Xiaojuan Qi , Philip H. S. Torr

Dense panoptic prediction is a key ingredient in many existing applications such as autonomous driving, automated warehouses or remote sensing. Many of these applications require fast inference over large input resolutions on affordable or…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Josip Šarić , Marin Oršić , Siniša Šegvić

We propose a simple, fast, and flexible framework to generate simultaneously semantic and instance masks for panoptic segmentation. Our method, called PanoNet, incorporates a clean and natural structure design that tackles the problem…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Xia Chen , Jianren Wang , Martial Hebert

A new, machine learning-based approach for automatically generating 3D digital geometries of woven composite textiles is proposed to overcome the limitations of existing analytical descriptions and segmentation methods. In this approach,…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Aaron Allred , Lauren J. Abbott , Alireza Doostan , Kurt Maute

Panoptic segmentation unifies semantic and instance segmentation and thus delivers a semantic class label and, for so-called thing classes, also an instance label per pixel. The differentiation of distinct objects of the same class with a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Tuan Nguyen , Max Mehltretter , Franz Rottensteiner

Unsupervised panoptic segmentation aims to partition an image into semantically meaningful regions and distinct object instances without training on manually annotated data. In contrast to prior work on unsupervised panoptic scene…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Oliver Hahn , Christoph Reich , Nikita Araslanov , Daniel Cremers , Christian Rupprecht , Stefan Roth

We propose a fully differentiable architecture for simultaneous semantic and instance segmentation (a.k.a. panoptic segmentation) consisting of a convolutional neural network and an asymmetric multiway cut problem solver. The latter solves…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Ahmed Abbas , Paul Swoboda

Panoptic segmentation aims to address semantic and instance segmentation simultaneously in a unified framework. However, an efficient solution of panoptic segmentation in applications like autonomous driving is still an open research…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Enxu Li , Ryan Razani , Yixuan Xu , Liu Bingbing

Panoptic Part Segmentation (PPS) aims to unify panoptic segmentation and part segmentation into one task. Previous work mainly utilizes separated approaches to handle thing, stuff, and part predictions individually without performing any…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Xiangtai Li , Shilin Xu , Yibo Yang , Guangliang Cheng , Yunhai Tong , Dacheng Tao

Panoptic segmentation is a fundamental task in computer vision and a crucial component for perception in autonomous vehicles. Recent mask-transformer-based methods achieve impressive performance on standard benchmarks but face significant…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Lojze Žust , Matej Kristan

Recently, there has been a panoptic segmentation task combining semantic and instance segmentation, in which the goal is to classify each pixel with the corresponding instance ID. In this work, we propose a solution to tackle the panoptic…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shuo-En Chang , Yi-Cheng Yang , En-Ting Lin , Pei-Yung Hsiao , Li-Chen Fu

From the autonomous car driving to medical diagnosis, the requirement of the task of image segmentation is everywhere. Segmentation of an image is one of the indispensable tasks in computer vision. This task is comparatively complicated…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Farhana Sultana , Abu Sufian , Paramartha Dutta

Few-shot segmentation is a challenging dense prediction task, which entails segmenting a novel query image given only a small annotated support set. The key problem is thus to design a method that aggregates detailed information from the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Joakim Johnander , Johan Edstedt , Michael Felsberg , Fahad Shahbaz Khan , Martin Danelljan

It is generally accepted that one of the critical parts of current vision algorithms based on deep learning and convolutional neural networks is the annotation of a sufficient number of images to achieve competitive performance. This is…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Kai Yao , Alberto Ortiz , Francisco Bonnin-Pascual

Panoptic Part Segmentation (PPS) unifies panoptic and part segmentation into one task. Previous works utilize separate approaches to handle things, stuff, and part predictions without shared computation and task association. We aim to unify…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xiangtai Li , Shilin Xu , Yibo Yang , Haobo Yuan , Guangliang Cheng , Yunhai Tong , Zhouchen Lin , Ming-Hsuan Yang , Dacheng Tao

Panoptic and instance segmentation networks are often trained with specialized object detection modules, complex loss functions, and ad-hoc post-processing steps to manage the permutation-invariance of the instance masks. This work builds…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Wouter Van Gansbeke , Bert De Brabandere

In computer vision, superpixels have been widely used as an effective way to reduce the number of image primitives for subsequent processing. But only a few attempts have been made to incorporate them into deep neural networks. One main…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Fengting Yang , Qian Sun , Hailin Jin , Zihan Zhou

Panoptic segmentation is a key enabler for robotic perception, as it unifies semantic understanding with object-level reasoning. However, the increasing complexity of state-of-the-art models makes them unsuitable for deployment on…

Robotics · Computer Science 2026-05-19 Calvin Galagain , Martyna Poreba , François Goulette , Cyrill Stachniss