English
Related papers

Related papers: Panoptic SegFormer: Delving Deeper into Panoptic S…

200 papers

In this paper, we present an algorithm to tackle a video panoptic segmentation problem, a newly emerging area of research. The video panoptic segmentation is a task that unifies the typical task of panoptic segmentation and multi-object…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Jeongwon Ryu , Kwangjin Yoon

Recently, there has been a panoptic segmentation task combining semantic and instance segmentation, in which the goal is to classify each pixel with the corresponding instance ID. In this work, we propose a solution to tackle the panoptic…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shuo-En Chang , Yi-Cheng Yang , En-Ting Lin , Pei-Yung Hsiao , Li-Chen Fu

In this paper, we present a conceptually simple, strong, and efficient framework for fully- and weakly-supervised panoptic segmentation, called Panoptic FCN. Our approach aims to represent and predict foreground things and background stuff…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Yanwei Li , Hengshuang Zhao , Xiaojuan Qi , Yukang Chen , Lu Qi , Liwei Wang , Zeming Li , Jian Sun , Jiaya Jia

Convolutional Neural Networks (CNNs) and Transformers have achieved remarkable success in computer vision tasks. However, their deep architectures often lead to high computational redundancy, making them less suitable for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Novendra Setyawan , Ghufron Wahyu Kurniawan , Chi-Chia Sun , Jun-Wei Hsieh , Jing-Ming Guo , Wen-Kai Kuo

Referring image segmentation aims to segment an object referred to by natural language expression from an image. The primary challenge lies in the efficient propagation of fine-grained semantic information from textual features to visual…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yichen Yan , Xingjian He , Sihan Chen , Jing Liu

Two-stage and query-based instance segmentation methods have achieved remarkable results. However, their segmented masks are still very coarse. In this paper, we present Mask Transfiner for high-quality and efficient instance segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Lei Ke , Martin Danelljan , Xia Li , Yu-Wing Tai , Chi-Keung Tang , Fisher Yu

Panoptic segmentation combines instance and semantic predictions, allowing the detection of "things" and "stuff" simultaneously. Effectively approaching panoptic segmentation in remotely sensed data can be auspicious in many challenging…

We present a novel end-to-end single-shot method that segments countable object instances (things) as well as background regions (stuff) into a non-overlapping panoptic segmentation at almost video frame rate. Current state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Mark Weber , Jonathon Luiten , Bastian Leibe

We propose a fully differentiable architecture for simultaneous semantic and instance segmentation (a.k.a. panoptic segmentation) consisting of a convolutional neural network and an asymmetric multiway cut problem solver. The latter solves…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Ahmed Abbas , Paul Swoboda

Referring image segmentation aims to segment the image region of interest according to the given language expression, which is a typical multi-modal task. Existing methods either adopt the pixel classification-based or the learnable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Zhichao Wei , Xiaohao Chen , Mingqiang Chen , Siyu Zhu

In panoptic scene graph generation (PSGG), models retrieve interactions between objects in an image which are grounded by panoptic segmentation masks. Previous evaluations on panoptic scene graphs have been subject to an erroneous…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Julian Lorenz , Alexander Pest , Daniel Kienzle , Katja Ludwig , Rainer Lienhart

Medical imaging segmentation plays a significant role in the automatic recognition and analysis of lesions. State-of-the-art methods, particularly those utilizing transformers, have been prominently adopted in 3D semantic segmentation due…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Shengbo Tan , Zeyu Zhang , Ying Cai , Daji Ergu , Lin Wu , Binbin Hu , Pengzhang Yu , Yang Zhao

As a fundamental task in computer vision, semantic segmentation is widely applied in fields such as autonomous driving, remote sensing image analysis, and medical image processing. In recent years, Transformer-based segmentation methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Tai An , Weiqiang Huang , Da Xu , Qingyuan He , Jiacheng Hu , Yujia Lou

Few-shot Semantic Segmentation addresses the challenge of segmenting objects in query images with only a handful of annotated examples. However, many previous state-of-the-art methods either have to discard intricate local semantic features…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Amirreza Fateh , Mohammad Reza Mohammadi , Mohammad Reza Jahed Motlagh

How to identify and segment camouflaged objects from the background is challenging. Inspired by the multi-head self-attention in Transformers, we present a simple masked separable attention (MSA) for camouflaged object detection. We first…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Bowen Yin , Xuying Zhang , Qibin Hou , Bo-Yuan Sun , Deng-Ping Fan , Luc Van Gool

Accurately perceiving and tracking instances over time is essential for the decision-making processes of autonomous agents interacting safely in dynamic environments. With this intention, we propose Mask4Former for the challenging task of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Kadir Yilmaz , Jonas Schult , Alexey Nekrasov , Bastian Leibe

Hair artifacts in dermoscopic images present significant challenges for accurate skin lesion analysis, potentially obscuring critical diagnostic features in dermatological assessments. This work introduces a fine-tuned SegFormer model…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Asif Mohammed Saad , Umme Niraj Mahi

Given an input image and set of class names, panoptic segmentation aims to label each pixel in an image with class labels and instance labels. In comparison, Open Vocabulary Panoptic Segmentation aims to facilitate the segmentation of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Nafis Sadeq , Qingfeng Liu , Mostafa El-Khamy

Semantic segmentation has witnessed remarkable advancements with the adaptation of the Transformer architecture. Parallel to the strides made by the Transformer, CNN-based U-Net has seen significant progress, especially in high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Seul-Ki Yeom , Julian von Klitzing

Panoptic segmentation unifies semantic and instance segmentation and thus delivers a semantic class label and, for so-called thing classes, also an instance label per pixel. The differentiation of distinct objects of the same class with a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Tuan Nguyen , Max Mehltretter , Franz Rottensteiner