English
Related papers

Related papers: PEM: Prototype-based Efficient MaskFormer for Imag…

200 papers

Modern approaches typically formulate semantic segmentation as a per-pixel classification task, while instance-level segmentation is handled with an alternative mask classification. Our key insight: mask classification is sufficiently…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Bowen Cheng , Alexander G. Schwing , Alexander Kirillov

In this paper, we aim to tackle the challenging few-shot segmentation task from a new perspective. Typical methods follow the paradigm to firstly learn prototypical features from support images and then match query features in pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Siyu Jiao , Gengwei Zhang , Shant Navasardyan , Ling Chen , Yao Zhao , Yunchao Wei , Humphrey Shi

The Segment Anything Model (SAM) has exhibited outstanding performance in various image segmentation tasks. Despite being trained with over a billion masks, SAM faces challenges in mask prediction quality in numerous scenarios, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Zhaozhi Xie , Bochen Guan , Weihao Jiang , Muyang Yi , Yue Ding , Hongtao Lu , Lei Zhang

Pedestrian attribute recognition (PAR) has received increasing attention because of its wide application in video surveillance and pedestrian analysis. Extracting robust feature representation is one of the key challenges in this task. The…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Xinwen Fan , Yukang Zhang , Yang Lu , Hanzi Wang

Imaging modalities such as Computed Tomography (CT) and Positron Emission Tomography (PET) are key in cancer detection, inspiring Deep Neural Networks (DNN) models that merge these scans for tumor segmentation. When both CT and PET scans…

Image and Video Processing · Electrical Eng. & Systems 2024-04-23 Nada Saadi , Numan Saeed , Mohammad Yaqub , Karthik Nandakumar

Accurate and efficient brain tumor segmentation remains a critical challenge in neuroimaging due to the heterogeneous nature of tumor subregions and the high computational cost of volumetric inference. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Fatemeh Ziaeetabar

We study the problem of improving the efficiency of segmentation transformers by using disparate amounts of computation for different parts of the image. Our method, PAUMER, accomplishes this by pausing computation for patches that are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Evann Courdier , Prabhu Teja Sivaprasad , François Fleuret

We introduce a fast and efficient convolutional neural network, ESPNet, for semantic segmentation of high resolution images under resource constraints. ESPNet is based on a new convolutional module, efficient spatial pyramid (ESP), which is…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Sachin Mehta , Mohammad Rastegari , Anat Caspi , Linda Shapiro , Hannaneh Hajishirzi

Polygonal meshes have become the standard for discretely approximating 3D shapes, thanks to their efficiency and high flexibility in capturing non-uniform shapes. This non-uniformity, however, leads to irregularity in the mesh structure,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Giuseppe Vecchio , Luca Prezzavento , Carmelo Pino , Francesco Rundo , Simone Palazzo , Concetto Spampinato

In this work, we address various segmentation tasks, each traditionally tackled by distinct or partially unified models. We propose OMG-Seg, One Model that is Good enough to efficiently and effectively handle all the segmentation tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Xiangtai Li , Haobo Yuan , Wei Li , Henghui Ding , Size Wu , Wenwei Zhang , Yining Li , Kai Chen , Chen Change Loy

Deep neural networks have been a prevailing technique in the field of medical image processing. However, the most popular convolutional neural networks (CNNs) based methods for medical image segmentation are imperfect because they model…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Zhuangzhuang Zhang , Weixiong Zhang

Segment Anything Model (SAM) has emerged as a powerful tool for numerous vision applications. A key component that drives the impressive performance for zero-shot transfer and high versatility is a super large Transformer model trained on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yunyang Xiong , Bala Varadarajan , Lemeng Wu , Xiaoyu Xiang , Fanyi Xiao , Chenchen Zhu , Xiaoliang Dai , Dilin Wang , Fei Sun , Forrest Iandola , Raghuraman Krishnamoorthi , Vikas Chandra

Accurate and computationally efficient 3D medical image segmentation remains a critical challenge in clinical workflows. Transformer-based architectures often demonstrate superior global contextual modeling but at the expense of excessive…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Kavyansh Tyagi , Vishwas Rathi , Puneet Goyal

We present a mask-piloted Transformer which improves masked-attention in Mask2Former for image segmentation. The improvement is based on our observation that Mask2Former suffers from inconsistent mask predictions between consecutive decoder…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Hao Zhang , Feng Li , Huaizhe Xu , Shijia Huang , Shilong Liu , Lionel M. Ni , Lei Zhang

Convolutional Neural Networks (CNNs) and Transformers have achieved remarkable success in computer vision tasks. However, their deep architectures often lead to high computational redundancy, making them less suitable for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Novendra Setyawan , Ghufron Wahyu Kurniawan , Chi-Chia Sun , Jun-Wei Hsieh , Jing-Ming Guo , Wen-Kai Kuo

Recent efforts have explored multimodal semantic segmentation using various backbone architectures. However, while most methods aim to improve accuracy, their computational efficiency remains underexplored. To address this, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Zelin Zhang , Tao Zhang , KediLI , Xu Zheng

Segmentation is an important analysis task for biomedical images, enabling the study of individual organelles, cells or organs. Deep learning has massively improved segmentation methods, but challenges remain in generalization to new…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Carolin Teuber , Anwai Archit , Constantin Pape

Feature pyramids have been widely adopted in convolutional neural networks and transformers for tasks in medical image segmentation. However, existing models generally focus on the Encoder-side Transformer for feature extraction. We further…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Hongyi Cai , Mohammad Mahdinur Rahman , Wenzhen Dong , Jingyu Wu

The Foundation model for image segmentation, Segment Anything (SAM), has been actively researched in various fields since its proposal. Various researches have been proposed to adapt SAM to specific domains, with one notable approach…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Joohyeok Kim , Joonhyeon Song , Seohwan Yun , Seongho Yoon , Sangmin Lee

Medical image segmentation is pivotal in healthcare, enhancing diagnostic accuracy, informing treatment strategies, and tracking disease progression. This process allows clinicians to extract critical information from visual data, enabling…

Image and Video Processing · Electrical Eng. & Systems 2024-10-31 Ovais Iqbal Shah , Danish Raza Rizvi , Aqib Nazir Mir