English
Related papers

Related papers: Leveraging Swin Transformer for Local-to-Global We…

200 papers

Currently, existing efforts in Weakly Supervised Semantic Segmentation (WSSS) based on Convolutional Neural Networks (CNNs) have predominantly focused on enhancing the multi-label classification network stage, with limited attention given…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Jia Zhang , Bo Peng , Xi Wu

Reliable classification and detection of certain medical conditions, in images, with state-of-the-art semantic segmentation networks, require vast amounts of pixel-wise annotation. However, the public availability of such datasets is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Erik Ostrowski , Bharath Srinivas Prabakaran , Muhammad Shafique

Recently, Transformer-based architectures have been explored for speaker embedding extraction. Although the Transformer employs the self-attention mechanism to efficiently model the global interaction between token embeddings, it is…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-02 Mufan Sang , Yong Zhao , Gang Liu , John H. L. Hansen , Jian Wu

The Swin transformer has recently attracted attention in medical image analysis due to its computational efficiency and long-range modeling capability. Owing to these properties, the Swin Transformer is suitable for establishing more…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Mingrui Ma , Tao Wang , Lei Song , Weijie Wang , Guixia Liu

The recent advances in image transformers have shown impressive results and have largely closed the gap between traditional CNN architectures. The standard procedure is to train on large datasets like ImageNet-21k and then finetune on…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Ethan Huynh

Semantic segmentation necessitates approaches that learn high-level characteristics while dealing with enormous amounts of data. Convolutional neural networks (CNNs) can learn unique and adaptive features to achieve this aim. However, due…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Hasan AlMarzouqi , Lyes Saad Saoud

Vision Transformers (ViT)s have recently become popular due to their outstanding modeling capabilities, in particular for capturing long-range information, and scalability to dataset and model sizes which has led to state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2022-04-06 Ali Hatamizadeh , Ziyue Xu , Dong Yang , Wenqi Li , Holger Roth , Daguang Xu

Estimating closely spaced frequency components of a signal is a fundamental problem in statistical signal processing. In this letter, we introduce 1-D real-valued and complex-valued shifted window (Swin) transformers, referred to as…

Signal Processing · Electrical Eng. & Systems 2023-09-19 Josiah W. Smith , Murat Torlak

We propose a novel algorithm for weakly supervised semantic segmentation based on image-level class labels only. In weakly supervised setting, it is commonly observed that trained model overly focuses on discriminative parts rather than the…

Computer Vision and Pattern Recognition · Computer Science 2018-01-09 Seunghoon Hong , Donghun Yeo , Suha Kwak , Honglak Lee , Bohyung Han

Semantic segmentation aims to classify every pixel of an input image. Considering the difficulty of acquiring dense labels, researchers have recently been resorting to weak labels to alleviate the annotation burden of segmentation. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Yazhou Yao , Tao Chen , Guosen Xie , Chuanyi Zhang , Fumin Shen , Qi Wu , Zhenmin Tang , Jian Zhang

Deep learning, especially convolutional neural networks (CNNs) and Transformer architectures, have become the focus of extensive research in medical image segmentation, achieving impressive results. However, CNNs come with inductive biases…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Xiao Liu , Peng Gao , Tao Yu , Fei Wang , Ru-Yue Yuan

The features of self-supervised vision transformers (ViTs) contain strong semantic and positional information relevant to downstream tasks like object localization and segmentation. Recent works combine these features with traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Ronan Docherty , Antonis Vamvakeros , Samuel J. Cooper

Convolutional neural networks (CNNs) are good at extracting contexture features within certain receptive fields, while transformers can model the global long-range dependency features. By absorbing the advantage of transformer and the merit…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Zhengyi Liu , Yacheng Tan , Qian He , Yun Xiao

Automatic medical image segmentation has made great progress benefit from the development of deep learning. However, most existing methods are based on convolutional neural networks (CNNs), which fail to build long-range dependencies and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Ailiang Lin , Bingzhi Chen , Jiayu Xu , Zheng Zhang , Guangming Lu

Neural networks have become the standard technique for medical diagnostics, especially in cancer detection and classification. This work evaluates the performance of Vision Transformers architectures, including Swin Transformer and MaxViT,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Óscar A. Martín , Javier Sánchez

Traditional feature encoding scheme (e.g., Fisher vector) with local descriptors (e.g., SIFT) and recent convolutional neural networks (CNNs) are two classes of successful methods for image recognition. In this paper, we propose a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Zhe Wang , Limin Wang , Yali Wang , Bowen Zhang , Yu Qiao

This study explores the impact of scaling semantic categories on the image classification performance of vision transformers (ViTs). In this specific case, the CLIP server provided by Jina AI is used for experimentation. The research…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Anthony Lamelas , Harrison Muchnic

This work addresses the task of completely weakly supervised class-incremental learning for semantic segmentation to learn segmentation for both base and additional novel classes using only image-level labels. While class-incremental…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 David Minkwan Kim , Soeun Lee , Byeongkeun Kang

Unsupervised Domain Adaptation (UDA) aims to utilize labeled data from a source domain to solve tasks in an unlabeled target domain, often hindered by significant domain gaps. Traditional CNN-based methods struggle to fully capture complex…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 A. Enes Doruk , Erhan Oztop , Hasan F. Ates

Weakly Supervised Semantic Segmentation (WSSS) with image-level labels has long been suffering from fragmentary object regions led by Class Activation Map (CAM), which is incapable of generating fine-grained masks for semantic segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Jiren Mai , Fei Zhang , Junjie Ye , Marcus Kalander , Xian Zhang , WanKou Yang , Tongliang Liu , Bo Han