English
Related papers

Related papers: Leveraging Swin Transformer for Local-to-Global We…

200 papers

We present a simple approach to make pre-trained Vision Transformers (ViTs) interpretable for fine-grained analysis, aiming to identify and localize the traits that distinguish visually similar categories, such as bird species. Pre-trained…

Weakly supervised semantic segmentation (WSSS) approaches typically rely on class activation maps (CAMs) for initial seed generation, which often fail to capture global context due to limited supervision from image-level labels. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Soojin Jang , Jungmin Yun , Junehyoung Kwon , Eunju Lee , Youngbin Kim

Learning semantic segmentation models under image-level supervision is far more challenging than under fully supervised setting. Without knowing the exact pixel-label correspondence, most weakly-supervised methods rely on external models to…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Zi-Yi Ke , Chiou-Ting Hsu

Super-resolution, which aims to reconstruct high-resolution images from low-resolution images, has drawn considerable attention and has been intensively studied in computer vision and remote sensing communities. The super-resolution…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Rui Li , Xiaowei Zhao

The Vision Transformer (ViT) leverages the Transformer's encoder to capture global information by dividing images into patches and achieves superior performance across various computer vision tasks. However, the self-attention mechanism of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Tianxiao Zhang , Wenju Xu , Bo Luo , Guanghui Wang

The Vision Transformer (ViT) excels in global modeling but faces deployment challenges on resource-constrained devices due to the quadratic computational complexity of its attention mechanism. To address this, we propose the Semantic-Aware…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Youbing Hu , Yun Cheng , Anqi Lu , Dawei Wei , Zhijun Li

Vision Transformers (ViT) have recently brought a new wave of research in the field of computer vision. These models have performed particularly well in image classification and segmentation. Research on semantic and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Ashim Dahal , Saydul Akbar Murad , Nick Rahimi

Recently, masked image modeling (MIM) has offered a new methodology of self-supervised pre-training of vision transformers. A key idea of efficient implementation is to discard the masked image patches (or tokens) throughout the target…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Xiaosong Zhang , Yunjie Tian , Wei Huang , Qixiang Ye , Qi Dai , Lingxi Xie , Qi Tian

Weakly Supervised Object Localization (WSOL), which aims to localize objects by only using image-level labels, has attracted much attention because of its low annotation cost in real applications. Current studies focus on the Class…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Xi Yang , Songsong Duan , Nannan Wang , Xinbo Gao

Models based on deep convolutional neural networks (CNN) have significantly improved the performance of semantic segmentation. However, learning these models requires a large amount of training images with pixel-level labels, which are very…

Computer Vision and Pattern Recognition · Computer Science 2018-02-05 Linwei Ye , Zhi Liu , Yang Wang

In the past few years, convolutional neural networks (CNNs) have achieved milestones in medical image analysis. Especially, the deep neural networks based on U-shaped architecture and skip-connections have been widely applied in a variety…

Image and Video Processing · Electrical Eng. & Systems 2021-05-13 Hu Cao , Yueyue Wang , Joy Chen , Dongsheng Jiang , Xiaopeng Zhang , Qi Tian , Manning Wang

Most existing weakly supervised semantic segmentation (WSSS) methods rely on Class Activation Mapping (CAM) to extract coarse class-specific localization maps using image-level labels. Prior works have commonly used an off-line heuristic…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Lian Xu , Mohammed Bennamoun , Farid Boussaid , Wanli Ouyang , Ferdous Sohel , Dan Xu

Surface cracks are a common sight on public infrastructure nowadays. Recent work has been addressing this problem by supporting structural maintenance measures using machine learning methods. Those methods are used to segment surface cracks…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Jacob König , Mark Jenkins , Mike Mannion , Peter Barrie , Gordon Morison

Weakly Supervised Semantic Segmentation (WSSS) based on image-level labels has been greatly advanced by exploiting the outputs of Class Activation Map (CAM) to generate the pseudo labels for semantic segmentation. However, CAM merely…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Fei Zhang , Chaochen Gu , Chenyue Zhang , Yuchao Dai

Image-level weakly supervised semantic segmentation is a challenging problem that has been deeply studied in recent years. Most of advanced solutions exploit class activation map (CAM). However, CAMs can hardly serve as the object mask due…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Yude Wang , Jie Zhang , Meina Kan , Shiguang Shan , Xilin Chen

For computer vision, Vision Transformers (ViTs) have become one of the go-to deep net architectures. Despite being inspired by Convolutional Neural Networks (CNNs), ViTs' output remains sensitive to small spatial shifts in the input, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Renan A. Rojas-Gomez , Teck-Yian Lim , Minh N. Do , Raymond A. Yeh

Recently proposed methods for weakly-supervised semantic segmentation have achieved impressive performance in predicting pixel classes despite being trained with only image labels which lack positional information. Because image annotations…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Lyndon Chan , Mahdi S. Hosseini , Konstantinos N. Plataniotis

Existing weakly-supervised semantic segmentation methods using image-level annotations typically rely on initial responses to locate object regions. However, such response maps generated by the classification network usually focus on…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Yu-Ting Chang , Qiaosong Wang , Wei-Chih Hung , Robinson Piramuthu , Yi-Hsuan Tsai , Ming-Hsuan Yang

Self-supervised vision transformers (SSTs) have shown great potential to yield rich localization maps that highlight different objects in an image. However, these maps remain class-agnostic since the model is unsupervised. They often tend…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Shakeeb Murtaza , Soufiane Belharbi , Marco Pedersoli , Aydin Sarraf , Eric Granger

Supervised learning can learn large representational spaces, which are crucial for handling difficult learning tasks. However, due to the design of the model, classical image classification approaches struggle to generalize to new problems…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Safwen Naimi , Rien van Leeuwen , Wided Souidene , Slim Ben Saoud