English
Related papers

Related papers: Transformers Fusion across Disjoint Samples for Hy…

200 papers

Recently, the vision transformer (ViT) has made breakthroughs in image recognition. Its self-attention mechanism (MSA) can extract discriminative labeling information of different pixel blocks to improve image classification accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Chao Hu , Liqiang Zhu , Weibin Qiu , Weijie Wu

The recent advancement of spatial transcriptomics (ST) allows to characterize spatial gene expression within tissue for discovery research. However, current ST platforms suffer from low resolution, hindering in-depth understanding of…

Image and Video Processing · Electrical Eng. & Systems 2025-11-05 Xiaofei Wang , Xingxu Huang , Stephen J. Price , Chao Li

Hyperspectral change detection (HCD) is one of the core applications of remote sensing images, holding significant research value in fields like environmental monitoring and disaster assessment. However, existing methods often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Mingshuai Sheng , Bhatti Uzair Aslam , Junfeng Zhang , Siling Feng , Yonis Gulzar

Attention mechanism has gained huge popularity due to its effectiveness in achieving high accuracy in different domains. But attention is opportunistic and is not justified by the content or usability of the content. Transformer like…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Chiranjib Sur

The inclusion of spatial information into spectral classifiers for fine-resolution hyperspectral imagery has led to significant improvements in terms of classification performance. The task of spectral-spatial hyperspectral image…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Puhong Duan , Pedram Ghamisi , Xudong Kang , Behnood Rasti , Shutao Li , Richard Gloaguen

Neural networks have become the standard technique for medical diagnostics, especially in cancer detection and classification. This work evaluates the performance of Vision Transformers architectures, including Swin Transformer and MaxViT,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Óscar A. Martín , Javier Sánchez

Recent advances in Vision Transformers (ViTs) have significantly enhanced medical image segmentation by facilitating the learning of global relationships. However, these methods face a notable challenge in capturing diverse local and global…

Image and Video Processing · Electrical Eng. & Systems 2024-07-11 Szymon Płotka , Maciej Chrabaszcz , Przemyslaw Biecek

This paper presents a new vision Transformer, called Swin Transformer, that capably serves as a general-purpose backbone for computer vision. Challenges in adapting Transformer from language to vision arise from differences between the two…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Ze Liu , Yutong Lin , Yue Cao , Han Hu , Yixuan Wei , Zheng Zhang , Stephen Lin , Baining Guo

Attention-based models such as transformers have shown outstanding performance on dense prediction tasks, such as semantic segmentation, owing to their capability of capturing long-range dependency in an image. However, the benefit of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Ashutosh Agarwal , Chetan Arora

With an unprecedented increase in the number of agents and systems that aim to navigate the real world using visual cues and the rising impetus for 3D Vision Models, the importance of depth estimation is hard to understate. While supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Snehal Singh Tomar , Maitreya Suin , A. N. Rajagopalan

Enabled by multi-head self-attention, Transformer has exhibited remarkable results in speech emotion recognition (SER). Compared to the original full attention mechanism, window-based attention is more effective in learning fine-grained…

Sound · Computer Science 2023-02-28 Weidong Chen , Xiaofen Xing , Xiangmin Xu , Jianxin Pang , Lan Du

One of the common and promising deep learning approaches used for medical image segmentation is transformers, as they can capture long-range dependencies among the pixels by utilizing self-attention. Despite being successful in medical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Md Motiur Rahman , Shiva Shokouhmand , Smriti Bhatt , Miad Faezipour

Side-scan sonar (SSS) imagery presents unique challenges in the classification of man-made objects on the seafloor due to the complex and varied underwater environments. Historically, experts have manually interpreted SSS images, relying on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 BW Sheffield , Jeffrey Ellen , Ben Whitmore

The Transformer has been successfully used in medical image segmentation due to its excellent long-range modeling capabilities. However, patch segmentation is necessary when building a Transformer class model. This process may disrupt the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Xiaofei Huang , Hongfang Gong , Jin Zhang

The recently developed vision transformer (ViT) has achieved promising results on image classification compared to convolutional neural networks. Inspired by this, in this paper, we study how to learn multi-scale feature representations in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Chun-Fu Chen , Quanfu Fan , Rameswar Panda

Automatically segmenting objects from optical remote sensing images (ORSIs) is an important task. Most existing models are primarily based on either convolutional or Transformer features, each offering distinct advantages. Exploiting both…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yanguang Sun , Jiexi Yan , Jianjun Qian , Chunyan Xu , Jian Yang , Lei Luo

Hyperspectral image (HSI) classification is a crucial technique for remote sensing to build large-scale earth monitoring systems. HSI contains much more information than traditional visual images for identifying the categories of land…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Zhiqiang Gao , Jiaqi Wang , Hangchi Shen , Zhihao Dou , Xiangbo Zhang , Kaizhu Huang

Effective feature fusion of multispectral images plays a crucial role in multi-spectral object detection. Previous studies have demonstrated the effectiveness of feature fusion using convolutional neural networks, but these methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Jifeng Shen , Yifei Chen , Yue Liu , Xin Zuo , Heng Fan , Wankou Yang

The deep learning model Transformer has achieved remarkable success in the hyperspectral image (HSI) restoration tasks by leveraging Spectral and Spatial Self-Attention (SA) mechanisms. However, applying these designs to remote sensing (RS)…

Image and Video Processing · Electrical Eng. & Systems 2023-12-13 Yo-Yu Lai , Chia-Hsiang Lin , Zi-Chao Leng

This paper presents a novel framework called HST for semi-supervised video object segmentation (VOS). HST extracts image and video features using the latest Swin Transformer and Video Swin Transformer to inherit their inductive bias for the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Jun-Sang Yoo , Hongjae Lee , Seung-Won Jung