English
Related papers

Related papers: MultiScale Spectral-Spatial Convolutional Transfor…

200 papers

Transformers have demonstrated remarkable performance in natural language processing and computer vision. However, existing vision Transformers struggle to learn from limited medical data and are unable to generalize on diverse medical…

Image and Video Processing · Electrical Eng. & Systems 2023-04-06 Yunhe Gao , Mu Zhou , Di Liu , Zhennan Yan , Shaoting Zhang , Dimitris N. Metaxas

A Hyperspectral image contains much more number of channels as compared to a RGB image, hence containing more information about entities within the image. The convolutional neural network (CNN) and the Multi-Layer Perceptron (MLP) have been…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Uphar Singh , Kumar Saurabh , Neelaksh Trehan , Ranjana Vyas , O. P. Vyas

In recent years, Hyperspectral Imaging (HSI) has become a powerful source for reliable data in applications such as remote sensing, agriculture, and biomedicine. However, hyperspectral images are highly data-dense and often benefit from…

Image and Video Processing · Electrical Eng. & Systems 2021-09-28 Giorgio Morales , John Sheppard , Riley Logan , Joseph Shaw

Hyperspectral images are of crucial importance in order to better understand features of different materials. To reach this goal, they leverage on a high number of spectral bands. However, this interesting characteristic is often paid by a…

Image and Video Processing · Electrical Eng. & Systems 2020-06-01 Jin-Fan Hu , Ting-Zhu Huang , Liang-Jian Deng , Tai-Xiang Jiang , Gemine Vivone , Jocelyn Chanussot

We propose a versatile deep image compression network based on Spatial Feature Transform (SFT arXiv:1804.02815), which takes a source image and a corresponding quality map as inputs and produce a compressed image with variable rates. Our…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Myungseo Song , Jinyoung Choi , Bohyung Han

Semantic segmentation of microscopy cell images by deep learning is a significant technique. We considered that the Transformers, which have recently outperformed CNNs in image recognition, could also be improved and developed for cell…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Hinako Mitsuoka , Kazuhiro Hotta

Recently, deep learning methods have been widely used for tumor segmentation of multimodal medical images with promising results. However, most existing methods are limited by insufficient representational ability, specific modality number…

Image and Video Processing · Electrical Eng. & Systems 2023-07-06 Jun Shi , Hongyu Kan , Shulan Ruan , Ziqi Zhu , Minfan Zhao , Liang Qiao , Zhaohui Wang , Hong An , Xudong Xue

We present a new encoder-decoder Vision Transformer architecture, Patcher, for medical image segmentation. Unlike standard Vision Transformers, it employs Patcher blocks that segment an image into large patches, each of which is further…

Image and Video Processing · Electrical Eng. & Systems 2023-05-31 Yanglan Ou , Ye Yuan , Xiaolei Huang , Stephen T. C. Wong , John Volpi , James Z. Wang , Kelvin Wong

Vision Transformers face a fundamental limitation: standard self-attention jointly processes spatial and channel dimensions, leading to entangled representations that prevent independent modeling of structural and semantic dependencies.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Jiashu Liao , Pietro Liò , Marc de Kamps , Duygu Sarikaya

Medical image classification has developed rapidly under the impetus of the convolutional neural network (CNN). Due to the fixed size of the receptive field of the convolution kernel, it is difficult to capture the global features of…

Image and Video Processing · Electrical Eng. & Systems 2022-09-22 Xiangzuo Huo , Gang Sun , Shengwei Tian , Yan Wang , Long Yu , Jun Long , Wendong Zhang , Aolun Li

Graph Transformers have emerged as a powerful alternative to Message-Passing Graph Neural Networks (MP-GNNs) to address limitations such as over-squashing of information exchange. However, incorporating graph inductive bias into transformer…

Machine Learning · Computer Science 2024-04-09 Zihan Pengmei , Zimu Li

In this paper, we propose a method using the fusion of CNN and transformer structure to improve image classification performance. In the case of CNN, information about a local area on an image can be extracted well, but there is a limit to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Keong Hun Choi , Jin Woo Kim , Yao Wang , Jong Eun Ha

Transformer-based models have greatly pushed the boundaries of time series forecasting recently. Existing methods typically encode time series data into $\textit{patches}$ using one or a fixed set of patch lengths. This, however, could…

Machine Learning · Computer Science 2024-02-09 Linfeng Du , Ji Xin , Alex Labach , Saba Zuberi , Maksims Volkovs , Rahul G. Krishnan

Underwater images often exhibit poor quality, distorted color balance and low contrast due to the complex and intricate interplay of light, water, and objects. Despite the significant contributions of previous underwater enhancement…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Weiwen Chen , Yingtie Lei , Shenghong Luo , Ziyang Zhou , Mingxian Li , Chi-Man Pun

Multispectral and Hyperspectral Image Fusion (MHIF) aims to reconstruct high-resolution images by integrating low-resolution hyperspectral images (LRHSI) and high-resolution multispectral images (HRMSI). However, existing methods face…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Baisong Li

Transfer learning makes it possible to use large vision networks on a variety of domains, by specializing their models' general filters to new tasks. However, these networks assume the input images to have 3 input channels, making them…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Mariette Schönfeld , Laurens Devos , Wannes Meert , Hendrik Blockeel

Pansharpening aims to generate high-resolution multispectral (HRMS) images by fusing low-resolution multispectral (LRMS) images with high-resolution panchromatic (PAN) images. However, the current mainstream frequency-based pansharpening…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zijian Zhou , Jianing Zhang , Kai Sun , Xiangyu Zhao , Chunxia Zhang , Xiangyong Cao

Hyperspectral remote sensing (HIS) enables the detailed capture of spectral information from the Earth's surface, facilitating precise classification and identification of surface crops due to its superior spectral diagnostic capabilities.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Faxu Guo , Quan Feng , Sen Yang , Wanxia Yang

Transformer-based deep neural networks have achieved remarkable success across various computer vision tasks, largely attributed to their long-range self-attention mechanism and scalability. However, most transformer architectures embed…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Muyi Bao , Changyu Zeng , Yifan Wang , Zhengni Yang , Zimu Wang , Guangliang Cheng , Jun Qi , Wei Wang

The quadratic complexity of standard self-attention severely limits the application of Transformer-based models to long-context tasks. While efficient Transformer variants exist, they often require architectural changes and costly…

Computation and Language · Computer Science 2025-11-14 Jiangshu Du , Wenpeng Yin , Philip Yu