English
Related papers

Related papers: Multimodal Fusion Transformer for Remote Sensing I…

200 papers

Side-scan sonar (SSS) imagery presents unique challenges in the classification of man-made objects on the seafloor due to the complex and varied underwater environments. Historically, experts have manually interpreted SSS images, relying on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 BW Sheffield , Jeffrey Ellen , Ben Whitmore

In the field of medical CT image processing, convolutional neural networks (CNNs) have been the dominant technique.Encoder-decoder CNNs utilise locality for efficiency, but they cannot simulate distant pixel interactions properly.Recent…

Image and Video Processing · Electrical Eng. & Systems 2022-11-03 Hongyang He , Feng Ziliang , Yuanhang Zheng , Shudong Huang , HaoBing Gao

Vision Transformer (ViT) is a pioneering deep learning framework that can address real-world computer vision issues, such as image classification and object recognition. Importantly, ViTs are proven to outperform traditional deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Yuda Bi , Anees Abrol , Zening Fu , Vince Calhoun

Since Transformer has found widespread use in NLP, the potential of Transformer in CV has been realized and has inspired many new approaches. However, the computation required for replacing word tokens with image patches for Transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Hezheng Lin , Xing Cheng , Xiangyu Wu , Fan Yang , Dong Shen , Zhongyuan Wang , Qing Song , Wei Yuan

Transformers have captured growing attention in computer vision, thanks to its large capacity and global processing capabilities. However, transformers are data hungry, and their ability to generalize is constrained compared to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Hosam S. EL-Assiouti , Hadeer El-Saadawy , Maryam N. Al-Berry , Mohamed F. Tolba

Transfer learning is widely used in computer vision (CV), natural language processing (NLP) and achieves great success. Most transfer learning systems are based on the same modality (e.g. RGB image in CV and text in NLP). However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Xiaoke Shen , Ioannis Stamos

The core for tackling the fine-grained visual categorization (FGVC) is to learn subtle yet discriminative features. Most previous works achieve this by explicitly selecting the discriminative parts or integrating the attention mechanism via…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Jun Wang , Xiaohan Yu , Yongsheng Gao

Self-attention mechanisms, especially multi-head self-attention (MSA), have achieved great success in many fields such as computer vision and natural language processing. However, many existing vision transformer (ViT) works simply inherent…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Leijie Wu , Song Guo , Yaohong Ding , Junxiao Wang , Wenchao Xu , Richard Yida Xu , Jie Zhang

In this paper, we introduce a novel Synchronized Class Token Fusion (SCT Fusion) architecture in the framework of multi-modal multi-label classification (MLC) of remote sensing (RS) images. The proposed architecture leverages…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 David Hoffmann , Kai Norman Clasen , Begüm Demir

In this paper, we present TransMVSNet, based on our exploration of feature matching in multi-view stereo (MVS). We analogize MVS back to its nature of a feature matching task and therefore propose a powerful Feature Matching Transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Yikang Ding , Wentao Yuan , Qingtian Zhu , Haotian Zhang , Xiangyue Liu , Yuanjiang Wang , Xiao Liu

Vision transformers (ViTs) have found only limited practical use in processing images, in spite of their state-of-the-art accuracy on certain benchmarks. The reason for their limited use include their need for larger training datasets and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-26 Pranav Jeevan , Amit sethi

Land Use Scene Classification (LUSC) from remote sensing imagery plays a critical role in environmental monitoring, urban planning, and sustainable resource management. In recent years, deep learning methods have significantly advanced the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Arun D. Kulkarni

The extension of convolutional neural networks (CNNs) to non-Euclidean geometries has led to multiple frameworks for studying manifolds. Many of those methods have shown design limitations resulting in poor modelling of long-range…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Simon Dahan , Logan Z. J. Williams , Abdulah Fawaz , Daniel Rueckert , Emma C. Robinson

The recent vision transformer(i.e.for image classification) learns non-local attentive interaction of different patch tokens. However, prior arts miss learning the cross-scale dependencies of different pixels, the semantic correspondence of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Yuanfeng Ji , Ruimao Zhang , Huijie Wang , Zhen Li , Lingyun Wu , Shaoting Zhang , Ping Luo

Pansharpening aims to enhance remote sensing image (RSI) quality by merging high-resolution panchromatic (PAN) with multispectral (MS) images. However, prior techniques struggled to optimally fuse PAN and MS images for enhanced spatial and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Wen-Jie Shu , Hong-Xia Dou , Rui Wen , Xiao Wu , Liang-Jian Deng

Most face identification approaches employ a Siamese neural network to compare two images at the image embedding level. Yet, this technique can be subject to occlusion (e.g. faces with masks or sunglasses) and out-of-distribution data.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Hai Phan , Cindy Le , Vu Le , Yihui He , Anh Totti Nguyen

In image fusion, images obtained from different sensors are fused to generate a single image with enhanced information. In recent years, state-of-the-art methods have adopted Convolution Neural Networks (CNNs) to encode meaningful features…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Vibashan VS , Jeya Maria Jose Valanarasu , Poojan Oza , Vishal M. Patel

Convolutional neural networks (CNN) have demonstrated outstanding Compressed Sensing (CS) performance compared to traditional, hand-crafted methods. However, they are broadly limited in terms of generalisability, inductive bias and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Marlon Bran Lorenzana , Craig Engstrom , Shekhar S. Chandra

Vision Transformer (ViT) models have recently emerged as powerful and versatile models for various visual tasks. Recently, a work called PMF has achieved promising results in few-shot image classification by utilizing pre-trained vision…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Junjie Zhu , Yiying Li , Chunping Qiu , Ke Yang , Naiyang Guan , Xiaodong Yi

As remote sensing imaging technology continues to advance and evolve, processing high-resolution and diversified satellite imagery to improve segmentation accuracy and enhance interpretation efficiency emerg as a pivotal area of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yice Cao , Chenchen Liu , Zhenhua Wu , Wenxin Yao , Liu Xiong , Jie Chen , Zhixiang Huang