English
Related papers

Related papers: Spatial-Frequency Enhanced Mamba for Multi-Modal I…

200 papers

Video anomaly detection (VAD) has been extensively researched due to its potential for intelligent video systems. However, most existing methods based on CNNs and transformers still suffer from substantial computational burdens and have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Zhangxun Li , Mengyang Zhao , Xuan Yang , Yang Liu , Jiamu Sheng , Xinhua Zeng , Tian Wang , Kewei Wu , Yu-Gang Jiang

Multimodal medical analysis combining image and tabular data has gained increasing attention. However, effective fusion remains challenging due to cross-modal discrepancies in feature dimensions and modality contributions, as well as the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Congjing Yu , Jing Ye , Yang Liu , Xiaodong Zhang , Zhiyong Zhang

Since the era of deep learning, convolutional neural networks (CNNs) and vision transformers (ViTs) have been extensively studied and widely used in medical image classification tasks. Unfortunately, CNN's limitations in modeling long-range…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Yubiao Yue , Zhenzhang Li

Precise alignment of multi-modal images with inherent feature discrepancies poses a pivotal challenge in deformable image registration. Traditional learning-based approaches often consider registration networks as black boxes without…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kaiang Wen , Bin Xie , Bin Duan , Yan Yan

Efficient extraction of spectral sequences and geospatial information has always been a hot topic in hyperspectral image classification. In terms of spectral sequence feature capture, RNN and Transformer have become mainstream…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Aitao Yang , Min Li , Yao Ding , Leyuan Fang , Yaoming Cai , Yujie He

Balancing fine-grained local modeling with long-range dependency capture under computational constraints remains a central challenge in sequence modeling. While Transformers provide strong token mixing, they suffer from quadratic…

Machine Learning · Computer Science 2026-03-20 Youjin Wang , Jiaqiao Zhao , Rong Fu , Run Zhou , Ruizhe Zhang , Jiani Liang , Suisuai Cao , Feng Zhou

Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains. However, recent literature highlights issues with attention networks,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Badri N. Patro , Vijay S. Agneeswaran

The essence of multi-modal fusion lies in exploiting the complementary information inherent in diverse modalities. However, prevalent fusion methods rely on traditional neural architectures and are inadequately equipped to capture the…

Artificial Intelligence · Computer Science 2025-06-19 Wenbing Li , Hang Zhou , Junqing Yu , Zikai Song , Wei Yang

Unmanned Aerial Vehicle (UAV) object detection has been widely used in traffic management, agriculture, emergency rescue, etc. However, it faces significant challenges, including occlusions, small object sizes, and irregular shapes. These…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Wei Li , Jiaman Tang , Yang Li , Beihao Xia , Ligang Tan , Hongmao Qin

Multi-modal fusion holds great promise for integrating information from different modalities. However, due to a lack of consideration for modal consistency, existing multi-modal fusion methods in the field of remote sensing still face…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mingxiang Cao , Weiying Xie , Xin Zhang , Jiaqing Zhang , Kai Jiang , Jie Lei , Yunsong Li

Recurrent neural networks and Transformers have recently dominated most applications in hyperspectral (HS) imaging, owing to their capability to capture long-range dependencies from spectrum sequences. However, despite the success of these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Jing Yao , Danfeng Hong , Chenyu Li , Jocelyn Chanussot

Multispectral and Hyperspectral Image Fusion (MHIF) is a practical task that aims to fuse a high-resolution multispectral image (HR-MSI) and a low-resolution hyperspectral image (LR-HSI) of the same scene to obtain a high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 ShangQi Deng , RuoCheng Wu , Liang-Jian Deng , Ran Ran , Gemine Vivone

Neuron segmentation is the cornerstone of reconstructing comprehensive neuronal connectomes, which is essential for deciphering the functional organization of the brain. The irregular morphology and densely intertwined structures of neurons…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Liuyun Jiang , Yizhuo Lu , Yanchao Zhang , Jiazheng Liu , Hua Han

Sequential recommendation systems aim to predict users' next preferences based on their interaction histories, but existing approaches face critical limitations in efficiency and multi-scale pattern recognition. While Transformer-based…

Information Retrieval · Computer Science 2025-05-08 Qianru Zhang , Liang Qu , Honggang Wen , Dong Huang , Siu-Ming Yiu , Nguyen Quoc Viet Hung , Hongzhi Yin

Multimodal remote sensing object detection aims to achieve more accurate and robust perception under challenging conditions by fusing complementary information from different modalities. However, existing approaches that rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jianhong Han , Yupei Wang , Yuan Zhang , Liang Chen

Snapshot Compressive Imaging (SCI) enables fast spectral imaging but requires effective decoding algorithms for hyperspectral image (HSI) reconstruction from compressed measurements. Current CNN-based methods are limited in modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Wenzhe Tian , Haijin Zeng , Yin-Ping Zhao , Yongyong Chen , Zhen Wang , Xuelong Li

Pansharpening fuses a high-resolution panchromatic (PAN) image with a low-resolution multispectral (LRMS) image to produce a high-resolution multispectral (HRMS) image. A key difficulty is that jointly processing PAN and MS features often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Haoyu Zhang , Junhan Luo , Yugang Cao , Jie Huang , Liangjian-Deng

Multimodal evidence is critical in computational pathology: gigapixel whole slide images capture tumor morphology, while patient-level clinical descriptors preserve complementary context for prognosis. Integrating such heterogeneous signals…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Chengying She , Chengwei Chen , Xinran Zhang , Ben Wang , Lizhuang Liu , Chengwei Shao , Yun Bian

Existing RGB-Event detection methods process the low-information regions of both modalities (background in images and non-event regions in event data) uniformly during feature extraction and fusion, resulting in high computational costs and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Nan Yang , Yang Wang , Zhanwen Liu , Yuchao Dai , Yang Liu , Xiangmo Zhao

Transformer-based methods have demonstrated impressive performance in 4D light field (LF) super-resolution by effectively modeling long-range spatial-angular correlations, but their quadratic complexity hinders the efficient processing of…

Image and Video Processing · Electrical Eng. & Systems 2024-06-25 Ruisheng Gao , Zeyu Xiao , Zhiwei Xiong