English
Related papers

Related papers: MSD-KMamba: Bidirectional Spatial-Aware Multi-Moda…

200 papers

Accurate microscopic medical image segmentation plays a crucial role in diagnosing various cancerous cells and identifying tumors. Driven by advancements in deep learning, convolutional neural networks (CNNs) and transformer-based models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Daniya Najiha Abdul Kareem , Abdul Hannan , Mubashir Noman , Jean Lahoud , Mustansar Fiaz , Hisham Cholakkal

2D RGB images and 3D LIDAR point clouds provide complementary knowledge for the perception system of autonomous vehicles. Several 2D and 3D fusion methods have been explored for the LIDAR semantic segmentation task, but they suffer from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Jun Cen , Shiwei Zhang , Yixuan Pei , Kun Li , Hang Zheng , Maochun Luo , Yingya Zhang , Qifeng Chen

Multimodal fusion has made great progress in the field of remote sensing image classification due to its ability to exploit the complementary spatial-spectral information. Deep learning methods such as CNN and Transformer have been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Qingyu Wang , Xue Jiang , Guozheng Xu

Vision Mamba models have been extensively researched in various fields, which address the limitations of previous models by effectively managing long-range dependencies with a linear-time overhead. Several prospective studies have further…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Renrong Shao , Dongyang Li , Dong Xia , Lin Shao , Jiangdong Lu , Fen Zheng , Lulu Zhang

Automatic medical image segmentation technology has the potential to expedite pathological diagnoses, thereby enhancing the efficiency of patient care. However, medical images often have complex textures and structures, and the models often…

Image and Video Processing · Electrical Eng. & Systems 2024-10-03 Jiashu Xu

The quadratic computational complexity of self-attention in diffusion transformers (DiT) introduces substantial computational costs in high-resolution image generation. While the linear-complexity Mamba model emerges as a potential…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yuan Yao , Yicong Hong , Difan Liu , Long Mai , Feng Liu , Jiebo Luo

Multimodal image fusion aims to integrate information from different imaging techniques to produce a comprehensive, detail-rich single image for downstream vision tasks. Existing methods based on local convolutional neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xinyu Xie , Yawen Cui , Tao Tan , Xubin Zheng , Zitong Yu

In the field of medical image segmentation, models based on both CNN and Transformer have been thoroughly investigated. However, CNNs have limited modeling capabilities for long-range dependencies, making it challenging to exploit the…

Image and Video Processing · Electrical Eng. & Systems 2024-09-10 Mingya Zhang , Zhihao Chen , Yiyuan Ge , Xianping Tao

Accurate 3D medical image segmentation requires a delicate balance between fine-grained local details and global contextual understanding. While spatial-domain models often struggle with long-range dependencies, existing frequency-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Bo Zhang , Yifan Zhang , Shuo Yan , Yu Bai , Zheng Zhang , Wu Liu , Wendong Wang , Yongdong Zhang

Convolutional Neural Networks (CNNs) and Transformer-based self-attention models have become the standard for medical image segmentation. This paper demonstrates that convolution and self-attention, while widely used, are not the only…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Abbas Khan , Muhammad Asad , Martin Benning , Caroline Roney , Gregory Slabaugh

Pan-sharpening aims to generate high-resolution multispectral (HRMS) images by integrating a high-resolution panchromatic (PAN) image with its corresponding low-resolution multispectral (MS) image. To achieve effective fusion, it is crucial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Yingying Wang , Xuanhua He , Chen Wu , Jialing Huang , Suiyun Zhang , Rui Liu , Xinghao Ding , Haoxuan Che

Recent advancements in sequence modeling have led to the development of the Mamba architecture, noted for its selective state space approach, offering a promising avenue for efficient long sequence handling. However, its application in 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Shentong Mo

Medical image segmentation plays an important role in various clinical applications; however, existing deep learning models face trade-offs between efficiency and accuracy. Convolutional Neural Networks (CNNs) capture local details well but…

Image and Video Processing · Electrical Eng. & Systems 2025-10-20 Saqib Qamar , Mohd Fazil , Parvez Ahmad , Shakir Khan , Abu Taha Zamani

Recent advancements in medical imaging have resulted in more complex and diverse images, with challenges such as high anatomical variability, blurred tissue boundaries, low organ contrast, and noise. Traditional segmentation methods…

Image and Video Processing · Electrical Eng. & Systems 2024-11-01 Yufeng Jiang , Zongxi Li , Xiangyan Chen , Haoran Xie , Jing Cai

State Space Models (SSMs) such as Mamba have become a popular alternative to Transformer models, due to their reduced memory consumption and higher throughput at generation compared to their Attention-based counterparts. On the other hand,…

Computation and Language · Computer Science 2026-04-17 Abhinav Moudgil , Ningyuan Huang , Eeshan Gunesh Dhekane , Pau Rodríguez , Luca Zappella , Federico Danieli

Existing CNN-based speech separation models face local receptive field limitations and cannot effectively capture long time dependencies. Although LSTM and Transformer-based speech separation models can avoid this problem, their high…

Sound · Computer Science 2024-09-11 Kai Li , Guo Chen , Runxuan Yang , Xiaolin Hu

General networks for 3D medical image segmentation have recently undergone extensive exploration. Behind the exceptional performance of these networks lies a significant demand for a large volume of pixel-level annotated data, which is…

Image and Video Processing · Electrical Eng. & Systems 2024-09-16 Hualiang Wang , Yiqun Lin , Xinpeng Ding , Xiaomeng Li

Point cloud segmentation is an important topic in 3D understanding that has traditionally has been tackled using either the CNN or Transformer. Recently, Mamba has emerged as a promising alternative, offering efficient long-range contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yong Xien Chng , Xuchong Qiu , Yizeng Han , Yifan Pu , Jiewei Cao , Gao Huang

Balancing fine-grained local modeling with long-range dependency capture under computational constraints remains a central challenge in sequence modeling. While Transformers provide strong token mixing, they suffer from quadratic…

Machine Learning · Computer Science 2026-03-20 Youjin Wang , Jiaqiao Zhao , Rong Fu , Run Zhou , Ruizhe Zhang , Jiani Liang , Suisuai Cao , Feng Zhou

Spatial-Spectral Mamba (SSM) improves computational efficiency and captures long-range dependencies, addressing Transformer limitations. However, traditional Mamba models overlook rich spectral information in HSIs and struggle with high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Muhammad Ahmad , Muhammad Hassaan Farooq Butt , Muhammad Usama , Hamad Ahmed Altuwaijri , Manuel Mazzara , Salvatore Distefano