English
Related papers

Related papers: Why mamba is effective? Exploit Linear Transformer…

200 papers

Unmanned Aerial Vehicle (UAV) object detection has been widely used in traffic management, agriculture, emergency rescue, etc. However, it faces significant challenges, including occlusions, small object sizes, and irregular shapes. These…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Wei Li , Jiaman Tang , Yang Li , Beihao Xia , Ligang Tan , Hongmao Qin

Mamba, based on state space model (SSM) with its linear complexity and great success in classification provide its superiority in 3D point cloud analysis. Prior to that, Transformer has emerged as one of the most prominent and successful…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jia-wei Chen , Yu-jie Xiong , Yong-bin Gao

Selective state space models (SSMs), such as Mamba, highly excel at capturing long-range dependencies in 1D sequential data, while their applications to 2D vision tasks still face challenges. Current visual SSMs often convert images into 1D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Chaodong Xiao , Minghan Li , Zhengqiang Zhang , Deyu Meng , Lei Zhang

Multi-modality image fusion is a technique that combines information from different sensors or modalities, enabling the fused image to retain complementary features from each modality, such as functional highlights and texture details.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Zixiang Zhao , Haowen Bai , Jiangshe Zhang , Yulun Zhang , Kai Zhang , Shuang Xu , Dongdong Chen , Radu Timofte , Luc Van Gool

The Transformer architecture has shown a remarkable ability in modeling global relationships. However, it poses a significant computational challenge when processing high-dimensional medical images. This hinders its development and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Zhaohu Xing , Tian Ye , Yijun Yang , Guang Liu , Lei Zhu

Numerous CNN-Transformer hybrid models rely on high-complexity global attention mechanisms to capture long-range dependencies, which introduces non-linear computational complexity and leads to significant resource consumption. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Dayu Tan , Ziwei Zhang , Yansan Su , Xin Peng , Yike Dai , Chunhou Zheng , Weimin Zhong

The goal of multispectral and hyperspectral image fusion (MHIF) is to generate high-quality images that simultaneously possess rich spectral information and fine spatial details. However, due to the inherent trade-off between spectral and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Baisong Li , Xingwang Wang , Haixiao Xu

Semantic segmentation of high-resolution remote sensing images is vital in downstream applications such as land-cover mapping, urban planning and disaster assessment.Existing Transformer-based methods suffer from the constraint between…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Enze Zhu , Zhan Chen , Dingkai Wang , Hanru Shi , Xiaoxuan Liu , Lei Wang

We introduce a novel deep learning method for decoding error correction codes based on the Mamba architecture, enhanced with Transformer layers. Our approach proposes a hybrid decoder that leverages Mamba's efficient sequential modeling…

Information Theory · Computer Science 2025-05-26 Shy-el Cohen , Yoni Choukroun , Eliya Nachmani

Recent advancements in state space models, notably Mamba, have demonstrated significant progress in modeling long sequences for tasks like language understanding. Yet, their application in vision tasks has not markedly surpassed the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Tao Huang , Xiaohuan Pei , Shan You , Fei Wang , Chen Qian , Chang Xu

Leveraging the complementary characteristics of visible (RGB) and infrared (IR) imagery offers significant potential for improving object detection. In this paper, we propose WaveMamba, a cross-modality fusion method that efficiently…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Haodong Zhu , Wenhao Dong , Linlin Yang , Hong Li , Yuguang Yang , Yangyang Ren , Qingcheng Zhu , Zichao Feng , Changbai Li , Shaohui Lin , Runqi Wang , Xiaoyan Luo , Baochang Zhang

UNet and its variants have been widely used in medical image segmentation. However, these models, especially those based on Transformer architectures, pose challenges due to their large number of parameters and computational loads, making…

Image and Video Processing · Electrical Eng. & Systems 2024-03-12 Weibin Liao , Yinghao Zhu , Xinyuan Wang , Chengwei Pan , Yasha Wang , Liantao Ma

Medical image segmentation plays an important role in computer-aided diagnosis. Traditional convolution-based U-shape segmentation architectures are usually limited by the local receptive field. Existing vision transformers have been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Qing Xu , Yanming Chen , Yue Li , Ziyu Liu , Zhenye Lou , Yixuan Zhang , Xiangjian He

Translating NIR to the visible spectrum is challenging due to cross-domain complexities. Current models struggle to balance a broad receptive field with computational efficiency, limiting practical use. Although the Selective Structured…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Huiyu Zhai , Guang Jin , Xingxing Yang , Guosheng Kang

Point cloud analysis has seen substantial advancements due to deep learning, although previous Transformer-based methods excel at modeling long-range dependencies on this task, their computational demands are substantial. Conversely, the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Zicheng Wang , Zhenghao Chen , Yiming Wu , Zhen Zhao , Luping Zhou , Dong Xu

Brain tumors exhibit high heterogeneity in morphology and multimodal contrast, making manual slice-by-slice de lineation time-consuming and experience-dependent, thus necessitating efficient and stable automated segmentation methods. To…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Hanjun Tao , Hua Wang , Fan Zhang

Dynamic graph embedding has emerged as an important technique for modeling complex time-evolving networks across diverse domains. While transformer-based models have shown promise in capturing long-range dependencies in temporal graph data,…

Machine Learning · Computer Science 2025-05-13 Ashish Parmanand Pandey , Alan John Varghese , Sarang Patil , Mengjia Xu

Transformer, a deep neural network architecture, has long dominated the field of natural language processing and beyond. Nevertheless, the recent introduction of Mamba challenges its supremacy, sparks considerable interest among…

Computation and Language · Computer Science 2024-06-25 Yuchen Zou , Yineng Chen , Zuchao Li , Lefei Zhang , Hai Zhao

Video mirror detection has received significant research attention, yet existing methods suffer from limited performance and robustness. These approaches often over-rely on single, unreliable dynamic features, and are typically built on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Rui Song , Jiaying Lin , Rynson W. H. Lau

Existing brain tumor segmentation methods usually utilize multiple Magnetic Resonance Imaging (MRI) modalities in brain tumor images for segmentation, which can achieve better segmentation performance. However, in clinical applications,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Ming Kang , Fung Fung Ting , Shier Nee Saw , Raphaël C. -W. Phan , Zongyuan Ge , Chee-Ming Ting