English
Related papers

Related papers: Enhancing Mamba Decoder with Bidirectional Interac…

200 papers

Depression is a common mental disorder that affects millions of people worldwide. Although promising, current multimodal methods hinge on aligned or aggregated multimodal fusion, suffering two significant limitations: (i) inefficient…

Computers and Society · Computer Science 2024-09-25 Jiaxin Ye , Junping Zhang , Hongming Shan

U-shaped architectures have long dominated the field of medical image segmentation, while Transformers are widely employed for modeling long-range dependencies. The former typically handles scale variations implicitly by aggregating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yanhua Zhang , Ke Zhang , Jingyu Wang , Gabriella Balestra , Samanta Rosati , Yulin Wu , Wuwei Wang , Valentina Giannini

Selective state space models (SSMs) represented by Mamba have demonstrated their computational efficiency and promising outcomes in various tasks, including automatic speech recognition (ASR). Mamba has been applied to ASR task with the…

Sound · Computer Science 2024-11-12 Yoshiki Masuyama , Koichi Miyazaki , Masato Murata

Cross-modality fusing complementary information from different modalities effectively improves object detection performance, making it more useful and robust for a wider range of applications. Existing fusion strategies combine different…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Wenhao Dong , Haodong Zhu , Shaohui Lin , Xiaoyan Luo , Yunhang Shen , Xuhui Liu , Juan Zhang , Guodong Guo , Baochang Zhang

Transformer-based methods have achieved remarkable performance in event-based object detection, owing to the global modeling ability. However, they neglect the influence of non-event and noisy regions and process them uniformly, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Nan Yang , Yang Wang , Zhanwen Liu , Meng Li , Yisheng An , Xiangmo Zhao

We propose an innovative enhancement to the Mamba framework by increasing the Hausdorff dimension of its scanning pattern through a novel Hilbert Selective Scan mechanism. This mechanism explores the feature space more effectively,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Xinhua Wang , Caibo Feng , Xiangjun Fu , Chunxiao Liu

Sequential recommendation systems aim to predict users' next preferences based on their interaction histories, but existing approaches face critical limitations in efficiency and multi-scale pattern recognition. While Transformer-based…

Information Retrieval · Computer Science 2025-05-08 Qianru Zhang , Liang Qu , Honggang Wen , Dong Huang , Siu-Ming Yiu , Nguyen Quoc Viet Hung , Hongzhi Yin

Video mirror detection has received significant research attention, yet existing methods suffer from limited performance and robustness. These approaches often over-rely on single, unreliable dynamic features, and are typically built on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Rui Song , Jiaying Lin , Rynson W. H. Lau

Recently, a novel visual state space (VSS) model, referred to as Mamba, has demonstrated significant progress in modeling long sequences with linear complexity, comparable to Transformer models, thereby enhancing its adaptability for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Tao Wang , Tiecheng Bai , Chao Xu , Bin Liu , Erlei Zhang , Jiyun Huang , Hongming Zhang

Snapshot Compressive Imaging (SCI) enables fast spectral imaging but requires effective decoding algorithms for hyperspectral image (HSI) reconstruction from compressed measurements. Current CNN-based methods are limited in modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Wenzhe Tian , Haijin Zeng , Yin-Ping Zhao , Yongyong Chen , Zhen Wang , Xuelong Li

Advances in speech synthesis intensify security threats, motivating real-time deepfake detection research. We investigate whether bidirectional Mamba can serve as a competitive alternative to Self-Attention in detecting synthetic speech.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-14 Xi Xuan , Zimo Zhu , Wenxin Zhang , Yi-Cheng Lin , Tomi Kinnunen

Multimodal Large Language Models (MLLMs) have attracted much attention for their multifunctionality. However, traditional Transformer architectures incur significant overhead due to their secondary computational complexity. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Wenjun Huang , Jiakai Pan , Jiahao Tang , Yanyu Ding , Yifei Xing , Yuhe Wang , Zhengzhuo Wang , Jianguo Hu

Early and accurate diagnosis of brain tumors is crucial for improving patient survival rates. However, the detection and classification of brain tumors are challenging due to their diverse types and complex morphological characteristics.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Yinyi Lai , Anbo Cao , Yuan Gao , Jiaqi Shang , Zongyu Li , Jia Guo

Stock markets play an important role in the global economy, where accurate stock price predictions can lead to significant financial returns. While existing transformer-based models have outperformed long short-term memory networks and…

Computational Finance · Quantitative Finance 2025-01-14 Ali Mehrabian , Ehsan Hoseinzade , Mahdi Mazloum , Xiaohong Chen

Multicategory remote object counting is a fundamental task in computer vision, aimed at accurately estimating the number of objects of various categories in remote images. Existing methods rely on CNNs and Transformers, but CNNs struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Peng Liu , Sen Lei , Heng-Chao Li

Semantic segmentation is a fundamental task in computer vision with wide-ranging applications, including autonomous driving and robotics. While RGB-based methods have achieved strong performance with CNNs and Transformers, their…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Fuqiang Gu , Yuanke Li , Xianlei Long , Kangping Ji , Chao Chen , Qingyi Gu , Zhenliang Ni

Mamba-based architectures have shown to be a promising new direction for deep learning models owing to their competitive performance and sub-quadratic deployment speed. However, current Mamba multi-modal large language models (MLLM) are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yifei Xing , Xiangyuan Lan , Ruiping Wang , Dongmei Jiang , Wenjun Huang , Qingfang Zheng , Yaowei Wang

State Space Models (SSM), such as Mamba, have shown strong representation ability in modeling long-range dependency with linear complexity, achieving successful applications from high-level to low-level vision tasks. However, SSM's…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Junbo Qiao , Jincheng Liao , Wei Li , Yulun Zhang , Yong Guo , Yi Wen , Zhangxizi Qiu , Jiao Xie , Jie Hu , Shaohui Lin

State space models (SSMs) with selection mechanisms and hardware-aware architectures, namely Mamba, have recently demonstrated significant promise in long-sequence modeling. Since the self-attention mechanism in transformers has quadratic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Hanwei Zhang , Ying Zhu , Dan Wang , Lijun Zhang , Tianxiang Chen , Zi Ye

Perceptual image compression focuses on preserving high visual quality under low-bitrate constraints. Most existing approaches to perceptual compression leverage the strong generative capabilities of generative adversarial networks or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jiaqian Zhang , Hao Wei , Chenyang Ge , Yanhui Zhou