English
Related papers

Related papers: Vim-F: Visual State Space Model Benefiting from Le…

200 papers

Joint feature modeling in both the spatial and frequency domains has become a mainstream approach in MRI reconstruction. However, existing methods generally treat the frequency domain as a whole, neglecting the differences in the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Xiaoyan Kui , Zijie Fan , Zexin Ji , Qinsong Li , Hao Xu , Weixin Si , Haodong Xu , Beiji Zou

In recent years, visually-rich document understanding has attracted increasing attention. Transformer-based pre-trained models have become the mainstream approach, yielding significant performance gains in this field. However, the…

Computation and Language · Computer Science 2025-02-11 Pengfei Hu , Zhenrong Zhang , Jiefeng Ma , Shuhang Liu , Jun Du , Jianshu Zhang

Recently, infrared small target detection (ISTD) has made significant progress, thanks to the development of basic models. Specifically, the models combining CNNs with transformers can successfully extract both local and global features.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Tianxiang Chen , Zi Ye , Zhentao Tan , Tao Gong , Yue Wu , Qi Chu , Bin Liu , Nenghai Yu , Jieping Ye

In recent years, there has been a growing interest in integrating linear state-space models (SSM) in deep neural network architectures of foundation models. This is exemplified by the recent success of Mamba, showing better performance than…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Carmen Amo Alonso , Jerome Sieber , Melanie N. Zeilinger

Multi-modal learning that combines pathological images with genomic data has significantly enhanced the accuracy of survival prediction. Nevertheless, existing methods have not fully utilized the inherent hierarchical structure within both…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Ying Chen , Jiajing Xie , Yuxiang Lin , Yuhang Song , Wenxian Yang , Rongshan Yu

Spatial transcriptomics reveals gene expression patterns within tissue context, enabling precision oncology applications such as treatment response prediction, but its high cost and technical complexity limit clinical adoption. Predicting…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Won June Cho , Hongjun Yoon , Daeky Jeong , Hyeongyeol Lim , Yosep Chong

Voice user interfaces (VUIs) have facilitated the efficient interactions between humans and machines through spoken commands. Since real-word acoustic scenes are complex, speech enhancement plays a critical role for robust VUI. Transformer…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-12 Moran Chen , Qiquan Zhang , Mingjiang Wang , Xiangyu Zhang , Hexin Liu , Eliathamby Ambikairaiah , Deying Chen

State Space Models (SSMs) have emerged as powerful alternatives to attention-based Transformers, with Mamba demonstrating impressive efficiency and scalability. As these models grow increasingly larger, the need for Parameter-Efficient…

Machine Learning · Computer Science 2026-03-03 Donghyun Lee , Yuhang Li , Ruokai Yin , Shiting Xiao , Priyadarshini Panda

Attention mechanisms have been widely used to capture long-range dependencies among nodes in Graph Transformers. Bottlenecked by the quadratic computational cost, attention mechanisms fail to scale in large graphs. Recent improvements in…

Machine Learning · Computer Science 2024-02-02 Chloe Wang , Oleksii Tsepa , Jun Ma , Bo Wang

Combining CNNs or ViTs, with RNNs for spatiotemporal forecasting, has yielded unparalleled results in predicting temporal and spatial dynamics. However, modeling extensive global information remains a formidable challenge; CNNs are limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Yujin Tang , Peijie Dong , Zhenheng Tang , Xiaowen Chu , Junwei Liang

State Space Models (SSM), such as Mamba, have shown strong representation ability in modeling long-range dependency with linear complexity, achieving successful applications from high-level to low-level vision tasks. However, SSM's…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Junbo Qiao , Jincheng Liao , Wei Li , Yulun Zhang , Yong Guo , Yi Wen , Zhangxizi Qiu , Jiao Xie , Jie Hu , Shaohui Lin

Vascular segmentation in medical images is crucial for disease diagnosis and surgical navigation. However, the segmented vascular structure is often discontinuous due to its slender nature and inadequate prior modeling. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2025-07-03 Rongchang Zhao , Huanchi Liu , Jian Zhang

Multimodal medical image fusion integrates complementary information from different imaging modalities to enhance diagnostic accuracy and treatment planning. While deep learning methods have advanced performance, existing approaches face…

Image and Video Processing · Electrical Eng. & Systems 2025-08-06 Meng Zhou , Farzad Khalvati

Recent Mamba-based image restoration methods have achieved promising results but remain limited by fixed scanning patterns and inefficient feature utilization. Conventional Mamba architectures rely on predetermined paths that cannot adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Han Hu , Zhuoran Zheng , Liang Li , Chen Lyu

Ultra-high-definition (UHD) technology has attracted widespread attention due to its exceptional visual quality, but it also poses new challenges for low-light image enhancement (LLIE) techniques. UHD images inherently possess high…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Wenbin Zou , Hongxia Gao , Weipeng Yang , Tongtong Liu

Transformers and Mamba, initially invented for natural language processing, have inspired backbone architectures for visual recognition. Recent studies integrated Local Attention Transformers with Mamba to capture both local details and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Meng Lou , Yunxiang Fu , Yizhou Yu

In this work, we take the first exploration of the recently popular foundation model, i.e., State Space Model/Mamba, in image quality assessment (IQA), aiming at observing and excavating the perception potential in vision Mamba. A series of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Fengbin Guan , Xin Li , Zihao Yu , Yiting Lu , Zhibo Chen

Recent advances in sequence modeling have introduced selective SSMs as promising alternatives to Transformer architectures, offering theoretical computational efficiency and sequence processing advantages. A comprehensive understanding of…

Machine Learning · Computer Science 2025-12-01 Abdullah Al Asif , Mobina Kashaniyan , Sixing Yu , Juan Pablo Muñoz , Ali Jannesari

Image deraining is crucial for improving visual quality and supporting reliable downstream vision tasks. Although Mamba-based models provide efficient sequence modeling, their limited ability to capture fine-grained details and lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Zhiliang Zhu , Tao Zeng , Tao Yang , Guoliang Luo , Jiyong Zeng

Hyperspectral image (HSI) classification constitutes the fundamental research in remote sensing fields. Convolutional Neural Networks (CNNs) and Transformers have demonstrated impressive capability in capturing spectral-spatial contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Yan He , Bing Tu , Bo Liu , Jun Li , Antonio Plaza