English
Related papers

Related papers: Multi-Modal Mamba Modeling for Survival Prediction…

200 papers

Medical image classification is a core task in computer-aided diagnosis (CAD), playing a pivotal role in early disease detection, treatment planning, and patient prognosis assessment. In ophthalmic practice, fluorescein fundus angiography…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Zhuonan Wang , Wenjie Yan , Wenqiao Zhang , Xiaohui Song , Jian Ma , Ke Yao , Yibo Yu , Beng Chin Ooi

Recent advancements in the Mamba architecture, with its linear computational complexity, being a promising alternative to transformer architectures suffering from quadratic complexity. While existing works primarily focus on adapting Mamba…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jie Hu , Junwei Zheng , Jiale Wei , Jiaming Zhang , Rainer Stiefelhagen

Mamba-based architectures have shown to be a promising new direction for deep learning models owing to their competitive performance and sub-quadratic deployment speed. However, current Mamba multi-modal large language models (MLLM) are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yifei Xing , Xiangyuan Lan , Ruiping Wang , Dongmei Jiang , Wenjun Huang , Qingfang Zheng , Yaowei Wang

Background: High-resolution MRI is critical for diagnosis, but long acquisition times limit clinical use. Super-resolution (SR) can enhance resolution post-scan, yet existing deep learning methods face fidelity-efficiency trade-offs.…

Mamba-based models, VMamba and Vim, are a recent family of vision encoders that offer promising performance improvements in many computer vision tasks. This paper compares Mamba-based models with traditional Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Ali Nasiri-Sarvi , Mahdi S. Hosseini , Hassan Rivaz

Multivariate Time series forecasting is crucial in domains such as transportation, meteorology, and finance, especially for predicting extreme weather events. State-of-the-art methods predominantly rely on Transformer architectures, which…

Machine Learning · Computer Science 2024-10-16 Li Wu , Wenbin Pei , Jiulong Jiao , Qiang Zhang

In this work, we take the first exploration of the recently popular foundation model, i.e., State Space Model/Mamba, in image quality assessment (IQA), aiming at observing and excavating the perception potential in vision Mamba. A series of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Fengbin Guan , Xin Li , Zihao Yu , Yiting Lu , Zhibo Chen

State Space Models (SSMs), especially Mamba, have shown great promise in medical image segmentation due to their ability to model long-range dependencies with linear computational complexity. However, accurate medical image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Chaowei Chen , Li Yu , Shiquan Min , Shunfang Wang

Visual attention modeling, important for interpreting and prioritizing visual stimuli, plays a significant role in applications such as marketing, multimedia, and robotics. Traditional saliency prediction models, especially those based on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Alireza Hosseini , Amirhossein Kazerouni , Saeed Akhavan , Michael Brudno , Babak Taati

In this paper, we propose a self-prior guided Mamba-UNet network (SMamba-UNet) for medical image super-resolution. Existing methods are primarily based on convolutional neural networks (CNNs) or Transformers. CNNs-based methods fail to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zexin Ji , Beiji Zou , Xiaoyan Kui , Pierre Vera , Su Ruan

Recent 2D CNN-based domain adaptation approaches struggle with long-range dependencies due to limited receptive fields, making it difficult to adapt to target domains with significant spatial distribution changes. While transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 A. Enes Doruk , Hasan F. Ates

In recent years, multimodal medical data-based survival analysis has attracted much attention. However, real-world datasets often suffer from the problem of incomplete modality, where some patient modality information is missing due to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yi Yin , Yuntao Shou , Zao Dai , Yun Peng , Tao Meng , Wei Ai , Keqin Li

The effectiveness and efficiency of modeling complex spectral-spatial relations are both crucial for Hyperspectral image (HSI) classification. Most existing methods based on CNNs and transformers still suffer from heavy computational…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Jiamu Sheng , Jingyi Zhou , Jiong Wang , Peng Ye , Jiayuan Fan

Convolutional neural networks (CNNs) and transformers are widely employed in constructing UNet architectures for medical image segmentation tasks. However, CNNs struggle to model long-range dependencies, while transformers suffer from…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Shaolei Zhang , Jinyan Liu , Tianyi Qian , Xuesong Li

Recent Mamba-based image restoration methods have achieved promising results but remain limited by fixed scanning patterns and inefficient feature utilization. Conventional Mamba architectures rely on predetermined paths that cannot adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Han Hu , Zhuoran Zheng , Liang Li , Chen Lyu

In the field of multi-source remote sensing image classification, remarkable progress has been made by using Convolutional Neural Network (CNN) and Transformer. Recently, Mamba-based methods built upon the State Space Model (SSM) have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-01-28 Feng Gao , Xuepeng Jin , Xiaowei Zhou , Junyu Dong , Qian Du

Recent advances in Vision Transformers (ViTs) and State Space Models (SSMs) have challenged the dominance of Convolutional Neural Networks (CNNs) in computer vision. ViTs excel at capturing global context, and SSMs like Mamba offer linear…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Mustafa Munir , Alex Zhang , Radu Marculescu

The accelerated MRI reconstruction poses a challenging ill-posed inverse problem due to the significant undersampling in k-space. Deep neural networks, such as CNNs and ViTs, have shown substantial performance improvements for this task…

Image and Video Processing · Electrical Eng. & Systems 2025-04-01 Yucong Meng , Zhiwei Yang , Zhijian Song , Yonghong Shi

When oncologists estimate cancer patient survival, they rely on multimodal data. Even though some multimodal deep learning methods have been proposed in the literature, the majority rely on having two or more independent networks that share…

Image and Video Processing · Electrical Eng. & Systems 2022-09-13 Numan Saeed , Ikboljon Sobirov , Roba Al Majzoub , Mohammad Yaqub

Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module. Many subquadratic-time architectures such as linear attention,…

Machine Learning · Computer Science 2024-06-03 Albert Gu , Tri Dao