English
Related papers

Related papers: Enhancing Mamba Decoder with Bidirectional Interac…

200 papers

State Space Models (SSMs), especially recent Mamba architecture, have achieved remarkable success in sequence modeling tasks. However, extending SSMs to computer vision remains challenging due to the non-sequential structure of visual data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Puskal Khadka , KC Santosh

Accurate and efficient multivariate time series (MTS) analysis is increasingly critical for a wide range of intelligent applications. Within this realm, Transformers have emerged as the predominant architecture due to their strong ability…

Machine Learning · Computer Science 2026-05-19 Rui An , Haohao Qu , Wenqi Fan , Xuequn Shang , Qing Li

We present the first work demonstrating that a pure Mamba block can achieve efficient Dense Global Fusion, meanwhile guaranteeing top performance for camera-LiDAR multi-modal 3D object detection. Our motivation stems from the observation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hanshi Wang , Jin Gao , Weiming Hu , Zhipeng Zhang

Hyperspectral image (HSI) classification is pivotal in the remote sensing (RS) field, particularly with the advancement of deep learning techniques. Sequential models, adapted from the natural language processing (NLP) field such as…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Weilian Zhou , Sei-Ichiro Kamata , Haipeng Wang , Man-Sing Wong , Huiying , Hou

Pan-sharpening aims to generate high-resolution multispectral (HRMS) images by integrating a high-resolution panchromatic (PAN) image with its corresponding low-resolution multispectral (MS) image. To achieve effective fusion, it is crucial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Yingying Wang , Xuanhua He , Chen Wu , Jialing Huang , Suiyun Zhang , Rui Liu , Xinghao Ding , Haoxuan Che

This paper introduces Bio-Inspired Mamba (BIM), a novel online learning framework for selective state space models that integrates biological learning principles with the Mamba architecture. BIM combines Real-Time Recurrent Learning (RTRL)…

Neural and Evolutionary Computing · Computer Science 2024-09-18 Jiahao Qin

Multimodal remote sensing object detection aims to achieve more accurate and robust perception under challenging conditions by fusing complementary information from different modalities. However, existing approaches that rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jianhong Han , Yupei Wang , Yuan Zhang , Liang Chen

Referring Image Segmentation~(RIS) leveraging transformers has achieved great success on the interpretation of complex visual-language tasks. However, the quadratic computation cost makes it resource-consuming in capturing long-range…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Yuhuan Yang , Chaofan Ma , Jiangchao Yao , Zhun Zhong , Ya Zhang , Yanfeng Wang

Multi-task learning for dense prediction has emerged as a pivotal area in computer vision, enabling simultaneous processing of diverse yet interrelated pixel-wise prediction tasks. However, the substantial computational demands of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Yuzhang Shang , Dan Xu , Gaowen Liu , Ramana Rao Kompella , Yan Yan

Recently, State Space Models (SSMs), with Mamba as a prime example, have shown great promise for long-range dependency modeling with linear complexity. Then, Vision Mamba and the subsequent architectures are presented successively, and they…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Zhongping Ji

Multimodal image fusion aims to integrate information from different imaging techniques to produce a comprehensive, detail-rich single image for downstream vision tasks. Existing methods based on local convolutional neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xinyu Xie , Yawen Cui , Tao Tan , Xubin Zheng , Zitong Yu

Burst image super-resolution (BISR) aims to enhance the resolution of a keyframe by leveraging information from multiple low-resolution images captured in quick succession. In the deep learning era, BISR methods have evolved from fully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ozan Unal , Steven Marty , Dengxin Dai

We introduce a novel state-space architecture for diffusion models, effectively harnessing spatial and frequency information to enhance the inductive bias towards local features in input images for image generation tasks. While state-space…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Hao Phung , Quan Dao , Trung Dao , Hoang Phan , Dimitris Metaxas , Anh Tran

Recent efforts on image restoration have focused on developing "all-in-one" models that can handle different degradation types and levels within single model. However, most of mainstream Transformer-based ones confronted with dilemma…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Aiwen Jiang , Hourong Chen , Zhiwen Chen , Jihua Ye , Mingwen Wang

In this work, we propose an accurate and real-time optical flow and disparity estimation model by fusing pairwise input images in the proposed non-causal selective state space for dense perception tasks. We propose a non-causal Mamba…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Tushar Anand , Advik Sinha , Abhijit Das

Multimodal medical image fusion integrates complementary information from different imaging modalities to enhance diagnostic accuracy and treatment planning. While deep learning methods have advanced performance, existing approaches face…

Image and Video Processing · Electrical Eng. & Systems 2025-08-06 Meng Zhou , Farzad Khalvati

Mamba-based models, VMamba and Vim, are a recent family of vision encoders that offer promising performance improvements in many computer vision tasks. This paper compares Mamba-based models with traditional Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Ali Nasiri-Sarvi , Mahdi S. Hosseini , Hassan Rivaz

Accurate medical image segmentation demands the integration of multi-scale information, spanning from local features to global dependencies. However, it is challenging for existing methods to model long-range global information, where…

Image and Video Processing · Electrical Eng. & Systems 2024-03-07 Jiarun Liu , Hao Yang , Hong-Yu Zhou , Yan Xi , Lequan Yu , Yizhou Yu , Yong Liang , Guangming Shi , Shaoting Zhang , Hairong Zheng , Shanshan Wang

Deep learning methods, especially Convolutional Neural Networks (CNN) and Vision Transformer (ViT), are frequently employed to perform semantic segmentation of high-resolution remotely sensed images. However, CNNs are constrained by their…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Qinfeng Zhu , Yuan Fang , Yuanzhi Cai , Cheng Chen , Lei Fan

Mamba extends earlier state space models (SSMs) by introducing input-dependent dynamics, and has demonstrated strong empirical performance across a range of domains, including language modeling, computer vision, and foundation models.…

Machine Learning · Computer Science 2025-05-15 Annan Yu , N. Benjamin Erichson