English
Related papers

Related papers: SP-MoMamba: Superpixel-driven Mixture of State Spa…

200 papers

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance across a wide range of multimodal tasks. However, fine-tuning these models for domain-specific applications remains a computationally intensive challenge. This…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Chee Ng , Yuen Fung

In image fusion tasks, images from different sources possess distinct characteristics. This has driven the development of numerous methods to explore better ways of fusing them while preserving their respective characteristics.Mamba, as a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Zihan Cao , Xiao Wu , Liang-Jian Deng , Yu Zhong

Recent advances in Vision Transformers (ViTs) and State Space Models (SSMs) have challenged the dominance of Convolutional Neural Networks (CNNs) in computer vision. ViTs excel at capturing global context, and SSMs like Mamba offer linear…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Mustafa Munir , Alex Zhang , Radu Marculescu

Deep learning has profoundly transformed remote sensing, yet prevailing architectures like Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) remain constrained by critical trade-offs: CNNs suffer from limited receptive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Muyi Bao , Shuchang Lyu , Zhaoyang Xu , Huiyu Zhou , Jinchang Ren , Shiming Xiang , Xiangtai Li , Guangliang Cheng

Recent years have seen significant advancements in image restoration, largely attributed to the development of modern deep neural networks, such as CNNs and Transformers. However, existing restoration backbones often face the dilemma…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Hang Guo , Jinmin Li , Tao Dai , Zhihao Ouyang , Xudong Ren , Shu-Tao Xia

Semantic segmentation, as a basic tool for intelligent interpretation of remote sensing images, plays a vital role in many Earth Observation (EO) applications. Nowadays, accurate semantic segmentation of remote sensing images remains a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Libo Wang , Dongxu Li , Sijun Dong , Xiaoliang Meng , Xiaokang Zhang , Danfeng Hong

Multi-Modal Image Fusion (MMIF) aims to integrate complementary image information from different modalities to produce informative images. Previous deep learning-based MMIF methods generally adopt Convolutional Neural Networks (CNNs) or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hui Sun , Long Lv , Pingping Zhang , Tongdan Tang , Feng Tian , Weibing Sun , Huchuan Lu

Radar-camera depth estimation must turn an ultra-sparse, all-weather, metric radar signal into a dense per-pixel depth map. Existing methods -- concatenation, confidence-aware gating, sparse supervision, graph-based extraction -- combine…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Zhangcheng Hou , Tomoaki Ohtsuki

Accurate medical image segmentation requires effective modeling of both global anatomical structures and fine-grained boundary details. Recent state space models (e.g., Vision Mamba) offer efficient long-range dependency modeling. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Fuhao Zhang , Lei Liu , Jialin Zhang , Ya-Nan Zhang , Nan Mu

Accurate 3D medical image segmentation demands architectures capable of reconciling global context modeling with spatial topology preservation. While State Space Models (SSMs) like Mamba show potential for sequence modeling, existing…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Hangyu Ji

In recent years, State Space Models (SSMs) with efficient hardware-aware designs, known as the Mamba deep learning models, have made significant progress in modeling long sequences such as language understanding. Therefore, building…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Juntao Zhang , Shaogeng Liu , Jun Zhou , Kun Bian , You Zhou , Jianning Liu , Pei Zhang , Bingyan Liu

Nuclei panoptic segmentation supports cancer diagnostics by integrating both semantic and instance segmentation of different cell types to analyze overall tissue structure and individual nuclei in histopathology images. Major challenges…

Image and Video Processing · Electrical Eng. & Systems 2026-01-26 Ming Kang , Fung Fung Ting , Raphaël C. -W. Phan , Zongyuan Ge , Chee-Ming Ting

The Mamba architecture has been widely applied to various low-level vision tasks due to its exceptional adaptability and strong performance. Although the Mamba architecture has been adopted for spectral reconstruction, it still faces the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Yuze Zhang , Lingjie Li , Qiuzhen Lin , Zhong Ming , Fei Yu , Victor C. M. Leung

Many real-world computer vision tasks, such as depth completion, must handle inputs with arbitrarily shaped regions of missing or invalid data. For Convolutional Neural Networks (CNNs), Partial Convolutions solved this by a mask-aware…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Ignasi Mas , Ramon Morros , Javier-Ruiz Hidalgo , Ivan Huerta

In the realm of medical image segmentation, both CNN-based and Transformer-based models have been extensively explored. However, CNNs exhibit limitations in long-range modeling capabilities, whereas Transformers are hampered by their…

Image and Video Processing · Electrical Eng. & Systems 2024-11-11 Jiacheng Ruan , Jincheng Li , Suncheng Xiang

While Transformers have been the main architecture behind deep learning's success in language modeling, state-space models (SSMs) such as Mamba have recently been shown to match or outperform Transformers at small to medium scale. We show…

Machine Learning · Computer Science 2024-06-03 Tri Dao , Albert Gu

Recently, state space model (SSM) has gained great attention due to its promising performance, linear complexity, and long sequence modeling ability in both language and image domains. However, it is non-trivial to extend SSM to the point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Jiuming Liu , Ruiji Yu , Yian Wang , Yu Zheng , Tianchen Deng , Weicai Ye , Hesheng Wang

Pan-sharpening aims to generate high-resolution multispectral (HRMS) images by integrating a high-resolution panchromatic (PAN) image with its corresponding low-resolution multispectral (MS) image. To achieve effective fusion, it is crucial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Yingying Wang , Xuanhua He , Chen Wu , Jialing Huang , Suiyun Zhang , Rui Liu , Xinghao Ding , Haoxuan Che

State-space language models such as Mamba match Transformer quality while permitting linear complexity inference, yet still comprise billions of parameters that hinder deployment. Existing one-shot pruning methods are tailored to attention…

Machine Learning · Computer Science 2025-06-12 Kaiwen Tuo , Huan Wang

Transformers have revolutionized deep learning across various tasks, including audio representation learning, due to their powerful modeling capabilities. However, they often suffer from quadratic complexity in both GPU memory usage and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-06 Siavash Shams , Sukru Samet Dindar , Xilin Jiang , Nima Mesgarani