English
Related papers

Related papers: Scalable Visual State Space Model with Fractal Sca…

200 papers

Learned Image Compression (LIC) has explored various architectures, such as Convolutional Neural Networks (CNNs) and transformers, in modeling image content distributions in order to achieve compression effectiveness. However, achieving…

Image and Video Processing · Electrical Eng. & Systems 2025-02-10 Zhuojie Wu , Heming Du , Shuyun Wang , Ming Lu , Haiyang Sun , Yandong Guo , Xin Yu

Despite their frequent use for change detection, both ConvNets and Vision transformers (ViT) exhibit well-known limitations, namely the former struggle to model long-range dependencies while the latter are computationally inefficient,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Elman Ghazaei , Erchan Aptoula

Image super-resolution (SR) is a critical technology for overcoming the inherent hardware limitations of sensors. However, existing approaches mainly focus on directly enhancing the final resolution, often neglecting effective control over…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Chenyu Li , Danfeng Hong , Bing Zhang , Zhaojie Pan , Naoto Yokoya , Jocelyn Chanussot

Transformers dominate NLP and IR; but their inference inefficiencies and challenges in extrapolating to longer contexts have sparked interest in alternative model architectures. Among these, state space models (SSMs) like Mamba offer…

Computation and Language · Computer Science 2025-04-23 Zhichao Xu , Jinghua Yan , Ashim Gupta , Vivek Srikumar

Although Mamba models significantly improve hyperspectral image (HSI) classification, one critical challenge is the difficulty in building the sequence of Mamba tokens efficiently. This paper presents a Sparse Deformable Mamba (SDMamba)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Lincoln Linlin Xu , Yimin Zhu , Zack Dewis , Zhengsen Xu , Motasem Alkayid , Mabel Heffring , Saeid Taleghanidoozdoozan

State Space Models (SSMs) have become serious contenders in the field of sequential modeling, challenging the dominance of Transformers. At the same time, Mixture of Experts (MoE) has significantly improved Transformer-based Large Language…

Despite the progress made in Mamba-based medical image segmentation models, existing methods utilizing unidirectional or multi-directional feature scanning mechanisms struggle to effectively capture dependencies between neighboring…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Chao Fan , Hongyuan Yu , Yan Huang , Liang Wang , Zhenghan Yang , Xibin Jia

Semantic Change Detection (SCD) from remote sensing imagery requires models balancing extensive spatial context, computational efficiency, and sensitivity to class-imbalanced land-cover transitions. While Convolutional Neural Networks excel…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Buddhi Wijenayake , Athulya Ratnayake , Praveen Sumanasekara , Roshan Godaliyadda , Parakrama Ekanayake , Vijitha Herath , Nichula Wasalathilaka

Recent advancements have highlighted the Mamba framework, a state-space model known for its efficiency in capturing long-range dependencies with linear computational complexity. While Mamba has shown competitive performance in medical image…

Image and Video Processing · Electrical Eng. & Systems 2025-02-05 Weiren Zhao , Feng Wang , Yanran Wang , Yutong Xie , Qi Wu , Yuyin Zhou

State space models (SSMs) reduce the quadratic complexity of transformers by leveraging linear recurrence. Recently, VMamba has emerged as a strong SSM-based vision backbone, yet remains bottlenecked by spatial redundancy in its…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Tien-Yu Chi , Hung-Yueh Chiang , Diana Marculescu , Kai-Chiang Wu

State Space Models (SSMs) have emerged as a compelling alternative to attention models for long-range vision tasks, offering input-dependent recurrence with linear complexity. However, most efficient SSM variants reduce computation cost by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Sara Shoouri , Morteza Tavakoli Taba , Hun-Seok Kim

Convolutional neural networks (CNN) and Transformers have made impressive progress in the field of remote sensing change detection (CD). However, both architectures have inherent shortcomings: CNN are constrained by a limited receptive…

Image and Video Processing · Electrical Eng. & Systems 2024-12-31 Hongruixuan Chen , Jian Song , Chengxi Han , Junshi Xia , Naoto Yokoya

The goal of style transfer is, given a content image and a style source, generating a new image preserving the content but with the artistic representation of the style source. Most of the state-of-the-art architectures use transformers or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Filippo Botti , Alex Ergasti , Leonardo Rossi , Tomaso Fontanini , Claudio Ferrari , Massimo Bertozzi , Andrea Prati

Accurate segmentation of 3D medical images such as MRI and CT is essential for clinical diagnosis and treatment planning. Foundation models like the Segment Anything Model (SAM) provide powerful general-purpose representations but struggle…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Mohammadreza Gholipour Shahraki , Mehdi Rezaeian , Mohammad Ghasemzadeh

Accurate segmentation of 3D clinical medical images is critical in the diagnosis and treatment of spinal diseases. However, the inherent complexity of spinal anatomy and uncertainty inherent in current imaging technologies, poses…

Image and Video Processing · Electrical Eng. & Systems 2024-08-29 Zhiqing Zhang , Tianyong Liu , Guojia Fan , Bin Li , Qianjin Feng , Shoujun Zhou

Mamba has garnered widespread attention due to its flexible design and efficient hardware performance to process 1D sequences based on the state space model (SSM). Recent studies have attempted to apply Mamba to the visual domain by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Chengkun Wang , Wenzhao Zheng , Yuanhui Huang , Jie Zhou , Jiwen Lu

Recently, deep learning models have achieved excellent performance in hyperspectral image (HSI) classification. Among the many deep models, Transformer has gradually attracted interest for its excellence in modeling the long-range…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Lingbo Huang , Yushi Chen , Xin He

Medical time series are central to healthcare, enabling continuous monitoring and supporting timely clinical decisions. Despite recent progress, existing methods struggle to jointly model local-global dynamics and handle nonstationarities…

Machine Learning · Computer Science 2026-05-26 Da Zhang , Bingyu Li , Zhiyuan Zhao , Hongyuan Zhang , Junyu Gao , Xuelong Li

Multimodal image fusion aims to integrate information from different imaging techniques to produce a comprehensive, detail-rich single image for downstream vision tasks. Existing methods based on local convolutional neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xinyu Xie , Yawen Cui , Tao Tan , Xubin Zheng , Zitong Yu

State-space models (SSMs), particularly the Mamba architecture, have emerged as powerful alternatives to Transformers for sequence modeling, offering linear-time complexity and competitive performance across diverse tasks. However, their…

Machine Learning · Computer Science 2025-09-30 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma