English
Related papers

Related papers: EfficientVMamba: Atrous Selective Scan for Light W…

200 papers

Remote sensing image fusion aims to generate a high-resolution multi/hyper-spectral image by combining a high-resolution image with limited spectral data and a low-resolution image rich in spectral information. Current deep learning (DL)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Siran Peng , Xiangyu Zhu , Haoyu Deng , Liang-Jian Deng , Zhen Lei

State Space Model (SSM)-based machine learning architectures have recently gained significant attention for processing sequential data. Mamba, a recent sequence-to-sequence SSM, offers competitive accuracy with superior computational…

Machine Learning · Computer Science 2025-08-15 Jiyong Kim , Jaeho Lee , Jiahao Lin , Alish Kanani , Miao Sun , Umit Y. Ogras , Jaehyun Park

Mamba, a State Space Model (SSM) that accelerates training by recasting recurrence as a parallel scan, has recently emerged as a linearly-scaling alternative to self-attention. Because of its unidirectional nature, each state in Mamba only…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Jingwei Zhang , Xi Han , Hong Qin , Mahdi S. Hosseini , Dimitris Samaras

Recent advances in sequence modeling have introduced selective SSMs as promising alternatives to Transformer architectures, offering theoretical computational efficiency and sequence processing advantages. A comprehensive understanding of…

Machine Learning · Computer Science 2025-12-01 Abdullah Al Asif , Mobina Kashaniyan , Sixing Yu , Juan Pablo Muñoz , Ali Jannesari

Image shadow removal is a typical low-level vision task. Shadows cause local brightness shifts, which reduce the performance of downstream vision tasks. Currently, Transformer-based shadow removal methods suffer from quadratic computational…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Xiujin Zhu , Chee-Onn Chow , Joon Huang Chuah

The goal of style transfer is, given a content image and a style source, generating a new image preserving the content but with the artistic representation of the style source. Most of the state-of-the-art architectures use transformers or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Filippo Botti , Alex Ergasti , Leonardo Rossi , Tomaso Fontanini , Claudio Ferrari , Massimo Bertozzi , Andrea Prati

Food classification is the foundation for developing food vision tasks and plays a key role in the burgeoning field of computational nutrition. Due to the complexity of food requiring fine-grained classification, recent academic research…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Chi-Sheng Chen , Guan-Ying Chen , Dong Zhou , Di Jiang , Dai-Shi Chen

In recent years, visually-rich document understanding has attracted increasing attention. Transformer-based pre-trained models have become the mainstream approach, yielding significant performance gains in this field. However, the…

Computation and Language · Computer Science 2025-02-11 Pengfei Hu , Zhenrong Zhang , Jiefeng Ma , Shuhang Liu , Jun Du , Jianshu Zhang

Mamba is emerging as a novel approach to overcome the challenges faced by Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) in computer vision. While CNNs excel at extracting local features, they often struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Md Maklachur Rahman , Abdullah Aman Tutul , Ankur Nath , Lamyanba Laishram , Soon Ki Jung , Tracy Hammond

State Space Models (SSMs), particularly the Mamba architecture, have recently emerged as powerful alternatives to Transformers for sequence modeling, offering linear computational complexity while achieving competitive performance. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Mohamed A. Mabrok , Yalda Zafari

State Space Model (SSM) is a mathematical model used to describe and analyze the behavior of dynamic systems. This model has witnessed numerous applications in several fields, including control theory, signal processing, economics and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Xiao Liu , Chenxu Zhang , Lei Zhang

In the field of medical image segmentation, models based on both CNN and Transformer have been thoroughly investigated. However, CNNs have limited modeling capabilities for long-range dependencies, making it challenging to exploit the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Mingya Zhang , Yue Yu , Limei Gu , Tingsheng Lin , Xianping Tao

In image fusion tasks, images from different sources possess distinct characteristics. This has driven the development of numerous methods to explore better ways of fusing them while preserving their respective characteristics.Mamba, as a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Zihan Cao , Xiao Wu , Liang-Jian Deng , Yu Zhong

Recently, State Space Models (SSMs), with Mamba as a prime example, have shown great promise for long-range dependency modeling with linear complexity. Then, Vision Mamba and the subsequent architectures are presented successively, and they…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Zhongping Ji

Transformers and Mamba, initially invented for natural language processing, have inspired backbone architectures for visual recognition. Recent studies integrated Local Attention Transformers with Mamba to capture both local details and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Meng Lou , Yunxiang Fu , Yizhou Yu

UNet and its variants have been widely used in medical image segmentation. However, these models, especially those based on Transformer architectures, pose challenges due to their large number of parameters and computational loads, making…

Image and Video Processing · Electrical Eng. & Systems 2024-03-12 Weibin Liao , Yinghao Zhu , Xinyuan Wang , Chengwei Pan , Yasha Wang , Liantao Ma

Transformer-based methods have achieved remarkable performance in event-based object detection, owing to the global modeling ability. However, they neglect the influence of non-event and noisy regions and process them uniformly, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Nan Yang , Yang Wang , Zhanwen Liu , Meng Li , Yisheng An , Xiangmo Zhao

Transformers bring significantly improved performance to the light field image super-resolution task due to their long-range dependency modeling capability. However, the inherently high computational complexity of their core self-attention…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Zeqiang Wei , Kai Jin , Zeyi Hou , Kuan Song , Xiuzhuang Zhou

The computational assessment of facial attractiveness, a challenging subjective regression task, is dominated by architectures with a critical trade-off: Convolutional Neural Networks (CNNs) offer efficiency but have limited receptive…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Djamel Eddine Boukhari

State Space Models (SSMs) have emerged as efficient alternatives to attention for vision tasks, offering lineartime sequence processing with competitive accuracy. Vision SSMs, however, require serializing 2D images into 1D token sequences…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Yi-Kuan Hsieh , Jun-Wei Hsieh , Xin li , Ming-Ching Chang , Yu-Chee Tseng