English
Related papers

Related papers: SSM-RDU: A Reconfigurable Dataflow Unit for Long-S…

200 papers

Transformer models have achieved superior performance in various natural language processing tasks. However, the quadratic computational cost of the attention mechanism limits its practicality for long sequences. There are existing…

Computation and Language · Computer Science 2022-12-19 Simiao Zuo , Xiaodong Liu , Jian Jiao , Denis Charles , Eren Manavoglu , Tuo Zhao , Jianfeng Gao

Integrating components from convolutional neural networks and state space models in medical image segmentation presents a compelling approach to enhance accuracy and efficiency. We introduce Mamba HUNet, a novel architecture tailored for…

Image and Video Processing · Electrical Eng. & Systems 2024-08-31 Kazi Shahriar Sanjid , Md. Tanzim Hossain , Md. Shakib Shahariar Junayed , Mohammad Monir Uddin

State space models (SSMs) have recently garnered significant attention in computer vision. However, due to the unique characteristics of image data, adapting SSMs from natural language processing to computer vision has not outperformed the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Tanzhe Li , Caoshuo Li , Jiayi Lyu , Hongjuan Pei , Baochang Zhang , Taisong Jin , Rongrong Ji

Recent advancements in State Space Models (SSMs) have attracted significant interest, particularly in models optimized for parallel training and handling long-range dependencies. Architectures like Mamba have scaled to billions of…

Machine Learning · Computer Science 2024-10-22 Zheng Zhan , Yushu Wu , Zhenglun Kong , Changdi Yang , Yifan Gong , Xuan Shen , Xue Lin , Pu Zhao , Yanzhi Wang

Graph Neural Networks (GNNs) have shown promising potential in graph representation learning. The majority of GNNs define a local message-passing mechanism, propagating information over the graph by stacking multiple layers. These methods,…

Machine Learning · Computer Science 2024-02-20 Ali Behrouz , Farnoosh Hashemi

State-space models (SSMs) have emerged as an efficient strategy for building powerful language models, avoiding the quadratic complexity of computing attention in transformers. Despite their promise, the interpretability and steerability of…

Machine Learning · Computer Science 2026-05-22 Vamshi Sunku Mohan , Kaustubh Gupta , Aneesha Das , Chandan Singh

State-space models (SSMs) have recently demonstrated competitive performance to transformers at large-scale language modeling benchmarks while achieving linear time and memory complexity as a function of sequence length. Mamba, a recently…

Computation and Language · Computer Science 2024-02-06 Quentin Anthony , Yury Tokpanov , Paolo Glorioso , Beren Millidge

Recent advances in deep learning for vision tasks have seen the rise of State Space Models (SSMs) like Mamba, celebrated for their linear scalability. However, their adaptation to 2D visual data often necessitates complex modifications that…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Minjong Cheon , Changbae Mun

Accurate medical image segmentation requires effective modeling of both global anatomical structures and fine-grained boundary details. Recent state space models (e.g., Vision Mamba) offer efficient long-range dependency modeling. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Fuhao Zhang , Lei Liu , Jialin Zhang , Ya-Nan Zhang , Nan Mu

Recently, the Mamba architecture based on state space models has demonstrated remarkable performance in a series of natural language processing tasks and has been rapidly applied to remote sensing change detection (CD) tasks. However, most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Haotian Zhang , Keyan Chen , Chenyang Liu , Hao Chen , Zhengxia Zou , Zhenwei Shi

To cope with the increasing demand and computational intensity of deep neural networks (DNNs), industry and academia have turned to accelerator technologies. In particular, FPGAs have been shown to provide a good balance between performance…

Hardware Architecture · Computer Science 2018-07-12 Yongming Shen , Tianchu Ji , Michael Ferdman , Peter Milder

Recent advancements in diffusion models have significantly improved symbolic music generation. However, most approaches rely on transformer-based architectures with self-attention mechanisms, which are constrained by quadratic computational…

Sound · Computer Science 2026-03-04 Shenghua Yuan , Xing Tang , Jiatao Chen , Tianming Xie , Jing Wang , Bing Shi

State space models (SSMs) have emerged as an efficient alternative to Transformer models for language modeling, offering linear computational complexity and constant memory usage as context length increases. However, despite their…

Computation and Language · Computer Science 2025-04-23 Zhifan Ye , Kejing Xia , Yonggan Fu , Xin Dong , Jihoon Hong , Xiangchi Yuan , Shizhe Diao , Jan Kautz , Pavlo Molchanov , Yingyan Celine Lin

Transformers have become increasingly popular for image super-resolution (SR) tasks due to their strong global context modeling capabilities. However, their quadratic computational complexity necessitates the use of window-based attention…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Aman Urumbekov , Zheng Chen

We propose a modular framework for hybrid image restoration that integrates transformer and state-space model (SSM) blocks with a focus on improving runtime efficiency on edge hardware. While transformers provide strong global modeling…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Srinivas Soumitri Miriyala , Sowmya Vajrala , Sravanth Kodavanti , Vikram Nelvoy Rajendiran , Sharan Kumar Allur

Accurate medical image segmentation remains challenging due to blurred lesion boundaries (LBA), loss of high-frequency details (LHD), and difficulty in modeling long-range anatomical structures (DC-LRSS). Vision Mamba employs…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Ze Rong , ZiYue Zhao , Zhaoxin Wang , Lei Ma

Hyperspectral image (HSI) classification faces challenges such as high-dimensional data, limited training samples, and spectral redundancy, which often lead to overfitting and insufficient generalization capability. This paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Guandong Li , Mengxia Ye

State Space Models (SSMs) have become serious contenders in the field of sequential modeling, challenging the dominance of Transformers. At the same time, Mixture of Experts (MoE) has significantly improved Transformer-based Large Language…

Vision transformers have significantly advanced the field of computer vision, offering robust modeling capabilities and global receptive field. However, their high computational demands limit their applicability in processing long…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Yuheng Shi , Minjing Dong , Mingjia Li , Chang Xu

Spatial dataflow architectures such as reconfigurable dataflow accelerators (RDA) can provide much higher performance and efficiency than CPUs and GPUs. In particular, vectorized reconfigurable dataflow accelerators (vRDA) in recent…

Hardware Architecture · Computer Science 2024-02-01 Alexander Rucker , Shiv Sundram , Coleman Smith , Matthew Vilim , Raghu Prabhakar , Fredrik Kjolstad , Kunle Olukotun