English
Related papers

Related papers: Mamba-Spike: Enhancing the Mamba Architecture with…

200 papers

RGB-Event based tracking is an emerging research topic, focusing on how to effectively integrate heterogeneous multi-modal data (synchronized exposure video frames and asynchronous pulse Event stream). Existing works typically employ…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Ju Huang , Shiao Wang , Shuai Wang , Zhe Wu , Xiao Wang , Bo Jiang

Recent advancements in transformers, specifically self-attention mechanisms, have significantly improved hyperspectral image (HSI) classification. However, these models often suffer from inefficiencies, as their computational complexity…

Stock markets play an important role in the global economy, where accurate stock price predictions can lead to significant financial returns. While existing transformer-based models have outperformed long short-term memory networks and…

Computational Finance · Quantitative Finance 2025-01-14 Ali Mehrabian , Ehsan Hoseinzade , Mahdi Mazloum , Xiaohong Chen

This paper explores the application of spiking neural networks (SNNs), known for their low-power binary spikes, to bearing fault diagnosis, bridging the gap between high-performance AI algorithms and real-world industrial scenarios. In…

Neural and Evolutionary Computing · Computer Science 2025-06-17 Lin Zuo , Yongqi Ding , Mengmeng Jing , Kunshan Yang , Biao Chen , Yunqian Yu

Early exits (EEs) offer a promising approach to reducing computational costs and latency by dynamically terminating inference once a satisfactory prediction confidence on a data sample is achieved. Although many works integrate EEs into…

Computation and Language · Computer Science 2025-04-30 Miguel Nogales , Matteo Gambella , Manuel Roveri

State Space Models (SSMs), especially recent Mamba architecture, have achieved remarkable success in sequence modeling tasks. However, extending SSMs to computer vision remains challenging due to the non-sequential structure of visual data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Puskal Khadka , KC Santosh

Spiking neural networks (SNNs) promise orders-of-magnitude efficiency gains by communicating with sparse, event-driven spikes rather than dense numerical activations. However, most training pipelines either rely on surrogate-gradient…

Neural and Evolutionary Computing · Computer Science 2025-12-17 Arman Ferdowsi , Atakan Aral

We present PlainMamba: a simple non-hierarchical state space model (SSM) designed for general visual recognition. The recent Mamba model has shown how SSMs can be highly competitive with other architectures on sequential data and initial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Chenhongyi Yang , Zehui Chen , Miguel Espinosa , Linus Ericsson , Zhenyu Wang , Jiaming Liu , Elliot J. Crowley

Magnetic Resonance Fingerprinting (MRF) enables fast quantitative imaging by matching signal evolutions to a predefined dictionary. However, conventional dictionary matching suffers from exponential growth in computational cost and memory…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Tianyi Ding , Hongli Chen , Yang Gao , Zhuang Xiong , Feng Liu , Martijn A. Cloos , Hongfu Sun

Mamba-based vision models have gained extensive attention as a result of being computationally more efficient than attention-based models. However, spatial redundancy still exists in these models, represented by token and block redundancy.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Mengxuan Wu , Zekai Li , Zhiyuan Liang , Moyang Li , Xuanlei Zhao , Samir Khaki , Zheng Zhu , Xiaojiang Peng , Konstantinos N. Plataniotis , Kai Wang , Wangbo Zhao , Yang You

Spatial-Spectral Mamba (SSM) improves computational efficiency and captures long-range dependencies, addressing Transformer limitations. However, traditional Mamba models overlook rich spectral information in HSIs and struggle with high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Muhammad Ahmad , Muhammad Hassaan Farooq Butt , Muhammad Usama , Hamad Ahmed Altuwaijri , Manuel Mazzara , Salvatore Distefano

As one of the most representative DL techniques, Transformer architecture has empowered numerous advanced models, especially the large language models (LLMs) that comprise billions of parameters, becoming a cornerstone in deep learning.…

Machine Learning · Computer Science 2026-04-07 Haohao Qu , Liangbo Ning , Rui An , Wenqi Fan , Tyler Derr , Hui Liu , Xin Xu , Qing Li

Brain tumors exhibit high heterogeneity in morphology and multimodal contrast, making manual slice-by-slice de lineation time-consuming and experience-dependent, thus necessitating efficient and stable automated segmentation methods. To…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Hanjun Tao , Hua Wang , Fan Zhang

Structured State Space Models (SSMs) have emerged as a transformative paradigm in sequence modeling, addressing critical limitations of Recurrent Neural Networks (RNNs) and Transformers, namely, vanishing gradients, sequential computation…

Brain-inspired learning mechanisms, e.g. spike timing dependent plasticity (STDP), enable agile and fast on-the-fly adaptation capability in a spiking neural network. When incorporating emerging nanoscale resistive non-volatile memory (NVM)…

Neural and Evolutionary Computing · Computer Science 2020-02-19 Xinyu Wu , Vishal Saxena

Energy efficiency and low latency are crucial requirements for designing wearable AI-empowered human activity recognition systems, due to the hard constraints of battery operations and closed-loop feedback. While neural network models have…

Neural and Evolutionary Computing · Computer Science 2023-08-03 Sizhen Bian , Michele Magno

Panoptic segmentation requires the simultaneous recognition of countable thing instances and amorphous stuff regions, placing joint demands on long-range context modelling, multi-scale feature representation, and efficient dense prediction.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Qing Cheng , Damiano Bertolini , Wei Zhang , Dong Wang , Niclas Zeller , Daniel Cremers

EEG-based emotion recognition holds significant potential in the field of brain-computer interfaces. A key challenge lies in extracting discriminative spatiotemporal features from electroencephalogram (EEG) signals. Existing studies often…

Human-Computer Interaction · Computer Science 2025-12-02 Xin Zhou , Dawei Huang , Xiaojing Peng , Lijun Yin

Designing computationally efficient network architectures remains an ongoing necessity in computer vision. In this paper, we adapt Mamba, a state-space language model, into VMamba, a vision backbone with linear time complexity. At the core…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yue Liu , Yunjie Tian , Yuzhong Zhao , Hongtian Yu , Lingxi Xie , Yaowei Wang , Qixiang Ye , Jianbin Jiao , Yunfan Liu

The increasing need for compact and low-power computing solutions for machine learning applications has triggered significant interest in energy-efficient neuromorphic systems. However, most of these architectures rely on spiking neural…

Neural and Evolutionary Computing · Computer Science 2019-12-23 Manu V Nair , Giacomo Indiveri