English
Related papers

Related papers: Core-Periphery Principle Guided State Space Model …

200 papers

Previous research on lightweight models has primarily focused on CNNs and Transformer-based designs. CNNs, with their local receptive fields, struggle to capture long-range dependencies, while Transformers, despite their global modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Haoyang He , Jiangning Zhang , Yuxuan Cai , Hongxu Chen , Xiaobin Hu , Zhenye Gan , Yabiao Wang , Chengjie Wang , Yunsheng Wu , Lei Xie

Mamba, based on state space model (SSM) with its linear complexity and great success in classification provide its superiority in 3D point cloud analysis. Prior to that, Transformer has emerged as one of the most prominent and successful…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jia-wei Chen , Yu-jie Xiong , Yong-bin Gao

The computational assessment of facial attractiveness, a challenging subjective regression task, is dominated by architectures with a critical trade-off: Convolutional Neural Networks (CNNs) offer efficiency but have limited receptive…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Djamel Eddine Boukhari

State space models (SSMs) have emerged as an efficient alternative to Transformer models for language modeling, offering linear computational complexity and constant memory usage as context length increases. However, despite their…

Computation and Language · Computer Science 2025-04-23 Zhifan Ye , Kejing Xia , Yonggan Fu , Xin Dong , Jihoon Hong , Xiangchi Yuan , Shizhe Diao , Jan Kautz , Pavlo Molchanov , Yingyan Celine Lin

Mamba, a State Space Model (SSM) that accelerates training by recasting recurrence as a parallel scan, has recently emerged as a linearly-scaling alternative to self-attention. Because of its unidirectional nature, each state in Mamba only…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Jingwei Zhang , Xi Han , Hong Qin , Mahdi S. Hosseini , Dimitris Samaras

Mamba is an efficient State Space Model (SSM) with linear computational complexity. Although SSMs are not suitable for handling non-causal data, Vision Mamba (ViM) methods still demonstrate good performance in tasks such as image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Juntao Zhang , Shaogeng Liu , Kun Bian , You Zhou , Pei Zhang , Jianning Liu , Jun Zhou , Bingyan Liu

Semantic segmentation of remote sensing imagery is a fundamental task in computer vision, supporting a wide range of applications such as land use classification, urban planning, and environmental monitoring. However, this task is often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Qinfeng Zhu , Han Li , Liang He , Lei Fan

We tackle classification based on brain connectivity derived from diffusion magnetic resonance images. We propose a machine-learning model inspired by graph convolutional networks (GCNs), which takes a brain connectivity input graph and…

Neurons and Cognition · Quantitative Biology 2023-09-21 Anees Kazi , Jocelyn Mora , Bruce Fischl , Adrian V. Dalca , Iman Aganj

State-space models (SSMs) have recently attention as an efficient alternative to computationally expensive attention-based models for sequence modeling. They rely on linear recurrences to integrate information over time, enabling fast…

Machine Learning · Computer Science 2026-01-01 Mahdi Karami , Ali Behrouz , Peilin Zhong , Razvan Pascanu , Vahab Mirrokni

Point cloud registration (PCR) is a fundamental task in 3D computer vision and robotics. Most learning-based PCR methods rely on Transformer architectures, which suffer from quadratic computational complexity. This limitation restricts the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Bingxi Liu , An Liu , Hao Chen , Huaqi Tao , Jinqiang Cui , Yiqun Wang , Hong Zhang

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu

Mamba, a special case of the State Space Model, is gaining popularity as an alternative to template-based deep learning approaches in medical image analysis. While transformers are powerful architectures, they have drawbacks, including…

Physical field reconstruction (PFR) aims to predict the state distribution of physical quantities (e.g., velocity, pressure, and temperature) based on limited sensor measurements. It plays a critical role in domains such as fluid dynamics…

Machine Learning · Computer Science 2025-05-23 Jiahuan Long , Wenzhe Zhang , Ning Wang , Tingsong Jiang , Wen Yao

Accurate detection of cardiac abnormalities from electrocardiogram recordings is regarded as essential for clinical diagnostics and decision support. Traditional deep learning models such as residual networks and transformer architectures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Huawei Jiang , Husna Mutahira , Gan Huang , Mannan Saeed Muhammad

Deep learning has profoundly transformed remote sensing, yet prevailing architectures like Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) remain constrained by critical trade-offs: CNNs suffer from limited receptive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Muyi Bao , Shuchang Lyu , Zhaoyang Xu , Huiyu Zhou , Jinchang Ren , Shiming Xiang , Xiangtai Li , Guangliang Cheng

Perceptual image compression focuses on preserving high visual quality under low-bitrate constraints. Most existing approaches to perceptual compression leverage the strong generative capabilities of generative adversarial networks or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jiaqian Zhang , Hao Wei , Chenyang Ge , Yanhui Zhou

We introduce CausalMamba, a scalable framework that addresses fundamental limitations in fMRI-based causal inference: the ill-posed nature of inferring neural causality from hemodynamically distorted BOLD signals and the computational…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Sangyoon Bae , Jiook Cha

We introduce a novel state-space model (SSM)-based framework for skeleton-based human action recognition, with an anatomically-guided architecture that improves state-of-the-art performance in both clinical diagnostics and general action…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Niki Martinel , Mariano Serrao , Christian Micheloni

State space models (SSMs), particularly Mamba, have shown promise in NLP tasks and are increasingly applied to vision tasks. However, most Mamba-based vision models focus on network architecture and scan paths, with little attention to the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Yujie Zhu , Xinyi Zhang , Yekai Lu , Guang Yang , Faming Fang , Guixu Zhang

Traffic flow prediction, a critical aspect of intelligent transportation systems, has been increasingly popular in the field of artificial intelligence, driven by the availability of extensive traffic data. The current challenges of traffic…

Machine Learning · Computer Science 2024-05-21 Zhiqi Shao , Michael G. H. Bell , Ze Wang , D. Glenn Geers , Haoning Xi , Junbin Gao