English
Related papers

Related papers: VideoMamba: State Space Model for Efficient Video …

200 papers

Training urban spatio-temporal foundation models that generalize well across diverse regions and cities is critical for deploying urban services in unseen or data-scarce regions. Recent studies have typically focused on fusing cross-domain…

Machine Learning · Computer Science 2026-02-04 Rui An , Yifeng Zhang , Ziran Liang , Wenqi Fan , Yuxuan Liang , Xuequn Shang , Qing Li

In the field of medical image segmentation, models based on both CNN and Transformer have been thoroughly investigated. However, CNNs have limited modeling capabilities for long-range dependencies, making it challenging to exploit the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Mingya Zhang , Yue Yu , Limei Gu , Tingsheng Lin , Xianping Tao

Sequence modeling plays a vital role across various domains, with recurrent neural networks being historically the predominant method of performing these tasks. However, the emergence of transformers has altered this paradigm due to their…

In the field of self-supervised depth estimation, Convolutional Neural Networks (CNNs) and Transformers have traditionally been dominant. However, both architectures struggle with efficiently handling long-range dependencies due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Ionuţ Grigore , Călin-Adrian Popa

Dynamic graph embedding has emerged as an important technique for modeling complex time-evolving networks across diverse domains. While transformer-based models have shown promise in capturing long-range dependencies in temporal graph data,…

Machine Learning · Computer Science 2025-05-13 Ashish Parmanand Pandey , Alan John Varghese , Sarang Patil , Mengjia Xu

The attention mechanism has become a dominant operator in point cloud learning, but its quadratic complexity leads to limited inter-point interactions, hindering long-range dependency modeling between objects. Due to excellent long-range…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Kanglin Qu , Pan Gao , Qun Dai , Yuanhao Sun

Remote sensing images are frequently obscured by cloud cover, posing significant challenges to data integrity and reliability. Effective cloud detection requires addressing both short-range spatial redundancies and long-range atmospheric…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Tianxiang Xue , Jiayi Zhao , Jingsheng Li , Changlu Chen , Kun Zhan

Transformers bring significantly improved performance to the light field image super-resolution task due to their long-range dependency modeling capability. However, the inherently high computational complexity of their core self-attention…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Zeqiang Wei , Kai Jin , Zeyi Hou , Kuan Song , Xiuzhuang Zhou

The realm of Mamba for vision has been advanced in recent years to strike for the alternatives of Vision Transformers (ViTs) that suffer from the quadratic complexity. While the recurrent scanning mechanism of Mamba offers computational…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Masakazu Yoshimura , Teruaki Hayashi , Yuki Hoshino , Wei-Yao Wang , Takeshi Ohashi

Current automatic speech recognition systems struggle with modeling long speech sequences due to high quadratic complexity of Transformer-based models. Selective state space models such as Mamba has performed well on long-sequence modeling…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-30 Xiaoxue Gao , Nancy F. Chen

The quadratic complexity of the attention mechanism in Transformer models has motivated the development of alternative architectures with sub-quadratic scaling, such as state-space models. Among these, Mamba has emerged as a leading…

Machine Learning · Computer Science 2025-12-16 Peng Lu , Jerry Huang , Qiuhao Zeng , Xinyu Wang , Boxing Chen , Philippe Langlais , Yufei Cui

Long-form video understanding has always been a challenging problem due to the significant redundancy in both temporal and spatial contents. This challenge is further exacerbated by the limited context length of Multimodal Large Language…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Ruyang Liu , Shangkun Sun , Haoran Tang , Ge Li , Wei Gao

Balancing fine-grained local modeling with long-range dependency capture under computational constraints remains a central challenge in sequence modeling. While Transformers provide strong token mixing, they suffer from quadratic…

Machine Learning · Computer Science 2026-03-20 Youjin Wang , Jiaqiao Zhao , Rong Fu , Run Zhou , Ruizhe Zhang , Jiani Liang , Suisuai Cao , Feng Zhou

Mamba has recently gained widespread attention as a backbone model for point cloud modeling, leveraging a state-space architecture that enables efficient global sequence modeling with linear complexity. However, its lack of local inductive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Xuanyu Lin , Xiaona Zeng , Xianwei Zheng , Xutao Li

Transformer-based methods have demonstrated remarkable capabilities in 3D semantic segmentation through their powerful attention mechanisms, but the quadratic complexity limits their modeling of long-range dependencies in large-scale point…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Xinyu Wang , Jinghua Hou , Zhe Liu , Yingying Zhu

Multi-task dense scene understanding, which learns a model for multiple dense prediction tasks, has a wide range of application scenarios. Modeling long-range dependency and enhancing cross-task interactions are crucial to multi-task dense…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Baijiong Lin , Weisen Jiang , Pengguang Chen , Yu Zhang , Shu Liu , Ying-Cong Chen

The goal of style transfer is, given a content image and a style source, generating a new image preserving the content but with the artistic representation of the style source. Most of the state-of-the-art architectures use transformers or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Filippo Botti , Alex Ergasti , Leonardo Rossi , Tomaso Fontanini , Claudio Ferrari , Massimo Bertozzi , Andrea Prati

Mamba is an efficient State Space Model (SSM) with linear computational complexity. Although SSMs are not suitable for handling non-causal data, Vision Mamba (ViM) methods still demonstrate good performance in tasks such as image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Juntao Zhang , Shaogeng Liu , Kun Bian , You Zhou , Pei Zhang , Jianning Liu , Jun Zhou , Bingyan Liu

Recently, state space models have exhibited strong global modeling capabilities and linear computational complexity in contrast to transformers. This research focuses on applying such architecture to more efficiently and effectively model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Tao Zhang , Haobo Yuan , Lu Qi , Jiangning Zhang , Qianyu Zhou , Shunping Ji , Shuicheng Yan , Xiangtai Li

In recent advancements in medical image analysis, Convolutional Neural Networks (CNN) and Vision Transformers (ViT) have set significant benchmarks. While the former excels in capturing local features through its convolution operations, the…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Ziyang Wang , Jian-Qing Zheng , Yichi Zhang , Ge Cui , Lei Li