English
Related papers

Related papers: VP-Hype: A Hybrid Mamba-Transformer Framework with…

200 papers

The effectiveness and efficiency of modeling complex spectral-spatial relations are both crucial for Hyperspectral image (HSI) classification. Most existing methods based on CNNs and transformers still suffer from heavy computational…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Jiamu Sheng , Jingyi Zhou , Jiong Wang , Peng Ye , Jiayuan Fan

Efficient extraction of spectral sequences and geospatial information has always been a hot topic in hyperspectral image classification. In terms of spectral sequence feature capture, RNN and Transformer have become mainstream…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Aitao Yang , Min Li , Yao Ding , Leyuan Fang , Yaoming Cai , Yujie He

Classifying hyperspectral images is a difficult task in remote sensing, due to their complex high-dimensional data. To address this challenge, we propose HSIMamba, a novel framework that uses bidirectional reversed convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Judy X Yang , Jun Zhou , Jing Wang , Hui Tian , Alan Wee Chung Liew

Transformers have become increasingly popular for image super-resolution (SR) tasks due to their strong global context modeling capabilities. However, their quadratic computational complexity necessitates the use of window-based attention…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Aman Urumbekov , Zheng Chen

Transformer-based methods have demonstrated remarkable capabilities in 3D semantic segmentation through their powerful attention mechanisms, but the quadratic complexity limits their modeling of long-range dependencies in large-scale point…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Xinyu Wang , Jinghua Hou , Zhe Liu , Yingying Zhu

The rapid advances in deep learning have significantly enhanced the accuracy of multimodal 3D human pose estimation (HPE). However, the state-of-the-art (SOTA) HPE pipelines still rely on Transformers, whose quadratic complexity makes…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Zepeng Yang , Junxuan Bai , Hao Li , Ju Dai , Junjun Pan , Yongfeng Yin , Bin Li

Capturing long-range dependencies while preserving high-resolution visual representations is crucial for dense prediction tasks such as human pose estimation. Vision Transformers (ViTs) have advanced global modeling through self-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Hao Zhang , Yongqiang Ma , Wenqi Shao , Ping Luo , Nanning Zheng , Kaipeng Zhang

Transformers are the cornerstone of modern large language models, but their quadratic computational complexity limits efficiency in long-sequence processing. Recent advancements in Mamba, a state space model (SSM) with linear complexity,…

Machine Learning · Computer Science 2026-01-08 Yixing Li , Ruobing Xie , Zhen Yang , Xingwu Sun , Shuaipeng Li , Weidong Han , Zhanhui Kang , Yu Cheng , Chengzhong Xu , Di Wang , Jie Jiang

Accurate Autism Spectrum Disorder (ASD) diagnosis is vital for early intervention. This study presents a hybrid deep learning framework combining Vision Transformers (ViT) and Vision Mamba to detect ASD using eye-tracking data. The model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Wafaa Kasri , Yassine Himeur , Abigail Copiaco , Wathiq Mansoor , Ammar Albanna , Valsamma Eapen

Robot grasping, whether handling isolated objects, cluttered items, or stacked objects, plays a critical role in industrial and service applications. However, current visual grasp detection methods based on Convolutional Neural Networks…

Robotics · Computer Science 2025-03-11 Songsong Xiong , Hamidreza Kasaei

Efficiently modeling sequences with infinite context length has long been a challenging problem. Previous approaches have either suffered from quadratic computational complexity or limited extrapolation ability in length generalization. In…

Computation and Language · Computer Science 2025-03-03 Liliang Ren , Yang Liu , Yadong Lu , Yelong Shen , Chen Liang , Weizhu Chen

Pre-trained Vision Mamba (Vim) models have demonstrated exceptional performance across various computer vision tasks in a computationally efficient manner, attributed to their unique design of selective state space models. To further extend…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Yifeng Yao , Zichen Liu , Zhenyu Cui , Yuxin Peng , Jiahuan Zhou

State Space Models (SSM), such as Mamba, have shown strong representation ability in modeling long-range dependency with linear complexity, achieving successful applications from high-level to low-level vision tasks. However, SSM's…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Junbo Qiao , Jincheng Liao , Wei Li , Yulun Zhang , Yong Guo , Yi Wen , Zhangxizi Qiu , Jiao Xie , Jie Hu , Shaohui Lin

Deep unfolding methods have made impressive progress in restoring 3D hyperspectral images (HSIs) from 2D measurements through convolution neural networks or Transformers in spectral compressive imaging. However, they cannot efficiently…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Jiahua Dong , Hui Yin , Hongliu Li , Wenbo Li , Yulun Zhang , Salman Khan , Fahad Shahbaz Khan

Hyperspectral Image Classification (HSC) presents significant challenges owing to the high dimensionality and intricate nature of Hyperspectral (HS) data. While traditional Machine Learning (TML) approaches have demonstrated effectiveness,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Muhammad Ahmad , Salvatore Distifano , Adil Mehmood Khan , Manuel Mazzara , Chenyu Li , Hao Li , Jagannath Aryal , Yao Ding , Gemine Vivone , Danfeng Hong

Although Mamba models significantly improve hyperspectral image (HSI) classification, one critical challenge is the difficulty in building the sequence of Mamba tokens efficiently. This paper presents a Sparse Deformable Mamba (SDMamba)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Lincoln Linlin Xu , Yimin Zhu , Zack Dewis , Zhengsen Xu , Motasem Alkayid , Mabel Heffring , Saeid Taleghanidoozdoozan

Abnormality detection in medical imaging is a critical task requiring both high efficiency and accuracy to support effective diagnosis. While convolutional neural networks (CNNs) and Transformer-based models are widely used, both face…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yao Wang , Dong Yang , Zhi Qiao , Wenjian Huang , Liuzhi Yang , Zhen Qian

As a deep learning model, Visual Mamba (VMamba) has a low computational complexity and a global receptive field, which has been successful applied to image classification and detection. To extend its applications, we apply VMamba to crowd…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Hao-Yuan Ma , Li Zhang , Shuai Shi

Transformer-based methods have achieved remarkable performance in event-based object detection, owing to the global modeling ability. However, they neglect the influence of non-event and noisy regions and process them uniformly, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Nan Yang , Yang Wang , Zhanwen Liu , Meng Li , Yisheng An , Xiangmo Zhao

Token reduction is an effective way to accelerate long-video vision-language models (VLMs), but most existing methods are designed for dense Transformers and do not directly account for hybrid architectures that interleave attention with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jindong Jiang , Amala Sanjay Deshmukh , Kateryna Chumachenko , Karan Sapra , Zhiding Yu , Guilin Liu , Andrew Tao , Pavlo Molchanov , Jan Kautz , Wonmin Byeon