English
Related papers

Related papers: Mamba-Adaptor: State Space Model Adaptor for Visua…

200 papers

Linear State Space Models (SSMs) offer remarkable performance gains in efficient sequence modeling, with constant inference-time computation and memory complexity. Recent advances, such as Mamba, further enhance SSMs with input-dependent…

Machine Learning · Computer Science 2025-06-24 Zheng Zhan , Liliang Ren , Shuohang Wang , Liyuan Liu , Yang Liu , Yeyun Gong , Yanzhi Wang , Yelong Shen

Infrared small target detection (ISTD) is vital for long-range surveillance in military, maritime, and early warning applications. ISTD is challenged by targets occupying less than 0.15% of the image and low distinguishability from complex…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Wenhao Xu , Shuchen Zheng , Changwei Wang , Zherui Zhang , Chuan Ren , Rongtao Xu , Shibiao Xu

The computational assessment of facial attractiveness, a challenging subjective regression task, is dominated by architectures with a critical trade-off: Convolutional Neural Networks (CNNs) offer efficiency but have limited receptive…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Djamel Eddine Boukhari

Multimodal image fusion aims to integrate information from different imaging techniques to produce a comprehensive, detail-rich single image for downstream vision tasks. Existing methods based on local convolutional neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xinyu Xie , Yawen Cui , Tao Tan , Xubin Zheng , Zitong Yu

State-space models (SSMs) have recently demonstrated competitive performance to transformers at large-scale language modeling benchmarks while achieving linear time and memory complexity as a function of sequence length. Mamba, a recently…

Computation and Language · Computer Science 2024-02-06 Quentin Anthony , Yury Tokpanov , Paolo Glorioso , Beren Millidge

Voice user interfaces (VUIs) have facilitated the efficient interactions between humans and machines through spoken commands. Since real-word acoustic scenes are complex, speech enhancement plays a critical role for robust VUI. Transformer…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-12 Moran Chen , Qiquan Zhang , Mingjiang Wang , Xiangyu Zhang , Hexin Liu , Eliathamby Ambikairaiah , Deying Chen

Previous research on lightweight models has primarily focused on CNNs and Transformer-based designs. CNNs, with their local receptive fields, struggle to capture long-range dependencies, while Transformers, despite their global modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Haoyang He , Jiangning Zhang , Yuxuan Cai , Hongxu Chen , Xiaobin Hu , Zhenye Gan , Yabiao Wang , Chengjie Wang , Yunsheng Wu , Lei Xie

Recent advancements in multivariate time series forecasting have been propelled by Linear-based, Transformer-based, and Convolution-based models, with Transformer-based architectures gaining prominence for their efficacy in temporal and…

Machine Learning · Computer Science 2024-09-27 Chaolv Zeng , Zhanyu Liu , Guanjie Zheng , Linghe Kong

In the realm of time series forecasting (TSF), it is imperative for models to adeptly discern and distill hidden patterns within historical time series data to forecast future states. Transformer-based models exhibit formidable efficacy in…

Machine Learning · Computer Science 2024-04-30 Zihan Wang , Fanheng Kong , Shi Feng , Ming Wang , Xiaocui Yang , Han Zhao , Daling Wang , Yifei Zhang

Recent learned image compression (LIC) leverages Mamba-style state-space models (SSMs) for global receptive fields with linear complexity. However, the standard Mamba adopts content-agnostic, predefined raster (or multi-directional) scans…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yunuo Chen , Zezheng Lyu , Bing He , Hongwei Hu , Qi Wang , Yuan Tian , Li Song , Wenjun Zhang , Guo Lu

Micro-gesture recognition (MGR) targets the identification of subtle and fine-grained human motions and requires accurate modeling of both long-range and local spatiotemporal dependencies. While CNNs are effective at capturing local…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Deng Li , Jun Shao , Bohao Xing , Rong Gao , Bihan Wen , Heikki Kälviäinen , Xin Liu

Recent advancements in anomaly detection have seen the efficacy of CNN- and transformer-based approaches. However, CNNs struggle with long-range dependencies, while transformers are burdened by quadratic computational complexity.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Haoyang He , Yuhu Bai , Jiangning Zhang , Qingdong He , Hongxu Chen , Zhenye Gan , Chengjie Wang , Xiangtai Li , Guanzhong Tian , Lei Xie

State Space Model (SSM)-based machine learning architectures have recently gained significant attention for processing sequential data. Mamba, a recent sequence-to-sequence SSM, offers competitive accuracy with superior computational…

Machine Learning · Computer Science 2025-08-15 Jiyong Kim , Jaeho Lee , Jiahao Lin , Alish Kanani , Miao Sun , Umit Y. Ogras , Jaehyun Park

Recent Transformer-based diffusion models have shown remarkable performance, largely attributed to the ability of the self-attention mechanism to accurately capture both global and local contexts by computing all-pair interactions among…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Yunxiang Fu , Chaoqi Chen , Yizhou Yu

Efficient long-context language modeling remains a significant challenge in Natural Language Processing (NLP). While Transformers dominate language tasks, they struggle with long sequences due to quadratic computational complexity in…

Hyperspectral image (HSI) classification constitutes the fundamental research in remote sensing fields. Convolutional Neural Networks (CNNs) and Transformers have demonstrated impressive capability in capturing spectral-spatial contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Yan He , Bing Tu , Bo Liu , Jun Li , Antonio Plaza

Training deep learning models for semantic occupancy prediction is challenging due to factors such as a large number of occupancy cells, severe occlusion, limited visual cues, complicated driving scenarios, etc. Recent methods often adopt…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Heng Li , Yuenan Hou , Xiaohan Xing , Yuexin Ma , Xiao Sun , Yanyong Zhang

We propose Samba ASR,the first state of the art Automatic Speech Recognition(ASR)model leveraging the novel Mamba architecture as both encoder and decoder,built on the foundation of state space models(SSMs).Unlike transformerbased ASR…

Computation and Language · Computer Science 2025-01-09 Syed Abdul Gaffar Shakhadri , Kruthika KR , Kartik Basavaraj Angadi

Denoising is a crucial preprocessing step for hyperspectral images (HSIs) due to noise arising from intra-imaging mechanisms and environmental factors. Long-range spatial-spectral correlation modeling is beneficial for HSI denoising but…

Image and Video Processing · Electrical Eng. & Systems 2024-08-06 Guanyiman Fu , Fengchao Xiong , Jianfeng Lu , Jun Zhou

Point cloud segmentation is an important topic in 3D understanding that has traditionally has been tackled using either the CNN or Transformer. Recently, Mamba has emerged as a promising alternative, offering efficient long-range contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yong Xien Chng , Xuchong Qiu , Yizeng Han , Yifan Pu , Jiewei Cao , Gao Huang