English
Related papers

Related papers: SAMamba: Adaptive State Space Modeling with Hierar…

200 papers

Recent advancements in State Space Models, notably Mamba, have demonstrated superior performance over the dominant Transformer models, particularly in reducing the computational complexity from quadratic to linear. Yet, difficulties in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Fei Xie , Weijia Zhang , Zhongdao Wang , Chao Ma

Accurate 3D medical image segmentation demands architectures capable of reconciling global context modeling with spatial topology preservation. While State Space Models (SSMs) like Mamba show potential for sequence modeling, existing…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Hangyu Ji

Place recognition is the foundation for enabling autonomous systems to achieve independent decision-making and safe operations. It is also crucial in tasks such as loop closure detection and global localization within SLAM. Previous methods…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Qiuchi Xiang , Jintao Cheng , Jiehao Luo , Jin Wu , Rui Fan , Xieyuanli Chen , Xiaoyu Tang

Accurate medical image segmentation remains challenging due to blurred lesion boundaries (LBA), loss of high-frequency details (LHD), and difficulty in modeling long-range anatomical structures (DC-LRSS). Vision Mamba employs…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Ze Rong , ZiYue Zhao , Zhaoxin Wang , Lei Ma

A high-performance image compression algorithm is crucial for real-time information transmission across numerous fields. Despite rapid progress in image compression, computational inefficiency and poor redundancy modeling still pose…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Fanhu Zeng , Hao Tang , Yihua Shao , Siyu Chen , Ling Shao , Yan Wang

Moving infrared small target detection (IRSTD) plays a critical role in practical applications, such as surveillance of unmanned aerial vehicles (UAVs) and UAV-based search system. Moving IRSTD still remains highly challenging due to weak…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Houzhang Fang , Shukai Guo , Qiuhuan Chen , Yi Chang , Luxin Yan

Balancing fine-grained local modeling with long-range dependency capture under computational constraints remains a central challenge in sequence modeling. While Transformers provide strong token mixing, they suffer from quadratic…

Machine Learning · Computer Science 2026-03-20 Youjin Wang , Jiaqiao Zhao , Rong Fu , Run Zhou , Ruizhe Zhang , Jiani Liang , Suisuai Cao , Feng Zhou

Remote sensing change detection is vital for monitoring environmental and urban transformations but faces challenges like manual feature extraction and sensitivity to noise. Traditional methods and early deep learning models, such as…

Medical time series are central to healthcare, enabling continuous monitoring and supporting timely clinical decisions. Despite recent progress, existing methods struggle to jointly model local-global dynamics and handle nonstationarities…

Machine Learning · Computer Science 2026-05-26 Da Zhang , Bingyu Li , Zhiyuan Zhao , Hongyuan Zhang , Junyu Gao , Xuelong Li

We propose a target driven adaptive (TDA) loss to enhance the performance of infrared small target detection (IRSTD). Prior works have used loss functions, such as binary cross-entropy loss and IoU loss, to train segmentation models for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yuho Shoji , Takahiro Toizumi , Atsushi Ito

Infrared small target detection (ISTD) is critical in both civilian and military applications. However, the limited texture and structural information in infrared images makes accurate detection particularly challenging. Although recent…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Xingye Cui , Junhai Luo , Jiakun Deng , Kexuan Li , Xiangyu Qiu , Zhenming Peng

Recent advancements in state space models, notably Mamba, have demonstrated significant progress in modeling long sequences for tasks like language understanding. Yet, their application in vision tasks has not markedly surpassed the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Tao Huang , Xiaohuan Pei , Shan You , Fei Wang , Chen Qian , Chang Xu

Infrared small target detection (ISTD) is widely used in civilian and military applications. However, ISTD encounters several challenges, including the tendency for small and dim targets to be obscured by complex backgrounds. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Chen Hu , Yian Huang , Kexuan Li , Luping Zhang , Chang Long , Yiming Zhu , Tian Pu , Zhenming Peng

Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module. Many subquadratic-time architectures such as linear attention,…

Machine Learning · Computer Science 2024-06-03 Albert Gu , Tri Dao

Long-term multivariate time series forecasting (LTSF) plays a crucial role in various high-performance computing applications, including real-time energy grid management and large-scale traffic flow simulation. However, existing solutions…

Machine Learning · Computer Science 2026-02-03 Qianyang Li , Xingjun Zhang , Shaoxun Wang , Jia Wei , Yueqi Xing

Hyperspectral image (HSI) classification has been one of the hot topics in remote sensing fields. Recently, the Mamba architecture based on selective state-space models (S6) has demonstrated great advantages in long sequence modeling.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Hongxing Peng , Kang Lin , Huanai Liu

Recent works have demonstrated that attention-based transformer and large language model (LLM) architectures can achieve strong channel state prediction (CSP) performance by capturing long-range temporal dependencies across channel state…

Information Theory · Computer Science 2026-04-27 Aladin Djuhera , Haris Gacanin , Holger Boche

In recent years, State Space Models (SSMs) with efficient hardware-aware designs, known as the Mamba deep learning models, have made significant progress in modeling long sequences such as language understanding. Therefore, building…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Juntao Zhang , Shaogeng Liu , Jun Zhou , Kun Bian , You Zhou , Jianning Liu , Pei Zhang , Bingyan Liu

State space models (SSMs) have emerged as an efficient alternative to Transformer models for language modeling, offering linear computational complexity and constant memory usage as context length increases. However, despite their…

Computation and Language · Computer Science 2025-04-23 Zhifan Ye , Kejing Xia , Yonggan Fu , Xin Dong , Jihoon Hong , Xiangchi Yuan , Shizhe Diao , Jan Kautz , Pavlo Molchanov , Yingyan Celine Lin

Semantic segmentation is a vital task in the field of remote sensing (RS). However, conventional convolutional neural network (CNN) and transformer-based models face limitations in capturing long-range dependencies or are often…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Yin Hu , Xianping Ma , Jialu Sui , Man-On Pun