English
Related papers

Related papers: Beyond Mamba: Enhancing State-space Models with De…

200 papers

Recent advancements in the Mamba architecture, with its linear computational complexity, being a promising alternative to transformer architectures suffering from quadratic complexity. While existing works primarily focus on adapting Mamba…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jie Hu , Junwei Zheng , Jiale Wei , Jiaming Zhang , Rainer Stiefelhagen

CNN- and Transformer-based architectures have achieved strong performance in medical image segmentation, but CNNs are limited in modeling long-range dependencies, while Transformers often suffer from quadratic computational and memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Diego Adame , Fabian Vazquez , Jose A. Nunez , Huimin Li , Jinghao Yang , Erik Enriquez , DongChul Kim , Haoteng Tang , Bin Fu , Pengfei Gu

Image deraining is crucial for improving visual quality and supporting reliable downstream vision tasks. Although Mamba-based models provide efficient sequence modeling, their limited ability to capture fine-grained details and lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Zhiliang Zhu , Tao Zeng , Tao Yang , Guoliang Luo , Jiyong Zeng

Reliable 3D object detection is fundamental to autonomous driving, and multimodal fusion algorithms using cameras and LiDAR remain a persistent challenge. Cameras provide dense visual cues but ill posed depth; LiDAR provides a precise 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Venkatraman Narayanan , Bala Sai , Rahul Ahuja , Pratik Likhar , Varun Ravi Kumar , Senthil Yogamani

Camouflaged Object Detection (COD) is challenging due to the strong similarity between camouflaged objects and their surroundings, which complicates identification. Existing methods mainly rely on spatial local features, failing to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ming Deng , Sijin Sun , Zihao Li , Xiaochuan Hu , Xing Wu

Linear modeling methods like Mamba have been merged as the effective backbone for the 3D object detection task. However, previous Mamba-based methods utilize the bidirectional encoding for the whole non-empty voxel sequence, which contains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Zhiwei Ning , Xuanang Gao , Jiaxi Cao , Runze Yang , Huiying Xu , Xinzhong Zhu , Jie Yang , Wei Liu

Recent advances in multi-modal detection have significantly improved detection accuracy in challenging environments (e.g., low light, overexposure). By integrating RGB with modalities such as thermal and depth, multi-modal fusion increases…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Xiaofan Yang , Yubin Liu , Wei Pan , Guoqing Chu , Junming Zhang , Jie Zhao , Zhuoqi Man , Xuanming Cao

Topological deep learning has emerged as a powerful paradigm for modeling higher-order relational structures beyond pairwise interactions that standard graph neural networks fail to capture. While combinatorial complexes (CCs) offer a…

Machine Learning · Computer Science 2026-03-16 Jiawen Chen , Qi Shao , Mingtong Zhou , Duxin Chen , Wenwu Yu

Recently, a novel visual state space (VSS) model, referred to as Mamba, has demonstrated significant progress in modeling long sequences with linear complexity, comparable to Transformer models, thereby enhancing its adaptability for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Tao Wang , Tiecheng Bai , Chao Xu , Bin Liu , Erlei Zhang , Jiyun Huang , Hongming Zhang

Due to the large-scale image size and object variations, current CNN-based and Transformer-based approaches for remote sensing image semantic segmentation are suboptimal for capturing the long-range dependency or limited to the complex…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Mushui Liu , Jun Dan , Ziqian Lu , Yunlong Yu , Yingming Li , Xi Li

In recent advancements in medical image analysis, Convolutional Neural Networks (CNN) and Vision Transformers (ViT) have set significant benchmarks. While the former excels in capturing local features through its convolution operations, the…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Ziyang Wang , Jian-Qing Zheng , Yichi Zhang , Ge Cui , Lei Li

Recent advancements in state space models, notably Mamba, have demonstrated significant progress in modeling long sequences for tasks like language understanding. Yet, their application in vision tasks has not markedly surpassed the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Tao Huang , Xiaohuan Pei , Shan You , Fei Wang , Chen Qian , Chang Xu

Dynamic graphs exhibit intertwined spatio-temporal evolutionary patterns, widely existing in the real world. Nevertheless, the structure incompleteness, noise, and redundancy result in poor robustness for Dynamic Graph Neural Networks…

Machine Learning · Computer Science 2024-12-20 Haonan Yuan , Qingyun Sun , Zhaonan Wang , Xingcheng Fu , Cheng Ji , Yongjian Wang , Bo Jin , Jianxin Li

Serving the Intelligent Transport System (ITS) and Vehicle-to-Everything (V2X) tasks, roadside perception has received increasing attention in recent years, as it can extend the perception range of connected vehicles and improve traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Zhang Zhang , Chao Sun , Chao Yue , Da Wen , Tianze Wang , Jianghao Leng

Accurate real-time object detection enhances the safety of advanced driver-assistance systems, making it an essential component in driving scenarios. With the rapid development of deep learning technology, CNN-based YOLO real-time object…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yang Li , Jianli Xiao

Multicategory remote object counting is a fundamental task in computer vision, aimed at accurately estimating the number of objects of various categories in remote images. Existing methods rely on CNNs and Transformers, but CNNs struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Peng Liu , Sen Lei , Heng-Chao Li

As remote sensing imaging technology continues to advance and evolve, processing high-resolution and diversified satellite imagery to improve segmentation accuracy and enhance interpretation efficiency emerg as a pivotal area of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yice Cao , Chenchen Liu , Zhenhua Wu , Wenxin Yao , Liu Xiong , Jie Chen , Zhixiang Huang

Place recognition is the foundation for enabling autonomous systems to achieve independent decision-making and safe operations. It is also crucial in tasks such as loop closure detection and global localization within SLAM. Previous methods…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Qiuchi Xiang , Jintao Cheng , Jiehao Luo , Jin Wu , Rui Fan , Xieyuanli Chen , Xiaoyu Tang

Convolutional neural networks (CNNs) and Transformers have shown advanced accuracy in crack detection under certain conditions. Yet, the fixed local attention can compromise the generalisation of CNNs, and the quadratic complexity of the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhaohui Chen , Elyas Asadi Shamsabadi , Sheng Jiang , Luming Shen , Daniel Dias-da-Costa

Sequence models like Transformers and RNNs often overallocate attention to irrelevant context, leading to noisy intermediate representations. This degrades LLM capabilities by promoting hallucinations, weakening long-range and retrieval…

Machine Learning · Computer Science 2025-10-30 Nadav Schneider , Itamar Zimerman , Eliya Nachmani