English
Related papers

Related papers: Fusion-Mamba for Cross-modality Object Detection

200 papers

Reliable 3D object detection is fundamental to autonomous driving, and multimodal fusion algorithms using cameras and LiDAR remain a persistent challenge. Cameras provide dense visual cues but ill posed depth; LiDAR provides a precise 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Venkatraman Narayanan , Bala Sai , Rahul Ahuja , Pratik Likhar , Varun Ravi Kumar , Senthil Yogamani

Recently, the Mamba architecture based on state space models has demonstrated remarkable performance in a series of natural language processing tasks and has been rapidly applied to remote sensing change detection (CD) tasks. However, most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Haotian Zhang , Keyan Chen , Chenyang Liu , Hao Chen , Zhengxia Zou , Zhenwei Shi

Many few-shot segmentation (FSS) methods use cross attention to fuse support foreground (FG) into query features, regardless of the quadratic complexity. A recent advance Mamba can also well capture intra-sequence dependencies, yet the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Qianxiong Xu , Xuanyi Liu , Lanyun Zhu , Guosheng Lin , Cheng Long , Ziyue Li , Rui Zhao

State Space Models (SSMs) have emerged as efficient alternatives to Transformers for sequential modeling, but their inability to leverage modality-specific features limits their performance in multi-modal pretraining. Here, we propose…

Machine Learning · Computer Science 2025-01-28 Weixin Liang , Junhong Shen , Genghan Zhang , Ning Dong , Luke Zettlemoyer , Lili Yu

Semantic Change Detection (SCD) from remote sensing imagery requires models balancing extensive spatial context, computational efficiency, and sensitivity to class-imbalanced land-cover transitions. While Convolutional Neural Networks excel…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Buddhi Wijenayake , Athulya Ratnayake , Praveen Sumanasekara , Roshan Godaliyadda , Parakrama Ekanayake , Vijitha Herath , Nichula Wasalathilaka

Enterprises are facing increasing risks of insider threats, while existing detection methods are unable to effectively address these challenges due to reasons such as insufficient temporal dynamic feature modeling, computational efficiency…

Cryptography and Security · Computer Science 2025-08-11 Kaichuan Kong , Dongjie Liu , Xiaobo Jin , Zhiying Li , Guanggang Geng , Jian Weng

Depth map super-resolution technology aims to improve the spatial resolution of low-resolution depth maps and effectively restore high-frequency detail information. Traditional convolutional neural network has limitations in dealing with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Chenggang Guo , Hao Xu , XianMing Wan

Modern multispectral feature fusion for object detection faces two critical limitations: (1) Excessive preference for local complementary features over cross-modal shared semantics adversely affects generalization performance; and (2) The…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Jifeng Shen , Haibo Zhan , Shaohua Dong , Xin Zuo , Wankou Yang , Haibin Ling

Depression is a common mental disorder that affects millions of people worldwide. Although promising, current multimodal methods hinge on aligned or aggregated multimodal fusion, suffering two significant limitations: (i) inefficient…

Computers and Society · Computer Science 2024-09-25 Jiaxin Ye , Junping Zhang , Hongming Shan

Semantic segmentation of multi-source remote sensing images is a fundamental task for Earth observation applications. Existing methods often struggle with insufficient multi-scale context modeling and suboptimal cross-modal feature fusion,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Feng Gao , Zhilin Jin , Yanhai Gan , Junyu Dong , Qian Du

Small object detection in Unmanned Aerial Vehicle (UAV) imagery is a persistent challenge, hindered by low resolution and background clutter. While fusing RGB and infrared (IR) data offers a promising solution, existing methods often…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Shuyu Cao , Minxin Chen , Yucheng Song , Zhaozhong Chen , Xinyou Zhang

Multispectral fusion object detection is a critical task for edge-based maritime surveillance and remote sensing, demanding both high inference efficiency and robust feature representation for high-resolution inputs. However, current State…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Qianqian Zhang , Leon Tabaro , Ahmed M. Abdelmoniem , Junshe An

Multi-Modal Image Fusion (MMIF) aims to combine images from different modalities to produce fused images, retaining texture details and preserving significant information. Recently, some MMIF methods incorporate frequency domain information…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Yixin Zhu , Long Lv , Pingping Zhang , Xuehu Liu , Tongdan Tang , Feng Tian , Weibing Sun , Huchuan Lu

In a real-world traffic scenario, varying-scale objects are usually distributed in a cluttered background, which poses great challenges to accurate detection. Although current Mamba-based methods can efficiently model long-range…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Jun Li , Yingying Shi , Zhixuan Ruan , Nan Guo , Jianhua Xu

Mamba and Vision Mamba (Vim) models have shown their potential as an alternative to methods based on Transformer architecture. This work introduces Fast Mamba for Vision (Famba-V), a cross-layer token fusion technique to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Hui Shen , Zhongwei Wan , Xin Wang , Mi Zhang

Shadow removal aims to restore images that are partially degraded by shadows, where the degradation is spatially localized and non-uniform. Unlike general restoration tasks that assume global degradation, shadow removal can leverage…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Linhao Li , Boya Jin , Zizhe Li , Lanqing Guo , Hao Cheng , Bo Li , Yongfeng Dong

Multi-modal fusion is crucial for Internet of Things (IoT) perception, widely deployed in smart homes, intelligent transport, industrial automation, and healthcare. However, existing systems often face challenges: high model complexity…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Weiqi Yang , Xu Zhou , Jingfu Guan , Hao Du , Tianyu Bai

Remote sensing change detection is vital for monitoring environmental and urban transformations but faces challenges like manual feature extraction and sensitivity to noise. Traditional methods and early deep learning models, such as…

Multispectral object detection is an important application for unmanned aerial vehicles (UAVs). However, it faces several challenges. First, low-light RGB images weaken the multispectral fusion due to details loss. Second, the interference…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Shucong Li , Zhenyu Liu , Zijie Hong , Zhiheng Zhou , Xianghai Cao

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu