English

HiddenObject: Modality-Agnostic Fusion for Multimodal Hidden Object Detection

Computer Vision and Pattern Recognition 2025-09-15 v2 Artificial Intelligence

Abstract

Detecting hidden or partially concealed objects remains a fundamental challenge in multimodal environments, where factors like occlusion, camouflage, and lighting variations significantly hinder performance. Traditional RGB-based detection methods often fail under such adverse conditions, motivating the need for more robust, modality-agnostic approaches. In this work, we present HiddenObject, a fusion framework that integrates RGB, thermal, and depth data using a Mamba-based fusion mechanism. Our method captures complementary signals across modalities, enabling enhanced detection of obscured or camouflaged targets. Specifically, the proposed approach identifies modality-specific features and fuses them in a unified representation that generalizes well across challenging scenarios. We validate HiddenObject across multiple benchmark datasets, demonstrating state-of-the-art or competitive performance compared to existing methods. These results highlight the efficacy of our fusion design and expose key limitations in current unimodal and na\"ive fusion strategies. More broadly, our findings suggest that Mamba-based fusion architectures can significantly advance the field of multimodal object detection, especially under visually degraded or complex conditions.

Keywords

Cite

@article{arxiv.2508.21135,
  title  = {HiddenObject: Modality-Agnostic Fusion for Multimodal Hidden Object Detection},
  author = {Harris Song and Tuan-Anh Vu and Sanjith Menon and Sriram Narasimhan and M. Khalid Jawed},
  journal= {arXiv preprint arXiv:2508.21135},
  year   = {2025}
}

Comments

fix typos

R2 v1 2026-07-01T05:10:59.807Z