中文
相关论文

相关论文: Sigma: Siamese Mamba Network for Multi-Modal Seman…

200 篇论文

Convolutional neural networks and Transformer have made significant progresses in multi-modality medical image super-resolution. However, these methods either have a fixed receptive field for local learning or significant computational…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Zexin Ji , Beiji Zou , Xiaoyan Kui , Sebastien Thureau , Su Ruan

Collaborative perception integrates multi-agent perspectives to enhance the sensing range and overcome occlusion issues. While existing multimodal approaches leverage complementary sensors to improve performance, they are highly prone to…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Jiageng Wen , Shengjie Zhao , Bing Li , Jiafeng Huang , Kenan Ye , Hao Deng

Multispectral oriented object detection faces challenges due to both inter-modal and intra-modal discrepancies. Recent studies often rely on transformer-based models to address these issues and achieve cross-modal fusion detection. However,…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Minghang Zhou , Tianyu Li , Chaofan Qiao , Dongyu Xie , Guoqing Wang , Ningjuan Ruan , Lin Mei , Yang Yang

We introduce a novel deep learning method for decoding error correction codes based on the Mamba architecture, enhanced with Transformer layers. Our approach proposes a hybrid decoder that leverages Mamba's efficient sequential modeling…

信息论 · 计算机科学 2025-05-26 Shy-el Cohen , Yoni Choukroun , Eliya Nachmani

Detecting hidden or partially concealed objects remains a fundamental challenge in multimodal environments, where factors like occlusion, camouflage, and lighting variations significantly hinder performance. Traditional RGB-based detection…

计算机视觉与模式识别 · 计算机科学 2025-09-15 Harris Song , Tuan-Anh Vu , Sanjith Menon , Sriram Narasimhan , M. Khalid Jawed

Multi-modal image fusion integrates complementary information from different modalities to produce enhanced and informative images. Although State-Space Models, such as Mamba, are proficient in long-range modeling with linear complexity,…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Ke Cao , Xuanhua He , Tao Hu , Chengjun Xie , Man Zhou , Jie Zhang

State Space Models (SSMs), especially recent Mamba architecture, have achieved remarkable success in sequence modeling tasks. However, extending SSMs to computer vision remains challenging due to the non-sequential structure of visual data…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Puskal Khadka , KC Santosh

Existing deraining Transformers employ self-attention mechanisms with fixed-range windows or along channel dimensions, limiting the exploitation of non-local receptive fields. In response to this issue, we introduce a novel dual-branch…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Shangquan Sun , Wenqi Ren , Juxiang Zhou , Jianhou Gan , Rui Wang , Xiaochun Cao

Although Mamba models significantly improve hyperspectral image (HSI) classification, one critical challenge is the difficulty in building the sequence of Mamba tokens efficiently. This paper presents a Sparse Deformable Mamba (SDMamba)…

计算机视觉与模式识别 · 计算机科学 2025-04-17 Lincoln Linlin Xu , Yimin Zhu , Zack Dewis , Zhengsen Xu , Motasem Alkayid , Mabel Heffring , Saeid Taleghanidoozdoozan

Multi-modal fusion is crucial for Internet of Things (IoT) perception, widely deployed in smart homes, intelligent transport, industrial automation, and healthcare. However, existing systems often face challenges: high model complexity…

计算机视觉与模式识别 · 计算机科学 2025-07-21 Weiqi Yang , Xu Zhou , Jingfu Guan , Hao Du , Tianyu Bai

Point cloud segmentation is crucial for robotic visual perception and environmental understanding, enabling applications such as robotic navigation and 3D reconstruction. However, handling the sparse and unordered nature of point cloud data…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Tao Wang , Wei Wen , Jingzhi Zhai , Kang Xu , Haoming Luo

3D semantic scene completion is critical for multiple downstream tasks in autonomous systems. It estimates missing geometric and semantic information in the acquired scene data. Due to the challenging real-world conditions, this task…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Li Liang , Naveed Akhtar , Jordan Vice , Xiangrui Kong , Ajmal Saeed Mian

Hyperspectral image (HSI) classification plays a pivotal role in domains such as environmental monitoring, agriculture, and urban planning. However, it faces significant challenges due to the high-dimensional nature of the data and the…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Muhammad Ahmad , Muhammad Hassaan Farooq Butt , Muhammad Usama , Manuel Mazzara , Salvatore Distefano , Adil Mehmood Khan , Danfeng Hong

Recent efforts on image restoration have focused on developing "all-in-one" models that can handle different degradation types and levels within single model. However, most of mainstream Transformer-based ones confronted with dilemma…

计算机视觉与模式识别 · 计算机科学 2024-12-23 Aiwen Jiang , Hourong Chen , Zhiwen Chen , Jihua Ye , Mingwen Wang

We introduce VideoMamba, a novel adaptation of the pure Mamba architecture, specifically designed for video recognition. Unlike transformers that rely on self-attention mechanisms leading to high computational costs by quadratic complexity,…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Jinyoung Park , Hee-Seon Kim , Kangwook Ko , Minbeom Kim , Changick Kim

Cloud detection in remote sensing imagery is a fundamental, critical, and highly challenging problem. Existing deep learning-based cloud detection methods generally formulate it as a single-stage pixel-wise binary segmentation task with one…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Jiajun Yang , Keyan Chen , Zhengxia Zou , Zhenwei Shi

The perception capability of robotic systems relies on the richness of the dataset. Although Segment Anything Model 2 (SAM2), trained on large datasets, demonstrates strong perception potential in perception tasks, its inherent training…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Jiayi Zhao , Fei Teng , Kai Luo , Guoqiang Zhao , Zhiyong Li , Xu Zheng , Kailun Yang

Multimodal image fusion aims to integrate information from different imaging techniques to produce a comprehensive, detail-rich single image for downstream vision tasks. Existing methods based on local convolutional neural networks (CNNs)…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Xinyu Xie , Yawen Cui , Tao Tan , Xubin Zheng , Zitong Yu

Accurate medical image segmentation requires effective modeling of both global anatomical structures and fine-grained boundary details. Recent state space models (e.g., Vision Mamba) offer efficient long-range dependency modeling. However,…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Fuhao Zhang , Lei Liu , Jialin Zhang , Ya-Nan Zhang , Nan Mu

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

计算机视觉与模式识别 · 计算机科学 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu