中文
相关论文

相关论文: Sigma: Siamese Mamba Network for Multi-Modal Seman…

200 篇论文

Learned Image Compression (LIC) has explored various architectures, such as Convolutional Neural Networks (CNNs) and transformers, in modeling image content distributions in order to achieve compression effectiveness. However, achieving…

图像与视频处理 · 电气工程与系统科学 2025-02-10 Zhuojie Wu , Heming Du , Shuyun Wang , Ming Lu , Haiyang Sun , Yandong Guo , Xin Yu

Medical image segmentation plays an important role in various clinical applications; however, existing deep learning models face trade-offs between efficiency and accuracy. Convolutional Neural Networks (CNNs) capture local details well but…

图像与视频处理 · 电气工程与系统科学 2025-10-20 Saqib Qamar , Mohd Fazil , Parvez Ahmad , Shakir Khan , Abu Taha Zamani

Ground-based cloud image segmentation is a critical research domain for photovoltaic power forecasting. Current deep learning approaches primarily focus on encoder-decoder architectural refinements. However, existing methodologies exhibit…

机器学习 · 计算机科学 2026-02-17 Penghui Niu , Jiashuai She , Taotao Cai , Yajuan Zhang , Ping Zhang , Junhua Gu , Jianxin Li

Accurate segmentation of 3D medical images such as MRI and CT is essential for clinical diagnosis and treatment planning. Foundation models like the Segment Anything Model (SAM) provide powerful general-purpose representations but struggle…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Mohammadreza Gholipour Shahraki , Mehdi Rezaeian , Mohammad Ghasemzadeh

Current end-to-end multi-modal models utilize different encoders and decoders to process input and output information. This separation hinders the joint representation learning of various modalities. To unify multi-modal processing, we…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Chunhao Lu , Qiang Lu , Meichen Dong , Jake Luo

In scene text detection, Transformer-based methods have addressed the global feature extraction limitations inherent in traditional convolution neural network-based methods. However, most directly rely on native Transformer attention layers…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Qiyan Zhao , Yue Yan , Da-Han Wang

Recent years have witnessed significant advancements in light field image super-resolution (LFSR) owing to the progress of modern neural networks. However, these methods often face challenges in capturing long-range dependencies (CNN-based)…

计算机视觉与模式识别 · 计算机科学 2024-06-19 Wang xia , Yao Lu , Shunzhou Wang , Ziqi Wang , Peiqi Xia , Tianfei Zhou

Recent State Space Models (SSM), especially Mamba, have demonstrated impressive performance in visual modeling and possess superior model efficiency. However, the application of Mamba to visual tasks suffers inferior performance due to…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Fei Xie , Jiahao Nie , Yujin Tang , Wenkang Zhang , Hongshen Zhao

Efficiently modeling large 2D contexts is essential for various fields including Giga-Pixel Whole Slide Imaging (WSI) and remote sensing. Transformer-based models offer high parallelism but face challenges due to their quadratic complexity…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Jingwei Zhang , Anh Tien Nguyen , Xi Han , Vincent Quoc-Huy Trinh , Hong Qin , Dimitris Samaras , Mahdi S. Hosseini

Semantic segmentation plays an important role in widespread applications such as autonomous driving and robotic sensing. Traditional methods mostly use RGB images which are heavily affected by lighting conditions, \eg, darkness. Recent…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Ping Li , Junjie Chen , Binbin Lin , Xianghua Xu

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

多媒体 · 计算机科学 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

Classifying hyperspectral images is a difficult task in remote sensing, due to their complex high-dimensional data. To address this challenge, we propose HSIMamba, a novel framework that uses bidirectional reversed convolutional neural…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Judy X Yang , Jun Zhou , Jing Wang , Hui Tian , Alan Wee Chung Liew

In clinical practice, medical image segmentation provides useful information on the contours and dimensions of target organs or tissues, facilitating improved diagnosis, analysis, and treatment. In the past few years, convolutional neural…

计算机视觉与模式识别 · 计算机科学 2024-06-26 Jinhong Wang , Jintai Chen , Danny Chen , Jian Wu

State space models (SSMs) with selection mechanisms and hardware-aware architectures, namely Mamba, have recently demonstrated significant promise in long-sequence modeling. Since the self-attention mechanism in transformers has quadratic…

计算机视觉与模式识别 · 计算机科学 2024-04-29 Hanwei Zhang , Ying Zhu , Dan Wang , Lijun Zhang , Tianxiang Chen , Zi Ye

Robust feature representations are essential for learning-based Multi-View Stereo (MVS), which relies on accurate feature matching. Recent MVS methods leverage Transformers to capture long-range dependencies based on local features…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Jianfei Jiang , Qiankun Liu , Hongyuan Liu , Haochen Yu , Liyong Wang , Jiansheng Chen , Huimin Ma

Compared to single view medical image classification, using multiple views can significantly enhance predictive accuracy as it can account for the complementarity of each view while leveraging correlations between views. Existing multi-view…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Xiaoyu Zheng , Xu Chen , Shaogang Gong , Xavier Griffin , Greg Slabaugh

Recently, Mamba-based methods have become popular in medical image segmentation due to their lightweight design and long-range dependency modeling capabilities. However, current segmentation methods frequently encounter challenges in fetal…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Caixu Xu , Junming Wei , Huizhen Chen , Pengchen Liang , Bocheng Liang , Ying Tan , Xintong Wei

Accurate 3D medical image segmentation demands architectures capable of reconciling global context modeling with spatial topology preservation. While State Space Models (SSMs) like Mamba show potential for sequence modeling, existing…

图像与视频处理 · 电气工程与系统科学 2025-06-06 Hangyu Ji

Establishing semantic correspondences between images is a fundamental yet challenging task in computer vision. Traditional feature-metric methods enhance visual features but may miss complex inter-correlation relationships, while recent…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Seungwook Kim , Minsu Cho

Recently, Mamba-based super-resolution (SR) methods have demonstrated the ability to capture global receptive fields with linear complexity, addressing the quadratic computational cost of Transformer-based SR approaches. However, existing…

计算机视觉与模式识别 · 计算机科学 2026-04-24 Sichen Guo , Wenjie Li , Yuanyang Liu , Guangwei Gao , Jian Yang , Chia-Wen Lin