English
Related papers

Related papers: Mamba as a Bridge: Where Vision Foundation Models …

200 papers

In recent years, Visual Question Localized-Answering in robotic surgery (Surgical-VQLA) has gained significant attention for its potential to assist medical students and junior doctors in understanding surgical scenes. Recently, the rapid…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Pengfei Hao , Hongqiu Wang , Shuaibo Li , Zhaohu Xing , Guang Yang , Kaishun Wu , Lei Zhu

Image segmentation holds a vital position in the realms of diagnosis and treatment within the medical domain. Traditional convolutional neural networks (CNNs) and Transformer models have made significant advancements in this realm, but they…

Image and Video Processing · Electrical Eng. & Systems 2024-05-06 Hao Tang , Lianglun Cheng , Guoheng Huang , Zhengguang Tan , Junhao Lu , Kaihong Wu

To segment medical images with distribution shifts, domain generalization (DG) has emerged as a promising setting to train models on source domains that can generalize to unseen target domains. Existing DG methods are mainly based on CNN or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Zihan Cheng , Jintao Guo , Jian Zhang , Lei Qi , Luping Zhou , Yinghuan Shi , Yang Gao

In the field of multi-source remote sensing image classification, remarkable progress has been made by using Convolutional Neural Network (CNN) and Transformer. Recently, Mamba-based methods built upon the State Space Model (SSM) have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-01-28 Feng Gao , Xuepeng Jin , Xiaowei Zhou , Junyu Dong , Qian Du

Semantic segmentation of remote sensing images is a fundamental task in geoscience research. However, there are some significant shortcomings for the widely used convolutional neural networks (CNNs) and Transformers. The former is limited…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Xianping Ma , Xiaokang Zhang , Man-On Pun

Mamba is emerging as a novel approach to overcome the challenges faced by Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) in computer vision. While CNNs excel at extracting local features, they often struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Md Maklachur Rahman , Abdullah Aman Tutul , Ankur Nath , Lamyanba Laishram , Soon Ki Jung , Tracy Hammond

In the realm of medical image segmentation, both CNN-based and Transformer-based models have been extensively explored. However, CNNs exhibit limitations in long-range modeling capabilities, whereas Transformers are hampered by their…

Image and Video Processing · Electrical Eng. & Systems 2024-11-11 Jiacheng Ruan , Jincheng Li , Suncheng Xiang

Many few-shot segmentation (FSS) methods use cross attention to fuse support foreground (FG) into query features, regardless of the quadratic complexity. A recent advance Mamba can also well capture intra-sequence dependencies, yet the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Qianxiong Xu , Xuanyi Liu , Lanyun Zhu , Guosheng Lin , Cheng Long , Ziyue Li , Rui Zhao

Neuron segmentation is the cornerstone of reconstructing comprehensive neuronal connectomes, which is essential for deciphering the functional organization of the brain. The irregular morphology and densely intertwined structures of neurons…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Liuyun Jiang , Yizhuo Lu , Yanchao Zhang , Jiazheng Liu , Hua Han

Vision Mamba (ViM) models offer a compelling efficiency advantage over Transformers by leveraging the linear complexity of State Space Models (SSMs), yet efficiently deploying them on FPGAs remains challenging. Linear layers struggle with…

Hardware Architecture · Computer Science 2026-05-05 Shengzhe Lyu , Yuhan She , Patrick S. Y. Hung , Ray C. C. Cheung , Weitao Xu

With the growing number and diversity of Vision-Language Models (VLMs), many works explore language-based ensemble, collaboration, and routing techniques across multiple VLMs to improve multi-model reasoning. In contrast, we address the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Selim Furkan Tekin , Yichang Xu , Gaowen Liu , Ramana Rao Kompella , Margaret L. Loper , Ling Liu

Domain Generalized Semantic Segmentation (DGSS) aims to improve the generalization ability of models across unseen domains without access to target data during training. Recent advances in DGSS have increasingly exploited vision foundation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Xinhui Li , Xiaojie Guo

Semantic segmentation is a fundamental task in computer vision with wide-ranging applications, including autonomous driving and robotics. While RGB-based methods have achieved strong performance with CNNs and Transformers, their…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Fuqiang Gu , Yuanke Li , Xianlei Long , Kangping Ji , Chao Chen , Qingyi Gu , Zhenliang Ni

While recent semantic segmentation networks heavily rely on powerful pretrained encoders, most employ simplistic decoders, leading to suboptimal trade-offs between semantic context and fine-grained detail preservation. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Guoan Xu , Yang Xiao , Wenjing Jia , Guangwei Gao , Guo-Jun Qi , Chia-Wen Lin

Achieving robust generalization across diverse data domains remains a significant challenge in computer vision. This challenge is important in safety-critical applications, where deep-neural-network-based systems must perform reliably under…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Brunó B. Englert , Fabrizio J. Piva , Tommie Kerssies , Daan de Geus , Gijs Dubbelman

Compared to single view medical image classification, using multiple views can significantly enhance predictive accuracy as it can account for the complementarity of each view while leveraging correlations between views. Existing multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Xiaoyu Zheng , Xu Chen , Shaogang Gong , Xavier Griffin , Greg Slabaugh

Cracks pose safety risks to infrastructure and cannot be overlooked. The prevailing structures in existing crack segmentation networks predominantly consist of CNNs or Transformers. However, CNNs exhibit a deficiency in global modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zhili He , Yu-Hsing Wang

Recent domain generalized semantic segmentation (DGSS) studies have achieved notable improvements by distilling semantic knowledge from Vision-Language Models (VLMs). However, they overlook the semantic misalignment between visual and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Seogkyu Jeon , Kibeom Hong , Hyeran Byun

Vision Language Models (VLMs) provide rich semantic priors but are underexplored in Semi supervised Semantic Segmentation. Recent attempts to integrate VLMs to inject high level semantics overlook the semantic misalignment between visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Numair Nadeem , Saeed Anwar , Muhammad Hamza Asad , Abdul Bais

U-shaped architectures have long dominated the field of medical image segmentation, while Transformers are widely employed for modeling long-range dependencies. The former typically handles scale variations implicitly by aggregating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yanhua Zhang , Ke Zhang , Jingyu Wang , Gabriella Balestra , Samanta Rosati , Yulin Wu , Wuwei Wang , Valentina Giannini