English
Related papers

Related papers: Patch-MoE Mamba: A Patch-Ordered Mixture-of-Expert…

200 papers

In the realm of smart healthcare, researchers enhance the scale and diversity of medical datasets through medical image synthesis. However, existing methods are limited by CNN local perception and Transformer quadratic complexity, making it…

Image and Video Processing · Electrical Eng. & Systems 2024-05-10 Zhihan Ju , Wanting Zhou

Convolutional neural networks (CNNs) and Transformers have shown advanced accuracy in crack detection under certain conditions. Yet, the fixed local attention can compromise the generalisation of CNNs, and the quadratic complexity of the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhaohui Chen , Elyas Asadi Shamsabadi , Sheng Jiang , Luming Shen , Daniel Dias-da-Costa

Unified Medical Image Segmentation (UMIS) is critical for comprehensive anatomical assessment but faces challenges due to multi-scale structural heterogeneity. Conventional pixel-based approaches, lacking object-level anatomical insight and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Ruicheng Zhang , Haowei Guo , Kanghui Tian , Jun Zhou , Mingliang Yan , Zeyu Zhang , Shen Zhao

CNNs, most notably the UNet, are the default architecture for biomedical segmentation. Transformer-based approaches, such as UNETR, have been proposed to replace them, benefiting from a global field of view, but suffering from larger…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Anwai Archit , Constantin Pape

The Transformer architecture has opened a new paradigm in the domain of deep learning with its ability to model long-range dependencies and capture global context and has outpaced the traditional Convolution Neural Networks (CNNs) in many…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Badhan Kumar Das , Ajay Singh , Saahil Islam , Gengyan Zhao , Andreas Maier

Semantic segmentation of high-resolution remote sensing images is vital in downstream applications such as land-cover mapping, urban planning and disaster assessment.Existing Transformer-based methods suffer from the constraint between…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Enze Zhu , Zhan Chen , Dingkai Wang , Hanru Shi , Xiaoxuan Liu , Lei Wang

Classifying 3D MRI images for early detection of Alzheimer's disease is a critical task in medical imaging. Traditional approaches using Convolutional Neural Networks (CNNs) and Transformers face significant challenges in this domain. CNNs,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Muthukumar K A , Amit Gurung , Priya Ranjan

Breast cancer (BC) remains one of the leading causes of cancer-related mortality among women, despite recent advances in Computer-Aided Diagnosis (CAD) systems. Accurate and efficient interpretation of multi-view mammograms is essential for…

Image and Video Processing · Electrical Eng. & Systems 2025-07-24 Farnoush Bayatmakou , Reza Taleei , Nicole Simone , Arash Mohammadi

Early detection of skin abnormalities plays a crucial role in diagnosing and treating skin cancer. Segmentation of affected skin regions using AI-powered devices is relatively common and supports the diagnostic process. However, achieving…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Thi-Nhu-Quynh Nguyen , Quang-Huy Ho , Duy-Thai Nguyen , Hoang-Minh-Quang Le , Van-Truong Pham , Thi-Thao Tran

Compared to single view medical image classification, using multiple views can significantly enhance predictive accuracy as it can account for the complementarity of each view while leveraging correlations between views. Existing multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Xiaoyu Zheng , Xu Chen , Shaogang Gong , Xavier Griffin , Greg Slabaugh

State Space Models (SSMs)-most notably RNNs-have historically played a central role in sequential modeling. Although attention mechanisms such as Transformers have since dominated due to their ability to model global context, their…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Hyun-kyu Ko , Youbin Kim , Jihyeon Park , Dongheok Park , Gyeongjin Kang , Wonjun Cho , Hyung Yi , Eunbyung Park

Medical image segmentation is a critical task in medical imaging analysis. Traditional CNN-based methods struggle with modeling long-range dependencies, while Transformer-based models, despite their success, suffer from quadratic…

Image and Video Processing · Electrical Eng. & Systems 2025-01-07 Yibo Zhang

High-performance semantic segmentation has achieved significant progress in recent years, often driven by increasingly large backbones and higher computational budgets. While effective, such approaches introduce substantial computational…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Sheng-Wei Chan , Hsin-Jui Pan , Chun-Po Shen , Chia-Min Lin , Yung-Che Wang , Jen-Shiun Chiang

Mamba, a recent selective structured state space model, excels in long sequence modeling, which is vital in the large model era. Long sequence modeling poses significant challenges, including capturing long-range dependencies within the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Rui Xu , Shu Yang , Yihui Wang , Yu Cai , Bo Du , Hao Chen

Medical image segmentation - the prerequisite of numerous clinical needs - has been significantly prospered by recent advances in convolutional neural networks (CNNs). However, it exhibits general limitations on modeling explicit long-range…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Yundong Zhang , Huiye Liu , Qiang Hu

Partial differential equations (PDEs) are widely used to model complex physical systems, but solving them efficiently remains a significant challenge. Recently, Transformers have emerged as the preferred architecture for PDEs due to their…

Machine Learning · Computer Science 2026-03-12 Chun-Wun Cheng , Jiahao Huang , Yi Zhang , Guang Yang , Carola-Bibiane Schönlieb , Angelica I. Aviles-Rivero

Multimodal image fusion aims to integrate information from different imaging techniques to produce a comprehensive, detail-rich single image for downstream vision tasks. Existing methods based on local convolutional neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xinyu Xie , Yawen Cui , Tao Tan , Xubin Zheng , Zitong Yu

Semantic segmentation of remote sensing imagery is a fundamental task in computer vision, supporting a wide range of applications such as land use classification, urban planning, and environmental monitoring. However, this task is often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Qinfeng Zhu , Han Li , Liang He , Lei Fan

State space models (SSMs) with selection mechanisms and hardware-aware architectures, namely Mamba, have recently demonstrated significant promise in long-sequence modeling. Since the self-attention mechanism in transformers has quadratic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Hanwei Zhang , Ying Zhu , Dan Wang , Lijun Zhang , Tianxiang Chen , Zi Ye

The effectiveness and efficiency of modeling complex spectral-spatial relations are both crucial for Hyperspectral image (HSI) classification. Most existing methods based on CNNs and transformers still suffer from heavy computational…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Jiamu Sheng , Jingyi Zhou , Jiong Wang , Peng Ye , Jiayuan Fan