English
Related papers

Related papers: SegResMamba: An Efficient Architecture for 3D Medi…

200 papers

The Foundation model for image segmentation, Segment Anything (SAM), has been actively researched in various fields since its proposal. Various researches have been proposed to adapt SAM to specific domains, with one notable approach…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Joohyeok Kim , Joonhyeon Song , Seohwan Yun , Seongho Yoon , Sangmin Lee

Decision Transformer, a promising approach that applies Transformer architectures to reinforcement learning, relies on causal self-attention to model sequences of states, actions, and rewards. While this method has shown competitive…

Machine Learning · Computer Science 2024-04-01 Toshihiro Ota

Selective state-space models (SSMs) like Mamba overcome some of the shortcomings of Transformers, such as quadratic computational complexity with sequence length and large inference-time memory requirements from the key-value cache.…

In data-scarce scenarios, deep learning models often overfit to noise and irrelevant patterns, which limits their ability to generalize to unseen samples. To address these challenges in medical image segmentation, we introduce Diff-UMamba,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Dhruv Jain , Romain Modzelewski , Romain Herault , Clement Chatelain , Eva Torfeh , Sebastien Thureau

Transformers have reached remarkable success in sequence modeling. However, these models have efficiency issues as they need to store all the history token-level representations as memory. We present Memformer, an efficient neural network…

Computation and Language · Computer Science 2022-04-14 Qingyang Wu , Zhenzhong Lan , Kun Qian , Jing Gu , Alborz Geramifard , Zhou Yu

Transformer, which can benefit from global (long-range) information modeling using self-attention mechanisms, has been successful in natural language processing and 2D image classification recently. However, both local and global features…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Wenxuan Wang , Chen Chen , Meng Ding , Jiangyun Li , Hong Yu , Sen Zha

Deep neural networks have been a prevailing technique in the field of medical image processing. However, the most popular convolutional neural networks (CNNs) based methods for medical image segmentation are imperfect because they model…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Zhuangzhuang Zhang , Weixiong Zhang

Accurate brain tumor segmentation is significant for clinical diagnosis and treatment but remains challenging due to tumor heterogeneity. Mamba-based State Space Models have demonstrated promising performance. However, despite their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Danish Ali , Ajmal Mian , Naveed Akhtar , Ghulam Mubashar Hassan

Achieving both high accuracy and topological continuity in road segmentation from satellite imagery is a critical goal for applications ranging from urban planning to disaster response. State-of-the-art methods often rely on Vision…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jules Decaestecker , Nicolas Vigne

With the explosive growth of data, long-sequence modeling has become increasingly important in tasks such as natural language processing and bioinformatics. However, existing methods face inherent trade-offs between efficiency and memory.…

Machine Learning · Computer Science 2025-10-07 Youjin Wang , Yangjingyi Chen , Jiahao Yan , Jiaxuan Lu , Xiao Sun

Due to the success of CNN-based and Transformer-based models in various computer vision tasks, recent works study the applicability of CNN-Transformer hybrid architecture models in 3D multi-modality medical segmentation tasks. Introducing…

Image and Video Processing · Electrical Eng. & Systems 2025-04-15 Yonghao Huang , Leiting Chen , Chuan Zhou

Medical image segmentation is vital for clinical diagnosis and quantitative analysis, yet remains challenging due to the heterogeneity of imaging modalities and the high cost of pixel-level annotations. Although general interactive…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yujie Lu , Jingwen Li , Sibo Ju , Yanzhou Su , he yao , Yisong Liu , Min Zhu , Junlong Cheng

Convolutional neural networks (CNN) and Transformers have made impressive progress in the field of remote sensing change detection (CD). However, both architectures have inherent shortcomings: CNN are constrained by a limited receptive…

Image and Video Processing · Electrical Eng. & Systems 2024-12-31 Hongruixuan Chen , Jian Song , Chengxi Han , Junshi Xia , Naoto Yokoya

Automated medical image segmentation can assist doctors to diagnose faster and more accurate. Deep learning based models for medical image segmentation have made great progress in recent years. However, the existing models fail to…

Image and Video Processing · Electrical Eng. & Systems 2023-04-26 Lei Shi , Tianyu Gao , Zheng Zhang , Junxing Zhang

Electron microscopy (EM) imaging offers unparalleled resolution for analyzing neural tissues, crucial for uncovering the intricacies of synaptic connections and neural processes fundamental to understanding behavioral mechanisms. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Ruohua Shi , Qiufan Pang , Lei Ma , Lingyu Duan , Tiejun Huang , Tingting Jiang

While CNNs were long considered state of the art for image processing, the introduction of Transformer architectures has challenged this position. While achieving excellent results in image classification and segmentation, Transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 DeShin Hwa , Tobias Holmes , Klaus Drechsler

Recent efforts on image restoration have focused on developing "all-in-one" models that can handle different degradation types and levels within single model. However, most of mainstream Transformer-based ones confronted with dilemma…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Aiwen Jiang , Hourong Chen , Zhiwen Chen , Jihua Ye , Mingwen Wang

Brain tumors exhibit high heterogeneity in morphology and multimodal contrast, making manual slice-by-slice de lineation time-consuming and experience-dependent, thus necessitating efficient and stable automated segmentation methods. To…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Hanjun Tao , Hua Wang , Fan Zhang

Medical image segmentation plays a crucial role in advancing healthcare systems for disease diagnosis and treatment planning. The u-shaped architecture, popularly known as U-Net, has proven highly successful for various medical image…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Jieneng Chen , Jieru Mei , Xianhang Li , Yongyi Lu , Qihang Yu , Qingyue Wei , Xiangde Luo , Yutong Xie , Ehsan Adeli , Yan Wang , Matthew Lungren , Lei Xing , Le Lu , Alan Yuille , Yuyin Zhou

Transformer-based neural networks have surpassed promising performance on many biomedical image segmentation tasks due to a better global information modeling from the self-attention mechanism. However, most methods are still designed for…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Zheyuan Zhang , Ulas Bagci