English
Related papers

Related papers: Multi-dimension Transformer with Attention-based F…

200 papers

Medical image segmentation faces challenges due to variations in anatomical structures. While convolutional neural networks (CNNs) effectively capture local features, they struggle with modeling long-range dependencies. Transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Lalit Maurya , Honghai Liu , Reyer Zwiggelaar

Recently, 3D medical image reconstruction (MIR) and segmentation (MIS) based on deep neural networks have been developed with promising results, and attention mechanism has been further designed to capture global contextual information for…

Image and Video Processing · Electrical Eng. & Systems 2023-11-28 Hang Zhang , Jinwei Zhang , Rongguang Wang , Qihao Zhang , Pascal Spincemaille , Thanh D. Nguyen , Yi Wang

Transformer architecture has emerged to be successful in a number of natural language processing tasks. However, its applications to medical vision remain largely unexplored. In this study, we present UTNet, a simple yet powerful hybrid…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Yunhe Gao , Mu Zhou , Dimitris Metaxas

Attention-based models are proliferating in the space of image analytics, including segmentation. The standard method of feeding images to transformer encoders is to divide the images into patches and then feed the patches to the model as a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Enzhi Zhang , Isaac Lyngaas , Peng Chen , Xiao Wang , Jun Igarashi , Yuankai Huo , Mohamed Wahib , Masaharu Munetomo

Accurate segmentation of aortic vascular structures is critical for diagnosing and treating cardiovascular diseases.Traditional Transformer-based models have shown promise in this domain by capturing long-range dependencies between vascular…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhenxi Zhang , Fuchen Zheng , Adnan Iltaf , Yifei Han , Zhenyu Cheng , Yue Du , Bin Li , Tianyong Liu , Shoujun Zhou

The objective of dense material segmentation is to identify the material categories for every image pixel. Recent studies adopt image patches to extract material features. Although the trained networks can improve the segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Yuwen Heng , Srinandan Dasmahapatra , Hansung Kim

Medical image segmentation has witnessed significant advancements with the emergence of deep learning. However, the reliance of most neural network models on a substantial amount of annotated data remains a challenge for medical image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Xiaoxiao Wu , Xiaowei Chen , Zhenguo Gao , Shulei Qu , Yuanyuan Qiu

Transformers have recently gained attention in the computer vision domain due to their ability to model long-range dependencies. However, the self-attention mechanism, which is the core part of the Transformer model, usually suffers from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Reza Azad , René Arimond , Ehsan Khodapanah Aghdam , Amirhossein Kazerouni , Dorit Merhof

Medical image recognition serves as a key way to aid in clinical diagnosis, enabling more accurate and timely identification of diseases and abnormalities. Vision transformer-based approaches have proven effective in handling various…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Zunhui Xia , Hongxing Li , Libin Lan

Medical image segmentation plays a crucial role in clinical diagnosis and treatment planning. Although models based on convolutional neural networks (CNNs) and Transformers have achieved remarkable success in medical image segmentation…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Jiashu Xu

Synthesizing high-quality dynamic medical videos remains a significant challenge due to the need for modeling both spatial consistency and temporal dynamics. Existing Transformer-based approaches face critical limitations, including…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Huihan Wang , Zhiwen Yang , Hui Zhang , Dan Zhao , Bingzheng Wei , Yan Xu

Owing to the success of transformer models, recent works study their applicability in 3D medical segmentation tasks. Within the transformer models, the self-attention mechanism is one of the main building blocks that strives to capture…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Abdelrahman Shaker , Muhammad Maaz , Hanoona Rasheed , Salman Khan , Ming-Hsuan Yang , Fahad Shahbaz Khan

Medical image segmentation is vital to the area of medical imaging because it enables professionals to more accurately examine and understand the information offered by different imaging modalities. The technique of splitting a medical…

Image and Video Processing · Electrical Eng. & Systems 2024-09-01 Aitik Gupta , Joydip Dhar

Although transformer is preferred in natural language processing, some studies has only been applied to the field of medical imaging in recent years. For its long-term dependency, the transformer is expected to contribute to unconventional…

Image and Video Processing · Electrical Eng. & Systems 2024-09-17 Jing Xu

Computer-aided medical image segmentation has been applied widely in diagnosis and treatment to obtain clinically useful information of shapes and volumes of target organs and tissues. In the past several years, convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Yixuan Wu , Kuanlun Liao , Jintai Chen , Jinhong Wang , Danny Z. Chen , Honghao Gao , Jian Wu

Recent deep multi-view stereo (MVS) methods have widely incorporated transformers into cascade network for high-resolution depth estimation, achieving impressive results. However, existing transformer-based methods are constrained by their…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Sicheng Wang , Hao Jiang , Lei Xiang

Image super-resolution (SR) has significantly advanced through the adoption of Transformer architectures. However, conventional techniques aimed at enlarging the self-attention window to capture broader contexts come with inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Chengxing Xie , Xiaoming Zhang , Linze Li , Yuqian Fu , Biao Gong , Tianrui Li , Kai Zhang

Medical imaging segmentation plays a significant role in the automatic recognition and analysis of lesions. State-of-the-art methods, particularly those utilizing transformers, have been prominently adopted in 3D semantic segmentation due…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Shengbo Tan , Zeyu Zhang , Ying Cai , Daji Ergu , Lin Wu , Binbin Hu , Pengzhang Yu , Yang Zhao

Understanding the morphological structure of medical images and precisely segmenting the region of interest or abnormality is an important task that can assist in diagnosis. However, the unique properties of medical imaging make clear…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Sungmin Kang , Jaeha Song , Jihie Kim

Medical image segmentation is important for computer-aided diagnosis. Good segmentation demands the model to see the big picture and fine details simultaneously, i.e., to learn image features that incorporate large context while keep high…

Image and Video Processing · Electrical Eng. & Systems 2021-06-03 Shaohua Li , Xiuchao Sui , Xiangde Luo , Xinxing Xu , Yong Liu , Rick Goh