English
Related papers

Related papers: Multi-modal brain MRI synthesis based on SwinUNETR

200 papers

This study aims to address the problem of incomplete information in unimodal images for semantic segmentation and object detection tasks. Existing multimodal fusion methods suffer from limited capability in discriminative modeling of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yuchan Jie , Yushen Xu , Xiaosong Li , Huafeng Li , Haishu Tan , Feiping Nie

Segmentation is a crucial step in microscopy image analysis. Numerous approaches have been developed over the past years, ranging from classical segmentation algorithms to advanced deep learning models. While U-Net remains one of the most…

Image and Video Processing · Electrical Eng. & Systems 2024-09-26 Illia Tsiporenko , Pavel Chizhov , Dmytro Fishman

Magnetic Resonance Imaging (MRI) is one of the most flexible and powerful medical imaging modalities. This flexibility does however come at a cost; MRI images acquired at different sites and with different parameters exhibit significant…

Skin cancer segmentation poses a significant challenge in medical image analysis. Numerous existing solutions, predominantly CNN-based, face issues related to a lack of global contextual understanding. Alternatively, some approaches resort…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Shehan Perera , Yunus Erzurumlu , Deepak Gulati , Alper Yilmaz

Unpaired medical image synthesis aims to provide complementary information for an accurate clinical diagnostics, and address challenges in obtaining aligned multi-modal medical scans. Transformer-based models excel in imaging translation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Vu Minh Hieu Phan , Yutong Xie , Bowen Zhang , Yuankai Qi , Zhibin Liao , Antonios Perperidis , Son Lam Phung , Johan W. Verjans , Minh-Son To

Multimodal magnetic resonance imaging (MRI) constitutes the first line of investigation for clinicians in the care of brain tumors, providing crucial insights for surgery planning, treatment monitoring, and biomarker identification.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Lucas Robinet , Ahmad Berjaoui , Elizabeth Cohen-Jonathan Moyal

Deformable image registration plays a fundamental role in medical image analysis by enabling spatial alignment of anatomical structures across subjects. While recent deep learning-based approaches have significantly improved computational…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Jiaqi Shang , Haojin Wu , Yinyi Lai , Zongyu Li , Chenghao Zhang , Jia Guo

Automated medical image segmentation can assist doctors to diagnose faster and more accurate. Deep learning based models for medical image segmentation have made great progress in recent years. However, the existing models fail to…

Image and Video Processing · Electrical Eng. & Systems 2023-04-26 Lei Shi , Tianyu Gao , Zheng Zhang , Junxing Zhang

Magnetic resonance imaging (MRI) noninvasively provides critical information about how human brain structures develop across stages of life. Developmental scientists are particularly interested in the first few years of neurodevelopment.…

Image and Video Processing · Electrical Eng. & Systems 2021-05-31 Xuzhe Zhang , Xinzi He , Jia Guo , Nabil Ettehadi , Natalie Aw , David Semanek , Jonathan Posner , Andrew Laine , Yun Wang

Using multimodal Magnetic Resonance Imaging (MRI) is necessary for accurate brain tumor segmentation. The main problem is that not all types of MRIs are always available in clinical exams. Based on the fact that there is a strong…

Image and Video Processing · Electrical Eng. & Systems 2021-11-11 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Missing data is a common problem in machine learning and in retrospective imaging research it is often encountered in the form of missing imaging modalities. We propose to take into account missing modalities in the design and training of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Karin van Garderen , Marion Smits , Stefan Klein

We present a cross-modality generation framework that learns to generate translated modalities from given modalities in MR images without real acquisition. Our proposed method performs NeuroImage-to-NeuroImage translation (abbreviated as…

Computer Vision and Pattern Recognition · Computer Science 2018-09-12 Qianye Yang , Nannan Li , Zixu Zhao , Xingyu Fan , Eric I-Chao Chang , Yan Xu

Brain tumor segmentation is often based on multiple magnetic resonance imaging (MRI). However, in clinical practice, certain modalities of MRI may be missing, which presents a more difficult scenario. To cope with this challenge, Knowledge…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Tianyi Liu , Zhaorui Tan , Muyin Chen , Xi Yang , Haochuan Jiang , Kaizhu Huang

Precision in identifying and differentiating micro and macro blood vessels in the retina is crucial for the diagnosis of retinal diseases, although it poses a significant challenge. Current autoencoding-based segmentation approaches…

Image and Video Processing · Electrical Eng. & Systems 2024-03-05 Rui Yang , Shunpu Zhang

For medical image semantic segmentation (MISS), Vision Transformers have emerged as strong alternatives to convolutional neural networks thanks to their inherent ability to capture long-range correlations. However, existing research uses…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Qianying Liu , Chaitanya Kaul , Jun Wang , Christos Anagnostopoulos , Roderick Murray-Smith , Fani Deligianni

Vision Transformers (ViT)s have shown great performance in self-supervised learning of global and local representations that can be transferred to downstream applications. Inspired by these results, we introduce a novel self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yucheng Tang , Dong Yang , Wenqi Li , Holger Roth , Bennett Landman , Daguang Xu , Vishwesh Nath , Ali Hatamizadeh

Multimodal magnetic resonance imaging (MRI) is crucial for brain tumor segmentation, with many methods leveraging its four key modalities to capture complementary information for effective sub-region analysis. However, the absence of…

Artificial Intelligence · Computer Science 2026-05-19 Sha Tao , Jiao Pan , Yu Guo , Chao Yao

Multimodal brain networks characterize complex connectivities among different brain regions from both structural and functional aspects and provide a new means for mental disease analysis. Recently, Graph Neural Networks (GNNs) have become…

Neurons and Cognition · Quantitative Biology 2022-05-25 Yanqiao Zhu , Hejie Cui , Lifang He , Lichao Sun , Carl Yang

This study proposes a 3D semantic segmentation method for the spine based on the improved SwinUNETR to improve segmentation accuracy and robustness. Aiming at the complex anatomical structure of spinal images, this paper introduces a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yanlin Xiang , Qingyuan He , Ting Xu , Ran Hao , Jiacheng Hu , Hanchao Zhang

Brain tumor segmentation based on multi-modal magnetic resonance imaging (MRI) plays a pivotal role in assisting brain cancer diagnosis, treatment, and postoperative evaluations. Despite the achieved inspiring performance by existing…

Image and Video Processing · Electrical Eng. & Systems 2022-11-16 Haoran Li , Cheng Li , Weijian Huang , Xiawu Zheng , Yan Xi , Shanshan Wang