English
Related papers

Related papers: Multi-modal brain MRI synthesis based on SwinUNETR

200 papers

Multi-modal MRIs are widely used in neuroimaging applications since different MR sequences provide complementary information about brain structures. Recent works have suggested that multi-modal deep learning analysis can benefit from…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Jiahong Ouyang , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao , Greg Zaharchuk

Accurate brain tumor segmentation from multi-modal magnetic resonance imaging (MRI) is a prerequisite for precise radiotherapy planning and surgical navigation. While recent Transformer-based models such as Swin UNETR have achieved…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yan Zhou , Zhen Huang , Yingqiu Li , Yue Ouyang , Suncheng Xiang , Zehua Wang

Structural magnetic resonance imaging (sMRI) provides accurate estimates of the brain's structural organization and learning invariant brain representations from sMRI is an enduring issue in neuroscience. Previous deep representation…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ning Jiang , Gongshu Wang , Tianyi Yan

Brain tumors remain among the most lethal human diseases, where early detection and accurate classification are critical for effective diagnosis and treatment planning. Although deep learning-based computer-aided diagnostic (CADx) systems…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Mirza Mumtaz Zahoor , Saddam Hussain Khan

Deep learning based single image super resolution (SISR) algorithms has revolutionized the overall diagnosis framework by continually improving the architectural components and training strategies associated with convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-03-15 Fayaz Ali Dharejo , Muhammad Zawish , Farah Deeba Yuanchun Zhou , Kapal Dev , Sunder Ali Khowaja , Nawab Muhammad Faseeh Qureshi

Missing input sequences are common in medical imaging data, posing a challenge for deep learning models reliant on complete input data. In this work, inspired by MultiMAE [2], we develop a masked autoencoder (MAE) paradigm for multi-modal,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Ayhan Can Erdur , Christian Beischl , Daniel Scholz , Jiazhen Pan , Benedikt Wiestler , Daniel Rueckert , Jan C Peeken

Multimodal MRI provides critical complementary information for accurate brain tumor segmentation. However, conventional methods struggle when certain modalities are missing due to issues such as image quality, protocol inconsistencies,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Runze Cheng , Xihang Qiu , Ming Li , Ye Zhang , Chun Li , Fei Yu

Fast MRI aims to reconstruct a high fidelity image from partially observed measurements. Exuberant development in fast MRI using deep learning has been witnessed recently. Meanwhile, novel deep learning paradigms, e.g., Transformer based…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Jiahao Huang , Xiaodan Xing , Zhifan Gao , Guang Yang

Accurate synthesis of computed tomography (CT) images from magnetic resonance imaging (MRI) is clinically valuable for cranial applications such as attenuation correction, radiotherapy planning, and image-guided interventions. However,…

Image and Video Processing · Electrical Eng. & Systems 2026-05-05 Zhuoyao Xin , Yiren Zhang , Christopher Wu , Dong Liu , Chunming Gu , Elena Greco , Erik H. Middlebrooks , Jun Hua , Jia Guo

The integration of machine learning in magnetic resonance imaging (MRI), specifically in neuroimaging, is proving to be incredibly effective, leading to better diagnostic accuracy, accelerated image analysis, and data-driven insights, which…

Multimodal MR image synthesis aims to generate missing modality images by effectively fusing and mapping from a subset of available MRI modalities. Most existing methods adopt an image-to-image translation paradigm, treating multiple…

Image and Video Processing · Electrical Eng. & Systems 2025-04-29 Tao Song , Yicheng Wu , Minhao Hu , Xiangde Luo , Linda Wei , Guotai Wang , Yi Guo , Feng Xu , Shaoting Zhang

Cross modal image syntheses is gaining significant interests for its ability to estimate target images of a different modality from a given set of source images,like estimating MR to MR, MR to CT, CT to PET etc, without the need for an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-02 Deepa Gunashekar , Sailesh Conjeti , Abhijit Guha Roy , Nassir Navab , Kuangyu Shi

Gaining insights into the structural and functional mechanisms of the brain has been a longstanding focus in neuroscience research, particularly in the context of understanding and treating neuropsychiatric disorders such as Schizophrenia…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Badhan Mazumder , Lei Wu , Vince D. Calhoun , Dong Hye Ye

In MRI-based mental disorder diagnosis, most previous studies focus on functional connectivity network (FCN) derived from functional MRI (fMRI). However, the small size of annotated fMRI datasets restricts its wide application. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Xingcan Hu , Wei Wang , Li Xiao

Modeling spatiotemporal brain dynamics from high-dimensional data, such as functional Magnetic Resonance Imaging (fMRI), is a formidable task in neuroscience. Existing approaches for fMRI analysis utilize hand-crafted features, but the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Peter Yongho Kim , Junbeom Kwon , Sunghwan Joo , Sangyoon Bae , Donggyu Lee , Yoonho Jung , Shinjae Yoo , Jiook Cha , Taesup Moon

Brain tumor represents one of the most fatal cancers around the world, and is very common in children and the elderly. Accurate identification of the type and grade of tumor in the early stages plays an important role in choosing a precise…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Dunyuan Xu , Xi Wang , Jinyue Cai , Pheng-Ann Heng

Medical image segmentation is pivotal in healthcare, enhancing diagnostic accuracy, informing treatment strategies, and tracking disease progression. This process allows clinicians to extract critical information from visual data, enabling…

Image and Video Processing · Electrical Eng. & Systems 2024-10-31 Ovais Iqbal Shah , Danish Raza Rizvi , Aqib Nazir Mir

Gliomas are one of the most prevalent types of primary brain tumours, accounting for more than 30\% of all cases and they develop from the glial stem or progenitor cells. In theory, the majority of brain tumours could well be identified…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Reza Azad , Nika Khosravi , Dorit Merhof

Humans interpret and perceive the world by integrating sensory information from multiple modalities, such as vision and hearing. Spiking Neural Networks (SNNs), as brain-inspired computational models, exhibit unique advantages in emulating…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Xiang He , Dongcheng Zhao , Yiting Dong , Guobin Shen , Xin Yang , Yi Zeng

Automatic medical image segmentation has made great progress benefit from the development of deep learning. However, most existing methods are based on convolutional neural networks (CNNs), which fail to build long-range dependencies and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Ailiang Lin , Bingzhi Chen , Jiayu Xu , Zheng Zhang , Guangming Lu