English
Related papers

Related papers: Multi-modal brain MRI synthesis based on SwinUNETR

200 papers

Multimodal MRI offers complementary multi-scale information to characterize the brain structure. However, it remains challenging to effectively integrate multimodal MRI while achieving neuroscience interpretability. Here we propose to use…

Neurons and Cognition · Quantitative Biology 2025-12-15 Chengzhi Xia , Jianwei Chen , Yixuan Jiang , Qi Yan , Chao Li

Multi-modality imaging is widely used in clinical practice and biomedical research to gain a comprehensive understanding of an imaging subject. Currently, multi-modality imaging is accomplished by post hoc fusion of independently…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Lingting Zhu , Yizheng Chen , Lianli Liu , Lei Xing , Lequan Yu

Both functional and structural magnetic resonance imaging (fMRI and sMRI) are widely used for the diagnosis of mental disorder. However, combining complementary information from these two modalities is challenging due to their…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Ziyu Zhou , Anton Orlichenko , Gang Qu , Zening Fu , Vince D Calhoun , Zhengming Ding , Yu-Ping Wang

Automated brain tumor segmentation methods have become well-established and reached performance levels offering clear clinical utility. These methods typically rely on four input magnetic resonance imaging (MRI) modalities: T1-weighted…

This paper presents an annotated dataset of brain MRI images designed to advance the field of brain symmetry study. Magnetic resonance imaging (MRI) has gained interest in analyzing brain symmetry in neonatal infants, and challenges remain…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Arnaud Gucciardi , Safouane El Ghazouali , Francesca Venturini , Vida Groznik , Umberto Michelucci

Resting-state functional magnetic resonance imaging (rs-fMRI) can reflect spontaneous neural activities in brain and is widely used for brain disorder analysis.Previous studies propose to extract fMRI representations through diverse…

Quantitative Methods · Quantitative Biology 2023-06-27 Qianqian Wang , Wei Wang , Yuqi Fang , P. -T. Yap , Hongtu Zhu , Hong-Jun Li , Lishan Qiao , Mingxia Liu

Breast cancer is one of the leading causes of cancer-related mortality in women, and early detection is essential for improving outcomes. Magnetic resonance imaging (MRI) is a highly sensitive tool for breast cancer detection, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Smriti Joshi , Lidia Garrucho , Richard Osuala , Oliver Diaz , Karim Lekadir

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

Understanding brain disorders is crucial for accurate clinical diagnosis and treatment. Recent advances in Multimodal Large Language Models (MLLMs) offer a promising approach to interpreting medical images with the support of text…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Jing Zhang , Xiaowei Yu , Yanjun Lyu , Lu Zhang , Tong Chen , Chao Cao , Yan Zhuang , Minheng Chen , Tianming Liu , Dajiang Zhu

Convolutional neural networks (CNNs) are good at extracting contexture features within certain receptive fields, while transformers can model the global long-range dependency features. By absorbing the advantage of transformer and the merit…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Zhengyi Liu , Yacheng Tan , Qian He , Yun Xiao

Fetal brain magnetic resonance imaging (MRI) offers exquisite images of the developing brain but is not suitable for second-trimester anomaly screening, for which ultrasound (US) is employed. Although expert sonographers are adept at…

Image and Video Processing · Electrical Eng. & Systems 2020-08-21 Jianbo Jiao , Ana I. L. Namburete , Aris T. Papageorghiou , J. Alison Noble

Accurate medical image segmentation commonly requires effective learning of the complementary information from multimodal data. However, in clinical practice, we often encounter the problem of missing imaging modalities. We tackle this…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Cheng Chen , Qi Dou , Yueming Jin , Hao Chen , Jing Qin , Pheng-Ann Heng

Brain Tumor Segmentation from magnetic resonance imaging (MRI) is a critical technique for early diagnosis. However, rather than having complete four modalities as in BraTS dataset, it is common to have missing modalities in clinical…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Yan Shen , Mingchen Gao

Multimodal medical image fusion facilitates comprehensive diagnosis by aggregating complementary structural and functional information, but its effectiveness is limited by resolution degradation and modality discrepancies. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Fayaz Ali Dharejo , Sharif S. M. A. , Aiman Khalil , Nachiket Chaudhary , Rizwan Ali Naqvi , Radu Timofte

The integration of deep learning based systems in clinical practice is often impeded by challenges rooted in limited and heterogeneous medical datasets. In addition, the field has increasingly prioritized marginal performance gains on a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Sebastian Doerrich , Francesco Di Salvo , Julius Brockmann , Christian Ledig

Synthesizing MR imaging sequences is highly relevant in clinical practice, as single sequences are often missing or are of poor quality (e.g. due to motion). Naturally, the idea arises that a target modality would benefit from multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Hongwei Li , Johannes C. Paetzold , Anjany Sekuboyina , Florian Kofler , Jianguo Zhang , Jan S. Kirschke , Benedikt Wiestler , Bjoern Menze

Multi-sequence MRI is valuable in clinical settings for reliable diagnosis and treatment prognosis, but some sequences may be unusable or missing for various reasons. To address this issue, MRI synthesis is a potential solution. Recent deep…

Image and Video Processing · Electrical Eng. & Systems 2023-07-04 Luyi Han , Tianyu Zhang , Yunzhi Huang , Haoran Dou , Xin Wang , Yuan Gao , Chunyao Lu , Tan Tao , Ritse Mann

We propose a Multifaceted Resilient Network(MRNet), a novel architecture developed for medical image-to-image translation that outperforms state-of-the-art methods in MRI-to-CT and MRI-to-MRI conversion. MRNet leverages the Segment Anything…

Image and Video Processing · Electrical Eng. & Systems 2024-12-05 Hyojeong Lee , Youngwan Jo , Inpyo Hong , Sanghyun Park

Enhancing scene understanding in adverse visibility conditions remains a critical challenge for surveillance and autonomous navigation systems. Conventional imaging modalities, such as RGB and thermal infrared (MWIR / LWIR), when fused,…

Machine Learning · Computer Science 2025-11-25 Muhammad Ishfaq Hussain , Ma Van Linh , Zubia Naz , Unse Fatima , Yeongmin Ko , Moongu Jeon

Early detection and classifying brain tumors using Magnetic Resonance Imaging (MRI) images is highly important but difficult to extract in medical images. Convolutional Neural Networks (CNNs) are good at capturing both local texture and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Syed Ibad Hasnain , Muhammad Faris , Hafiza Syeda Yusra Tirmizi , Rabail Khowaja , Hafsa Israr