English
Related papers

Related papers: Multi-modal brain MRI synthesis based on SwinUNETR

200 papers

This review paper delves into the present state of medical imaging, with a specific focus on the use of deep learning techniques for brain image synthesis. The need for medical image synthesis to improve diagnostic accuracy and decrease…

Image and Video Processing · Electrical Eng. & Systems 2023-09-20 Shubham Singh , Ammar Ranapurwala , Mrunal Bewoor , Sheetal Patil , Satyam Rai

Brain tumor segmentation (BTS) in magnetic resonance image (MRI) is crucial for brain tumor diagnosis, cancer management and research purposes. With the great success of the ten-year BraTS challenges as well as the advances of CNN and…

Image and Video Processing · Electrical Eng. & Systems 2022-07-18 Jianwei Lin , Jiatai Lin , Cheng Lu , Hao Chen , Huan Lin , Bingchao Zhao , Zhenwei Shi , Bingjiang Qiu , Xipeng Pan , Zeyan Xu , Biao Huang , Changhong Liang , Guoqiang Han , Zaiyi Liu , Chu Han

The existing deep learning fusion methods mainly concentrate on the convolutional neural networks, and few attempts are made with transformer. Meanwhile, the convolutional operation is a content-independent interaction between the image and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Zhishe Wang , Yanlin Chen , Wenyu Shao , Hui Li , Lei Zhang

Since their emergence, Convolutional Neural Networks (CNNs) have made significant strides in medical image analysis. However, the local nature of the convolution operator may pose a limitation for capturing global and long-range…

Image and Video Processing · Electrical Eng. & Systems 2024-04-01 Abdul Rehman Khan , Asifullah Khan

Deciphering how visual stimuli are transformed into cortical responses is a fundamental challenge in computational neuroscience. This visual-to-neural mapping is inherently a one-to-many relationship, as identical visual inputs reliably…

Machine Learning · Computer Science 2025-11-04 Weijian Mai , Jiamin Wu , Yu Zhu , Zhouheng Yao , Dongzhan Zhou , Andrew F. Luo , Qihao Zheng , Wanli Ouyang , Chunfeng Song

Medical segmentation has grown exponentially through the advent of a fully convolutional network (FCN), and we have now reached a turning point through the success of Transformer. However, the different characteristics of the modality have…

Image and Video Processing · Electrical Eng. & Systems 2023-11-03 Jihoon Cho , Jinah Park

For the first time, we propose using a multiple instance learning based convolution-free transformer model, called Multiple Instance Neuroimage Transformer (MINiT), for the classification of T1weighted (T1w) MRIs. We first present several…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Ayush Singla , Qingyu Zhao , Daniel K. Do , Yuyin Zhou , Kilian M. Pohl , Ehsan Adeli

Multimodal human action recognition based on RGB and skeleton data fusion, while effective, is constrained by significant limitations such as high computational complexity, excessive memory consumption, and substantial energy demands,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Naichuan Zheng , Hailun Xia , Zeyu Liang , Yuchen Du

Cardiac Magnetic Resonance Imaging is commonly used for the assessment of the cardiac anatomy and function. The delineations of left and right ventricle blood pools and left ventricular myocardium are important for the diagnosis of cardiac…

Image and Video Processing · Electrical Eng. & Systems 2022-09-07 Michal K. Grzeszczyk , Szymon Płotka , Arkadiusz Sitek

Automated medical image segmentation is becoming increasingly crucial to modern clinical practice, driven by the growing demand for precise diagnosis, the push towards personalized treatment plans, and the advancements in machine learning…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Tan-Hanh Pham , Xianqi Li , Kim-Doang Nguyen

In clinical practice, multi-modal magnetic resonance imaging (MRI) with different contrasts is usually acquired in a single study to assess different properties of the same region of interest in the human body. The whole acquisition process…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Kai Xuan , Lei Xiang , Xiaoqian Huang , Lichi Zhang , Shu Liao , Dinggang Shen , Qian Wang

Multimodal magnetic resonance imaging (MRI) provides complementary information for sub-region analysis of brain tumors. Plenty of methods have been proposed for automatic brain tumor segmentation using four common MRI modalities and…

Image and Video Processing · Electrical Eng. & Systems 2023-03-10 Hong Liu , Dong Wei , Donghuan Lu , Jinghan Sun , Liansheng Wang , Yefeng Zheng

Image analysis using more than one modality (i.e. multi-modal) has been increasingly applied in the field of biomedical imaging. One of the challenges in performing the multimodal analysis is that there exist multiple schemes for fusing the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Zhe Guo , Xiang Li , Heng Huang , Ning Guo , Quanzheng Li

Early surgical treatment of brain tumors is crucial in reducing patient mortality rates. However, brain tissue deformation (called brain shift) occurs during the surgery, rendering pre-operative images invalid. As a cost-effective and…

Image and Video Processing · Electrical Eng. & Systems 2023-08-22 Soorena Salari , Amirhossein Rasoulian , Hassan Rivaz , Yiming Xiao

Magnetic resonance imaging (MRI) is a powerful and versatile imaging technique, offering a wide spectrum of information about the anatomy by employing different acquisition modalities. However, in the clinical workflow, it is impractical to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yicheng Wu , Tao Song , Zhonghua Wu , Jin Ye , Zongyuan Ge , Wenjia Bai , Zhaolin Chen , Jianfei Cai

This paper provides a novel 3D medical image segmentation model structure called nnY-Net. This name comes from the fact that our model adds a cross-attention module at the bottom of the U-net structure to form a Y structure. We integrate…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Haixu Liu , Zerui Tao , Wenzhen Dong , Qiuzhuang Sun

Automation of brain tumor segmentation in 3D magnetic resonance images (MRIs) is key to assess the diagnostic and treatment of the disease. In recent years, convolutional neural networks (CNNs) have shown improved results in the task.…

Image and Video Processing · Electrical Eng. & Systems 2021-01-01 Laura Mora Ballestar , Veronica Vilaplana

Magnetic Resonance Imaging (MRI) is a widely used imaging technique to assess brain tumor. Accurately segmenting brain tumor from MR images is the key to clinical diagnostics and treatment planning. In addition, multi-modal MR images can…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Understanding how the brain encodes external stimuli and how these stimuli can be decoded from the measured brain activities are long-standing and challenging questions in neuroscience. In this paper, we focus on reconstructing the complex…

Neurons and Cognition · Quantitative Biology 2022-10-05 Sikun Lin , Thomas Sprague , Ambuj K Singh

The integration of diverse clinical modalities such as medical imaging and the tabular data extracted from patients' Electronic Health Records (EHRs) is a crucial aspect of modern healthcare. Integrative analysis of multiple sources can…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Daniel Duenias , Brennan Nichyporuk , Tal Arbel , Tammy Riklin Raviv