English
Related papers

Related papers: Multi-modal brain MRI synthesis based on SwinUNETR

200 papers

Brain network analysis has emerged as pivotal method for gaining a deeper understanding of brain functions and disease mechanisms. Despite the existence of various network construction approaches, shortcomings persist in the learning of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Yongcheng Zong , Shuqiang Wang

Deep neural networks continue to advance the state-of-the-art of image recognition tasks with various methods. However, applications of these methods to multimodality remain limited. We present Multimodal Residual Networks (MRN) for the…

Computer Vision and Pattern Recognition · Computer Science 2016-09-01 Jin-Hwa Kim , Sang-Woo Lee , Dong-Hyun Kwak , Min-Oh Heo , Jeonghee Kim , Jung-Woo Ha , Byoung-Tak Zhang

Multi-modal magnetic resonance imaging (MRI) provides rich, complementary information for analyzing diseases. However, the practical challenges of acquiring multiple MRI modalities, such as cost, scan time, and safety considerations, often…

Image and Video Processing · Electrical Eng. & Systems 2024-09-16 Zhaohu Xing , Sicheng Yang , Sixiang Chen , Tian Ye , Yijun Yang , Jing Qin , Lei Zhu

Understanding brain dynamics is important for neuroscience and mental health. Functional magnetic resonance imaging (fMRI) enables the measurement of neural activities through blood-oxygen-level-dependent (BOLD) signals, which represent…

Neurons and Cognition · Quantitative Biology 2025-06-16 Yifei Sun , Daniel Chahine , Qinghao Wen , Tianming Liu , Xiang Li , Yixuan Yuan , Fernando Calamante , Jinglei Lv

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

Cancer survival prediction requires integrating pathological Whole Slide Images (WSIs) and genomic profiles, a challenging task due to the inherent heterogeneity and the complexity of modeling both inter- and intra-modality interactions.…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Mingxin Liu , Chengfei Cai , Jun Li , Pengbo Xu , Jinze Li , Jiquan Ma , Jun Xu

Generative adversarial models with convolutional neural network (CNN) backbones have recently been established as state-of-the-art in numerous medical image synthesis tasks. However, CNNs are designed to perform local processing with…

Image and Video Processing · Electrical Eng. & Systems 2022-07-21 Onat Dalmaz , Mahmut Yurt , Tolga Çukur

Capturing global contextual information plays a critical role in breast ultrasound (BUS) image classification. Although convolutional neural networks (CNNs) have demonstrated reliable performance in tumor classification, they have inherent…

Image and Video Processing · Electrical Eng. & Systems 2023-08-07 Bryar Shareef , Min Xian , Aleksandar Vakanski , Haotian Wang

Recent advancements in the acquisition of various brain data sources have created new opportunities for integrating multimodal brain data to assist in early detection of complex brain disorders. However, current data integration approaches…

Image and Video Processing · Electrical Eng. & Systems 2023-05-26 Reza Shirkavand , Liang Zhan , Heng Huang , Li Shen , Paul M. Thompson

Image super-resolution reconstruction is an important task in the field of image processing technology, which can restore low resolution image to high quality image with high resolution. In recent years, deep learning has been applied in…

Image and Video Processing · Electrical Eng. & Systems 2022-10-21 Bolong Zhang , Juan Chen , Quan Wen

In recent years, many research achievements are made in the medical image fusion field. Medical Image fusion means that several of various modality image information is comprehended together to form one image to express its information. The…

Image and Video Processing · Electrical Eng. & Systems 2020-07-23 T Deepika

Magnetic Resonance (MR) images of different modalities can provide complementary information for clinical diagnosis, but whole modalities are often costly to access. Most existing methods only focus on synthesizing missing images between…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Bingyu Xin , Yifan Hu , Yefeng Zheng , Hongen Liao

Spiking Neural Networks (SNNs) are efficient computation models to perform spatio-temporal pattern recognition on {resource}- and {power}-constrained platforms. SNNs executed on neuromorphic hardware can further reduce energy consumption of…

Neural and Evolutionary Computing · Computer Science 2020-12-01 Adarsha Balaji , Anup Das

This study proposes an efficient Densely Swin Hybrid (EDSH) framework for brain tumor MRI analysis, designed to jointly capture fine grained texture patterns and long range contextual dependencies. Two tumor aware experimental setups are…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Muhammad Ali Shah , Muhammad Mansoor Alam , Saddam Hussain Khan

Despite the successes of deep neural networks on many challenging vision tasks, they often fail to generalize to new test domains that are not distributed identically to the training data. The domain adaptation becomes more challenging for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Devavrat Tomar , Manana Lortkipanidze , Guillaume Vray , Behzad Bozorgtabar , Jean-Philippe Thiran

Over the past two decades, machine analysis of medical imaging has advanced rapidly, opening up significant potential for several important medical applications. As complicated diseases increase and the number of cases rises, the role of…

Image and Video Processing · Electrical Eng. & Systems 2024-05-08 Fares Bougourzi , Fadi Dornaika , Cosimo Distante , Abdelmalik Taleb-Ahmed

Accurate and reliable brain tumor segmentation, particularly when dealing with missing modalities, remains a critical challenge in medical image analysis. Previous studies have not fully resolved the challenges of tumor boundary…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Shenghao Zhu , Yifei Chen , Weihong Chen , Yuanhan Wang , Chang Liu , Shuo Jiang , Feiwei Qin , Changmiao Wang

Magnetic Resonance Imaging (MRI) is crucial for clinical diagnostics but is hindered by prolonged scan times. Current deep learning models enhance MRI reconstruction but are often memory-intensive and unsuitable for resource-limited…

Image and Video Processing · Electrical Eng. & Systems 2025-07-17 Haosen Zhang , Jiahao Huang , Yinzhe Wu , Congren Dai , Fanwen Wang , Zhenxuan Zhang , Guang Yang

Multimodal MRI is essential for brain tumor segmentation, yet missing modalities in clinical practice cause existing methods to exhibit >40% performance variance across modality combinations, rendering them clinically unreliable. We propose…

Image and Video Processing · Electrical Eng. & Systems 2026-01-28 Chengxiang Guo , Jian Wang , Junhua Fei , Xiao Li , Chunling Chen , Yun Jin

Vision foundation models like DINOv2 demonstrate remarkable potential in medical imaging despite their origin in natural image domains. However, their design inherently works best for uni-modal image analysis, limiting their effectiveness…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Daniel Scholz , Ayhan Can Erdur , Viktoria Ehm , Anke Meyer-Baese , Jan C. Peeken , Daniel Rueckert , Benedikt Wiestler