English
Related papers

Related papers: Cross-Modality Neuroimage Synthesis: A Survey

200 papers

Magnetic resonance imaging (MRI) has greatly advanced neuroscience research and clinical diagnostics. However, imaging data collected across different scanners, acquisition protocols, or imaging sites often exhibit substantial…

Image and Video Processing · Electrical Eng. & Systems 2026-04-02 Qinqin Yang , Firoozeh Shomal-Zadeh , Ali Gholipour

Extrapolating fine-grained pixel-level correspondences in a fully unsupervised manner from a large set of misaligned images can benefit several computer vision and graphics problems, e.g. co-segmentation, super-resolution, image edit…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Roberto Annunziata , Christos Sagonas , Jacques Cali

Medical image analysis using deep neural networks has been actively studied. Deep neural networks are trained by learning data. For accurate training of deep neural networks, the learning data should be sufficient, of good quality, and…

Image and Video Processing · Electrical Eng. & Systems 2021-01-05 Sunho Kim , Byungjai Kim , HyunWook Park

Data-driven approaches to assist operating room (OR) workflow analysis depend on large curated datasets that are time consuming and expensive to collect. On the other hand, we see a recent paradigm shift from supervised learning to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Muhammad Abdullah Jamal , Omid Mohareri

Deep learning-based image fusion approaches have obtained wide attention in recent years, achieving promising performance in terms of visual perception. However, the fusion module in the current deep learning-based methods suffers from two…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Dongyu Rao , Xiao-Jun Wu , Tianyang Xu , Guoyang Chen

Optical neuroimaging is a vital tool for understanding the brain structure and the connection between regions and nuclei. However, the image noise introduced in the sample preparation and the imaging system hinders the extraction of the…

Image and Video Processing · Electrical Eng. & Systems 2021-09-23 Tianfang Zhu , Yue Guan , Anan Li

Unsupervised cross-modality domain adaptation is a challenging task in medical image analysis, and it becomes more challenging when source and target domain data are collected from multiple institutions. In this paper, we present our…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Han Liu , Yubo Fan , Zhoubing Xu , Benoit M. Dawant , Ipek Oguz

Medical image synthesis remains challenging due to misalignment noise during training. Existing methods have attempted to address this challenge by incorporating a registration-guided module. However, these methods tend to overlook the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Chuanpu Li , Zeli Chen , Yiwen Zhang , Liming Zhong , Wei Yang

A key challenge in training neural networks for a given medical imaging task is often the difficulty of obtaining a sufficient number of manually labeled examples. In contrast, textual imaging reports, which are often readily available in…

Machine Learning · Computer Science 2022-01-31 Gongbo Liang , Connor Greenwell , Yu Zhang , Xiaoqin Wang , Ramakanth Kavuluru , Nathan Jacobs

Cross-modal alignment aims to map heterogeneous modalities into a shared latent space, as exemplified by models like CLIP, which benefit from large-scale image-text pretraining for strong recognition capabilities. However, when operating in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Jiaxiang Liu , Yuan Wang , Jiawei Du , Joey Tianyi Zhou , Mingkun Xu , Zuozhu Liu

The rapid evolution of deep learning has significantly advanced the field of medical image analysis. However, despite these achievements, the further enhancement of deep learning models for medical image analysis faces a significant…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Suruchi Kumari , Pravendra Singh

In the clinical treatment of mood disorders, the complex behavioral symptoms presented by patients and variability of patient response to particular medication classes can create difficulties in providing fast and reliable treatment when…

Machine Learning · Computer Science 2024-02-13 Bradley T. Baker , Mustafa S. Salman , Zening Fu , Armin Iraji , Elizabeth Osuch , Jeremy Bockholt , Vince D. Calhoun

Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Lin Liu , Xinxin Fan , Chulong Zhang , Jingjing Dai , Yaoqin Xie , Xiaokun Liang

Existing multimodal conditional image synthesis (MCIS) methods generate images conditioned on any combinations of various modalities that require all of them must be exactly conformed, hindering the synthesis controllability and leaving the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Jianbin Zheng , Daqing Liu , Chaoyue Wang , Minghui Hu , Zuopeng Yang , Changxing Ding , Dacheng Tao

Multimodal brain magnetic resonance (MR) imaging is indispensable in neuroscience and neurology. However, due to the accessibility of MRI scanners and their lengthy acquisition time, multimodal MR images are not commonly available. Current…

Image and Video Processing · Electrical Eng. & Systems 2024-09-26 Yulin Wang , Honglin Xiong , Kaicong Sun , Shuwei Bai , Ling Dai , Zhongxiang Ding , Jiameng Liu , Qian Wang , Qian Liu , Dinggang Shen

Multimodal functional neuroimaging enables systematic analysis of brain mechanisms and provides discriminative representations for brain-computer interface (BCI) decoding. However, its acquisition is constrained by high costs and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Weiheng Yao , Xuhang Chen , Shuqiang Wang

Many applications in image-guided surgery and therapy require fast and reliable non-linear, multi-modal image registration. Recently proposed unsupervised deep learning-based registration methods have demonstrated superior performance…

Image and Video Processing · Electrical Eng. & Systems 2022-10-07 Gerard Snaauw , Michele Sasdelli , Gabriel Maicas , Stephan Lau , Johan Verjans , Mark Jenkinson , Gustavo Carneiro

Multi-modal magnetic resonance imaging (MRI) is essential for providing complementary information about brain anatomy and pathology, leading to more accurate diagnoses. However, obtaining high-quality multi-modal MRI in a clinical setting…

Image and Video Processing · Electrical Eng. & Systems 2025-04-15 Minjoo Lim , Bogyeong Kang , Tae-Eui Kam

Retrospective analysis of brain MRI scans acquired in the clinic has the potential to enable neuroimaging studies with sample sizes much larger than those found in research datasets. However, analysing such clinical images "in the wild" is…

Image and Video Processing · Electrical Eng. & Systems 2023-01-06 Benjamin Billot , Magdamo Colin , Sean E. Arnold , Sudeshna Das , Juan. E. Iglesias

Analyzing microscopy images to extract biological object properties (e.g., their morphological organization, temporal dynamics, and population density) is fundamental to various biomedical research. Yet conducting this manually is costly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Xiaofei Hui , Haoxuan Qu , Hossein Rahmani , Shuohong Wang , Jeff W. Lichtman , Jun Liu