English
Related papers

Related papers: Cross-Modality Neuroimage Synthesis: A Survey

200 papers

ChronoMID builds on the success of cross-modal convolutional neural networks (X-CNNs), making the novel application of the technique to medical imaging data. Specifically, this paper presents and compares alternative approaches - timestamps…

Image and Video Processing · Electrical Eng. & Systems 2020-07-01 Alexander G. Rakowski , Petar Veličković , Enrico Dall'Ara , Pietro Liò

Self-supervised image denoising techniques emerged as convenient methods that allow training denoising models without requiring ground-truth noise-free data. Existing methods usually optimize loss metrics that are calculated from multiple…

The success of many computer vision tasks lies in the ability to exploit the interdependency between different image modalities such as intensity and depth. Fusing corresponding information can be achieved on several levels, and one…

Computer Vision and Pattern Recognition · Computer Science 2014-06-26 Martin Kiechle , Tim Habigt , Simon Hawe , Martin Kleinsteuber

Brain tumor represents one of the most fatal cancers around the world, and is very common in children and the elderly. Accurate identification of the type and grade of tumor in the early stages plays an important role in choosing a precise…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Dunyuan Xu , Xi Wang , Jinyue Cai , Pheng-Ann Heng

Non-rigid inter-modality registration can facilitate accurate information fusion from different modalities, but it is challenging due to the very different image appearances across modalities. In this paper, we propose to train a non-rigid…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Xiaohuan Cao , Jianhua Yang , Li Wang , Zhong Xue , Qian Wang , Dinggang Shen

Multimodal deep learning systems which employ multiple modalities like text, image, audio, video, etc., are showing better performance in comparison with individual modalities (i.e., unimodal) systems. Multimodal machine learning involves…

Machine Learning · Computer Science 2022-01-19 Anil Rahate , Rahee Walambe , Sheela Ramanna , Ketan Kotecha

Multi-contrast magnetic resonance imaging (MRI) is widely used in clinical practice as each contrast provides complementary information. However, the availability of each imaging contrast may vary amongst patients, which poses challenges to…

Image and Video Processing · Electrical Eng. & Systems 2023-03-31 Jiang Liu , Srivathsa Pasumarthi , Ben Duffy , Enhao Gong , Keshav Datta , Greg Zaharchuk

Multi-contrast super-resolution (MCSR) is crucial for enhancing MRI but current deep learning methods are limited. They typically require large, paired low- and high-resolution (LR/HR) training datasets, which are scarce, and are trained…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Yinzhe Wu , Hongyu Rui , Fanwen Wang , Jiahao Huang , Zhenxuan Zhang , Haosen Zhang , Zi Wang , Guang Yang

Feature matching is a cornerstone task in computer vision, essential for applications such as image retrieval, stereo matching, 3D reconstruction, and SLAM. This survey comprehensively reviews modality-based feature matching, exploring…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Weide Liu , Wei Zhou , Jun Liu , Ping Hu , Jun Cheng , Jungong Han , Weisi Lin

Harmonization of T1-weighted MR images across different scanners is crucial for ensuring consistency in neuroimaging studies. This study introduces a novel approach to direct image harmonization, moving beyond feature standardization to…

Modern medicine requires generalised approaches to the synthesis and integration of multimodal data, often at different biological scales, that can be applied to a variety of evidence structures, such as complex disease analyses and…

Quantitative Methods · Quantitative Biology 2019-11-11 Devin Taylor , Simeon Spasov , Pietro Liò

The classification of medical images is a pivotal aspect of disease diagnosis, often enhanced by deep learning techniques. However, traditional approaches typically focus on unimodal medical image data, neglecting the integration of diverse…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Jun-En Ding , Chien-Chin Hsu , Chi-Hsiang Chu , Shuqiang Wang , Feng Liu

Though performed almost effortlessly by humans, segmenting 2D gray-scale or color images into respective regions of interest (e.g.~background, objects, or portions of objects) constitutes one of the greatest challenges in science and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Alexandre Benatti , Luciano da F. Costa

Multimodal imaging has transformed neuroscience research. While it presents unprecedented opportunities, it also imposes serious challenges. Particularly, it is difficult to combine the merits of the interpretability attributed to a simple…

Methodology · Statistics 2021-11-25 Xiaowu Dai , Lexin Li

Accurate identification of protein nucleic-acid-binding residues poses a significant challenge with important implications for various biological processes and drug design. Many typical computational methods for protein analysis rely on a…

Biomolecules · Quantitative Biology 2023-12-21 Linglin Jing , Sheng Xu , Yifan Wang , Yuzhe Zhou , Tao Shen , Zhigang Ji , Hui Fang , Zhen Li , Siqi Sun

Cross-modal retrieval is the task of retrieving samples of a given modality by using queries of a different one. Due to the wide range of practical applications, the problem has been mainly focused on the vision and language case, e.g. text…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Jorge Sánchez , Rodrigo Laguna

In MRI, images of the same contrast (e.g., T$_1$) from the same subject can exhibit noticeable differences when acquired using different hardware, sequences, or scan parameters. These differences in images create a domain gap that needs to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-17 Hwihun Jeong , Heejoon Byun , Dong Un Kang , Jongho Lee

Recently, medical image synthesis gains more and more popularity, along with the rapid development of generative models. Medical image synthesis aims to generate an unacquired image modality, often from other observed data modalities.…

Image and Video Processing · Electrical Eng. & Systems 2025-07-04 Zhe Xiong , Qiaoqiao Ding , Xiaoqun Zhang

Learning-based synthetic multi-contrast MRI commonly involves deep models trained using high-quality images of source and target contrasts, regardless of whether source and target domain samples are paired or unpaired. This results in…

Image and Video Processing · Electrical Eng. & Systems 2021-05-13 Mahmut Yurt , Salman Ul Hassan Dar , Muzaffer Özbey , Berk Tınaz , Kader Karlı Oğuz , Tolga Çukur

Image denoising is of great importance for medical imaging system, since it can improve image quality for disease diagnosis and downstream image analyses. In a variety of applications, dynamic imaging techniques are utilized to capture the…

Image and Video Processing · Electrical Eng. & Systems 2021-06-24 Junshen Xu , Elfar Adalsteinsson