English
Related papers

Related papers: Multi-Modality Generative Adversarial Networks wit…

200 papers

The advancement of generative AI, particularly in medical imaging, confronts the trilemma of ensuring high fidelity, diversity, and efficiency in synthetic data generation. While Generative Adversarial Networks (GANs) have shown promise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Lorenzo Tronchin , Tommy Löfstedt , Paolo Soda , Valerio Guarrasi

Magnetic Resonance Imaging (MRI) is a vital modality for gaining precise anatomical information, and it plays a significant role in medical imaging for diagnosis and therapy planning. Image synthesis problems have seen a revolution in…

Image and Video Processing · Electrical Eng. & Systems 2024-04-16 Drici Mourad , Kazeem Oluwakemi Oseni

Multi-modal medical images provide complementary soft-tissue characteristics that aid in the screening and diagnosis of diseases. However, limited scanning time, image corruption and various imaging protocols often result in incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yue Zhang , Chengtao Peng , Qiuli Wang , Dan Song , Kaiyan Li , S. Kevin Zhou

Compared to traditional methods, Deep Learning (DL) becomes a key technology for computer vision tasks. Synthetic data generation is an interesting use case for DL, especially in the field of medical imaging such as Magnetic Resonance…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Md Sumon Ali , Muzammil Behzad

Magnetic resonance imaging (MRI) is a widely used neuroimaging technique that can provide images of different contrasts (i.e., modalities). Fusing this multi-modal data has proven particularly effective for boosting model performance in…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Tao Zhou , Huazhu Fu , Geng Chen , Jianbing Shen , Ling Shao

High-resolution magnetic resonance images can provide fine-grained anatomical information, but acquiring such data requires a long scanning time. In this paper, a framework called the Fused Attentive Generative Adversarial Networks(FA-GAN)…

Image and Video Processing · Electrical Eng. & Systems 2021-08-29 Mingfeng Jiang , Minghao Zhi , Liying Wei , Xiaocheng Yang , Jucheng Zhang , Yongming Li , Pin Wang , Jiahao Huang , Guang Yang

Magnetic Resonance Imaging (MRI) of the brain has been used to investigate a wide range of neurological disorders, but data acquisition can be expensive, time-consuming, and inconvenient. Multi-site studies present a valuable opportunity to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Harrison Nguyen , Richard W. Morris , Anthony W. Harris , Mayuresh S. Korgoankar , Fabio Ramos

Multimodal magnetic resonance imaging (MRI) can reveal different patterns of human tissue and is crucial for clinical diagnosis. However, limited by cost, noise and manual labeling, obtaining diverse and reliable multimodal MR images…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Li Zhu , Jiawei Jiang , Lin Lu , Jin Li

Due to the lack of available annotated medical images, accurate computer-assisted diagnosis requires intensive Data Augmentation (DA) techniques, such as geometric/intensity transformations of original images; however, those transformed…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Changhee Han , Leonardo Rundo , Ryosuke Araki , Yujiro Furukawa , Giancarlo Mauri , Hideki Nakayama , Hideaki Hayashi

Using multimodal Magnetic Resonance Imaging (MRI) is necessary for accurate brain tumor segmentation. The main problem is that not all types of MRIs are always available in clinical exams. Based on the fact that there is a strong…

Image and Video Processing · Electrical Eng. & Systems 2021-11-11 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

A key challenge in learning from multimodal biological data is missing modalities, where data from one or more modalities are absent for some patients. Existing approaches either exclude patients with missing modalities, impute missing…

Machine Learning · Computer Science 2026-05-19 Sina Tabakhi , Chen , Chen , Haiping Lu

Generative adversarial networks (GANs) are unsupervised Deep Learning approach in the computer vision community which has gained significant attention from the last few years in identifying the internal structure of multimodal medical…

Image and Video Processing · Electrical Eng. & Systems 2020-05-22 Nripendra Kumar Singh , Khalid Raza

Cross-modality image estimation involves the generation of images of one medical imaging modality from that of another modality. Convolutional neural networks (CNNs) have been shown to be useful in identifying, characterising and extracting…

Image and Video Processing · Electrical Eng. & Systems 2021-06-07 Azin Shokraei Fard , David C. Reutens , Viktor Vegh

Magnetic Resonance Imaging (MRI) of the brain can come in the form of different modalities such as T1-weighted and Fluid Attenuated Inversion Recovery (FLAIR) which has been used to investigate a wide range of neurological disorders.…

Machine Learning · Computer Science 2019-12-11 Harrison Nguyen , Simon Luo , Fabio Ramos

In the field of computer vision, multimodal image generation has become a research hotspot, especially the task of integrating text, image, and style. In this study, we propose a multimodal image generation method based on Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chaoyi Tan , Wenqing Zhang , Zhen Qi , Kowei Shih , Xinshi Li , Ao Xiang

Generative adversarial networks (GANs) are a class of unsupervised machine learning algorithms that can produce realistic images from randomly-sampled vectors in a multi-dimensional space. Until recently, it was not possible to generate…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Andrew Beers , James Brown , Ken Chang , J. Peter Campbell , Susan Ostmo , Michael F. Chiang , Jayashree Kalpathy-Cramer

Data augmentation is essential for medical research to increase the size of training datasets and achieve better results. In this work, we experiment three GAN architectures with different loss functions to generate new brain MRIs. The…

Image and Video Processing · Electrical Eng. & Systems 2020-02-10 Antoine Delplace

Every year thousands of patients are diagnosed with a glioma, a type of malignant brain tumor. Physicians use MR images as a key tool in the diagnosis and treatment of these patients. Neural networks show great potential to aid physicians…

Image and Video Processing · Electrical Eng. & Systems 2019-10-03 Eric Carver , Zhenzhen Dai , Evan Liang , James Snyder , Ning Wen

MRI cross-modal synthesis involves generating images from one acquisition protocol using another, offering considerable clinical value by reducing scan time while maintaining diagnostic information. This paper presents a comprehensive…

Image and Video Processing · Electrical Eng. & Systems 2026-02-10 Ali Alqutayfi , Sadam Al-Azani

Novel multimodal imaging methods are capable of generating extensive, super high resolution datasets for preclinical research. Yet, a massive lack of annotations prevents the broad use of deep learning to analyze such data. So far, existing…

Image and Video Processing · Electrical Eng. & Systems 2021-04-26 Izabela Horvath , Johannes C. Paetzold , Oliver Schoppe , Rami Al-Maskari , Ivan Ezhov , Suprosanna Shit , Hongwei Li , Ali Ertuerk , Bjoern H. Menze