English
Related papers

Related papers: Cross Modality Image Translation In Medical Imagin…

200 papers

Multi-modal images play a crucial role in comprehensive evaluations in medical image analysis providing complementary information for identifying clinically important biomarkers. However, in clinical practice, acquiring multiple modalities…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Jonghun Kim , Hyunjin Park

Intelligent vision is appealing in computer-assisted and robotic surgeries. Vision-based analysis with deep learning usually requires large labeled datasets, but manual data labeling is expensive and time-consuming in medical problems. We…

Image and Video Processing · Electrical Eng. & Systems 2020-08-17 Shan Lin , Fangbo Qin , Yangming Li , Randall A. Bly , Kris S. Moe , Blake Hannaford

Medical image translation (e.g. CT to MR) is a challenging task as it requires I) faithful translation of domain-invariant features (e.g. shape information of anatomical structures) and II) realistic synthesis of target-domain features…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Siyu Liu , Jason A. Dowling , Craig Engstrom , Peter B. Greer , Stuart Crozier , Shekhar S. Chandra

The goal of a speech-to-image transform is to produce a photo-realistic picture directly from a speech signal. Recently, various studies have focused on this task and have achieved promising performance. However, current speech-to-image…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Zhenxing Zhang , Lambert Schomaker

Generative adversarial networks (GANs) offer an effective solution to the image-to-image translation problem, thereby allowing for new possibilities in medical imaging. They can translate images from one imaging modality to another at a low…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Agnieszka Tomczak , Aarushi Gupta , Slobodan Ilic , Nassir Navab , Shadi Albarqouni

In recent years, the use of deep learning is becoming increasingly popular in computer vision. However, the effective training of deep architectures usually relies on huge sets of annotated data. This is critical in the medical field where…

Image and Video Processing · Electrical Eng. & Systems 2019-07-30 Paolo Andreini , Simone Bonechi , Monica Bianchini , Alessandro Mecocci , Franco Scarselli , Andrea Sodi

This paper presents Fd-CycleGAN, an image-to-image (I2I) translation framework that enhances latent representation learning to approximate real data distributions. Building upon the foundation of CycleGAN, our approach integrates Local…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Shivangi Nigam , Adarsh Prasad Behera , Shekhar Verma , P. Nagabhushan

Generative models such as Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs) play an increasingly important role in medical image analysis. The latent spaces of these models often show semantically meaningful…

Image and Video Processing · Electrical Eng. & Systems 2022-07-21 Julian Schön , Raghavendra Selvan , Jens Petersen

Image-to-image translation is a new field in computer vision with multiple potential applications in the medical domain. However, for supervised image translation frameworks, co-registered datasets, paired in a pixel-wise sense, are…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Karim Armanious , Chenming Jiang , Sherif Abdulatif , Thomas Küstner , Sergios Gatidis , Bin Yang

Given an input image from a source domain and a guidance image from a target domain, unsupervised many-to-many image-to-image (UMMI2I) translation methods seek to generate a plausible example from the target domain that preserves…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Dina Bashkirova , Ben Usman , Kate Saenko

Deep networks are now ubiquitous in large-scale multi-center imaging studies. However, the direct aggregation of images across sites is contraindicated for downstream statistical and deep learning-based image analysis due to inconsistent…

Image and Video Processing · Electrical Eng. & Systems 2021-04-16 Mengwei Ren , Neel Dey , James Fishbaugh , Guido Gerig

Generative Adversarial Networks (GANs) are a class of neural networks that have been widely used in the field of image-to-image translation. In this paper, we propose a streamlined image-to-image translation network with a simpler…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Guangzong Chen , Mingui Sun , Zhi-Hong Mao , Kangni Liu , Wenyan Jia

Generative AI is transforming image synthesis, enabling the creation of high-quality, diverse, and photorealistic visuals across industries like design, media, healthcare, and autonomous systems. Advances in techniques such as…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Fouad Bousetouane

Convolutional Neural Networks (CNNs) can play a key role in Medical Image Analysis under large-scale annotated datasets. However, preparing such massive dataset is demanding. In this context, Generative Adversarial Networks (GANs) can…

Image and Video Processing · Electrical Eng. & Systems 2021-06-04 Changhee Han

Sketch-to-image (S2I) translation plays an important role in image synthesis and manipulation tasks, such as photo editing and colorization. Some specific S2I translation including sketch-to-photo and sketch-to-painting can be used as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Jialu Huang , Jing Liao , Zhifeng Tan , Sam Kwong

The Diffusion Model (DM) has emerged as the SOTA approach for image synthesis. However, the existing DM cannot perform well on some image-to-image translation (I2I) tasks. Different from image synthesis, some I2I tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Bin Xia , Yulun Zhang , Shiyin Wang , Yitong Wang , Xinglong Wu , Yapeng Tian , Wenming Yang , Radu Timotfe , Luc Van Gool

Text-to-image generation (T2I) refers to the text-guided generation of high-quality images. In the past few years, T2I has attracted widespread attention and numerous works have emerged. In this survey, we comprehensively review 141 works…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Pengfei Yang , Ngai-Man Cheung , Xinda Ma

Supervised Pix2Pix and unsupervised Cycle-consistency are two modes that dominate the field of medical image-to-image translation. However, neither modes are ideal. The Pix2Pix mode has excellent performance. But it requires paired and well…

Image and Video Processing · Electrical Eng. & Systems 2021-11-12 Lingke Kong , Chenyu Lian , Detian Huang , Zhenjiang Li , Yanle Hu , Qichao Zhou

Text-to-image (T2I) diffusion models are popular for introducing image manipulation methods, such as editing, image fusion, inpainting, etc. At the same time, image-to-video (I2V) and text-to-video (T2V) models are also built on top of T2I…

Although convolutional neural networks have been proven to be an effective tool to generate high quality maps from remote sensing images, their performance significantly deteriorates when there exists a large domain shift between training…

Image and Video Processing · Electrical Eng. & Systems 2020-02-24 Onur Tasar , S L Happy , Yuliya Tarabalka , Pierre Alliez