English
Related papers

Related papers: Cross Modality Image Translation In Medical Imagin…

200 papers

Although text-to-image (T2I) models have recently thrived as visual generative priors, their reliance on high-quality text-image pairs makes scaling up expensive. We argue that grasping the cross-modality alignment is not a necessity for a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Shuailei Ma , Kecheng Zheng , Ying Wei , Wei Wu , Fan Lu , Yifei Zhang , Chen-Wei Xie , Biao Gong , Jiapeng Zhu , Yujun Shen

Data-driven paradigms using machine learning are becoming ubiquitous in image processing and communications. In particular, image-to-image (I2I) translation is a generic and widely used approach to image processing problems, such as image…

Image and Video Processing · Electrical Eng. & Systems 2022-08-10 Fei Yang , Yaxing Wang , Luis Herranz , Yongmei Cheng , Mikhail Mozerov

Image-to-Image translation in Generative Artificial Intelligence (Generative AI) has been a central focus of research, with applications spanning healthcare, remote sensing, physics, chemistry, photography, and more. Among the numerous…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Arpan Mahara , Naphtali D. Rishe , Liangdong Deng

State-of-the-art techniques in Generative Adversarial Networks (GANs) have shown remarkable success in image-to-image translation from peer domain X to domain Y using paired image data. However, obtaining abundant paired data is a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Xuewen Yang , Dongliang Xie , Xin Wang

Generative adversarial networks (GANs) are unsupervised Deep Learning approach in the computer vision community which has gained significant attention from the last few years in identifying the internal structure of multimodal medical…

Image and Video Processing · Electrical Eng. & Systems 2020-05-22 Nripendra Kumar Singh , Khalid Raza

Deep generative models have been applied to multiple applications in image-to-image translation. Generative Adversarial Networks and Diffusion Models have presented impressive results, setting new state-of-the-art results on these tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Sagar Saxena , Mohammad Nayeem Teli

Text-to-image synthesis (T2I) aims to generate photo-realistic images which are semantically consistent with the text descriptions. Existing methods are usually built upon conditional generative adversarial networks (GANs) and initialize an…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Kai Hu , Wentong Liao , Michael Ying Yang , Bodo Rosenhahn

Automatic parsing of anatomical objects in X-ray images is critical to many clinical applications in particular towards image-guided invention and workflow automation. Existing deep network models require a large amount of labeled data.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Yue Zhang , Shun Miao , Tommaso Mansi , Rui Liao

In this paper, we present an empirical study introducing a nuanced evaluation framework for text-to-image (T2I) generative models, applied to human image synthesis. Our framework categorizes evaluations into two distinct groups: first,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Muxi Chen , Yi Liu , Jian Yi , Changran Xu , Qiuxia Lai , Hongliang Wang , Tsung-Yi Ho , Qiang Xu

Paired multi-modality medical images, can provide complementary information to help physicians make more reasonable decisions than single modality medical images. But they are difficult to generate due to multiple factors in practice (e.g.,…

Image and Video Processing · Electrical Eng. & Systems 2021-05-20 Junxiao Chen , Jia Wei , Rui Li

Image-to-image (i2i) networks struggle to capture local changes because they do not affect the global scene structure. For example, translating from highway scenes to offroad, i2i networks easily focus on global color features but ignore…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Anthony Dell'Eva , Fabio Pizzati , Massimo Bertozzi , Raoul de Charette

Image-to-image (I2I) translation methods based on generative adversarial networks (GANs) typically suffer from overfitting when limited training data is available. In this work, we propose a data augmentation method (ReMix) to tackle this…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Jie Cao , Luanxuan Hou , Ming-Hsuan Yang , Ran He , Zhenan Sun

We propose a novel model named Multi-Channel Attention Selection Generative Adversarial Network (SelectionGAN) for guided image-to-image translation, where we translate an input image into another while respecting an external semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hao Tang , Philip H. S. Torr , Nicu Sebe

When humans read a specific text, they often visualize the corresponding images, and we hope that computers can do the same. Text-to-image synthesis (T2I), which focuses on generating high-quality images from textual descriptions, has…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Nonghai Zhang , Hao Tang

Recent advances in generative models and adversarial training have led to a flourishing image-to-image (I2I) translation literature. The current I2I translation approaches require training images from the two domains that are either all…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Samarth Shukla , Luc Van Gool , Radu Timofte

State-of-the-art methods for image-to-image translation with Generative Adversarial Networks (GANs) can learn a mapping from one domain to another domain using unpaired image data. However, these methods require the training of one specific…

Computer Vision and Pattern Recognition · Computer Science 2019-01-16 Hao Tang , Dan Xu , Wei Wang , Yan Yan , Nicu Sebe

Synthesized medical images have several important applications, e.g., as an intermedium in cross-modality image registration and as supplementary training samples to boost the generalization capability of a classifier. Especially,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Zizhao Zhang , Lin Yang , Yefeng Zheng

Medical image translation has the potential to reduce the imaging workload, by removing the need to capture some sequences, and to reduce the annotation burden for developing machine learning methods. GANs have been used successfully to…

Image and Video Processing · Electrical Eng. & Systems 2021-10-19 Pauliina Paavilainen , Saad Ullah Akram , Juho Kannala

We propose SANA-I2I, a text-free high-resolution image-to-image generation framework that extends the SANA family by removing textual conditioning entirely. In contrast to SanaControlNet, which combines text and image-based control,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Italo Felix Santos , Gilson Antonio Giraldi , Heron Werner Junior

Existing methods for multi-domain image-to-image translation (or generation) attempt to directly map an input image (or a random vector) to an image in one of the output domains. However, most existing methods have limited scalability and…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Bo Zhao , Bo Chang , Zequn Jie , Leonid Sigal