English
Related papers

Related papers: Cross Modality Image Translation In Medical Imagin…

200 papers

We propose a unified Generative Adversarial Network (GAN) for controllable image-to-image translation, i.e., transferring an image from a source to a target domain guided by controllable structures. In addition to conditioning on a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Hao Tang , Hong Liu , Nicu Sebe

Generally, image-to-image translation (i2i) methods aim at learning mappings across domains with the assumption that the images used for translation share content (e.g., pose) but have their own domain-specific information (a.k.a. style).…

Image and Video Processing · Electrical Eng. & Systems 2023-05-12 Mohamed Abid , Arman Afrasiyabi , Ihsen Hedhli , Jean-François Lalonde , Christian Gagné

Medical image translation is an ill-posed problem. Unlike existing paired unbounded unidirectional translation networks, in this paper, we consider unpaired medical images and provide a strictly bounded network that yields a stable…

Image and Video Processing · Electrical Eng. & Systems 2023-11-07 Swati Rai , Jignesh S. Bhatt , Sarat Kumar Patra

Generative models have been applied in the medical imaging domain for various image recognition and synthesis tasks. However, a more controllable and interpretable image synthesis model is still lacking yet necessary for important…

Image and Video Processing · Electrical Eng. & Systems 2021-11-15 Jiarong Ye , Yuan Xue , Peter Liu , Richard Zaino , Keith Cheng , Xiaolei Huang

Medical image synthesis is crucial for alleviating data scarcity and privacy constraints. However, fine-tuning general text-to-image (T2I) models remains challenging, mainly due to the significant modality gap between complex visual details…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Xin Huang , Junjie Liang , Qingshan Hou , Peng Cao , Jinzhu Yang , Xiaoli Liu , Osmar R. Zaiane

Image semantic communication (ISC) has garnered significant attention for its potential to achieve high efficiency in visual content transmission. However, existing ISC systems based on joint source-channel coding face challenges in…

Information Theory · Computer Science 2024-08-08 Xijun Wang , Dongshan Ye , Chenyuan Feng , Howard H. Yang , Xiang Chen , Tony Q. S. Quek

In this paper, we propose a bi-modality medical image synthesis approach based on sequential generative adversarial network (GAN) and semi-supervised learning. Our approach consists of two generative modules that synthesize images of the…

Image and Video Processing · Electrical Eng. & Systems 2023-08-30 Xin Yang , Yi Lin , Zhiwei Wang , Xin Li , Kwang-Ting Cheng

Deep learning based generative adversarial networks (GAN) can effectively perform image reconstruction with under-sampled MR data. In general, a large number of training samples are required to improve the reconstruction performance of a…

Image and Video Processing · Electrical Eng. & Systems 2021-05-19 Jun Lv , Guangyuan Li , Xiangrong Tong , Weibo Chen , Jiahao Huang , Chengyan Wang , Guang Yang

Recently image-to-image translation has received increasing attention, which aims to map images in one domain to another specific one. Existing methods mainly solve this task via a deep generative model, and focus on exploring the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Songyao Jiang , Zhiqiang Tao , Yun Fu

Inter-scanner and inter-protocol discrepancy in MRI datasets are known to lead to significant quantification variability. Hence image-to-image or scanner-to-scanner translation is a crucial frontier in the area of medical image analysis…

Image and Video Processing · Electrical Eng. & Systems 2021-02-16 Xiaobin Hu

Ultrasound is the second most used modality in medical imaging. It is cost effective, hazardless, portable and implemented routinely in numerous clinical procedures. Nonetheless, image quality is characterized by granulated appearance, poor…

Image and Video Processing · Electrical Eng. & Systems 2022-06-13 Lilach Barkat , Moti Freiman , Haim Azhari

Generative adversarial networks (GANs) are a class of unsupervised machine learning algorithms that can produce realistic images from randomly-sampled vectors in a multi-dimensional space. Until recently, it was not possible to generate…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Andrew Beers , James Brown , Ken Chang , J. Peter Campbell , Susan Ostmo , Michael F. Chiang , Jayashree Kalpathy-Cramer

Text-to-image (T2I) models are well known for their ability to produce highly realistic images, while multimodal large language models (MLLMs) are renowned for their proficiency in understanding and integrating multiple modalities. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jian Ma , Qirong Peng , Xu Guo , Chen Chen , Haonan Lu , Zhenyu Yang

The use of accurate scanning transmission electron microscopy (STEM) image simulation methods require large computation times that can make their use infeasible for the simulation of many images. Other simulation methods based on linear…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Nick Lawrence , Mingren Shen , Ruiqi Yin , Cloris Feng , Dane Morgan

The image-to-image translation is a learning task to establish a visual mapping between an input and output image. The task has several variations differentiated based on the purpose of the translation, such as synthetic to real…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Pranjal Singh Rajput , Kanya Satis , Sonnya Dellarosa , Wenxuan Huang , Obinna Agba

The medical field is one of the important fields in the application of artificial intelligence technology. With the explosive growth and diversification of medical data, as well as the continuous improvement of medical needs and challenges,…

Artificial Intelligence · Computer Science 2024-03-27 Jingyu Xu , Binbin Wu , Jiaxin Huang , Yulu Gong , Yifan Zhang , Bo Liu

Image translation across domains for unpaired datasets has gained interest and great improvement lately. In medical imaging, there are multiple imaging modalities, with very different characteristics. Our goal is to use cross-modality…

Image and Video Processing · Electrical Eng. & Systems 2022-02-07 Leo Segre , Or Hirschorn , Dvir Ginzburg , Dan Raviv

Image-to-image translation (I2I), and particularly its subfield of appearance transfer, which seeks to alter the visual appearance between images while maintaining structural coherence, presents formidable challenges. Despite significant…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yuteng Ye , Guanwen Li , Hang Zhou , Cai Jiale , Junqing Yu , Yawei Luo , Zikai Song , Qilong Xing , Youjia Zhang , Wei Yang

Automated lesion segmentation from computed tomography (CT) is an important and challenging task in medical image analysis. While many advancements have been made, there is room for continued improvements. One hurdle is that CT images can…

Computer Vision and Pattern Recognition · Computer Science 2018-07-20 Youbao Tang , Jinzheng Cai , Le Lu , Adam P. Harrison , Ke Yan , Jing Xiao , Lin Yang , Ronald M. Summers

Recently, many text-to-image diffusion models have excelled at generating high-resolution images from text but struggle with precise control over spatial composition and object counting. To address these challenges, prior works have…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Huancheng Chen , Jingtao Li , Weiming Zhuang , Haris Vikalo , Lingjuan Lyu