English
Related papers

Related papers: Multimodal Image-to-Image Translation via Mutual I…

200 papers

Multi-modal magnetic resonance imaging (MRI) provides rich, complementary information for analyzing diseases. However, the practical challenges of acquiring multiple MRI modalities, such as cost, scan time, and safety considerations, often…

Image and Video Processing · Electrical Eng. & Systems 2024-09-16 Zhaohu Xing , Sicheng Yang , Sixiang Chen , Tian Ye , Yijun Yang , Jing Qin , Lei Zhu

Interest in image-to-image translation has grown substantially in recent years with the success of unsupervised models based on the cycle-consistency assumption. The achievements of these models have been limited to a particular subset of…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Matthew Amodio , Smita Krishnaswamy

Most deep learning models are data-driven and the excellent performance is highly dependent on the abundant and diverse datasets. However, it is very hard to obtain and label the datasets of some specific scenes or applications. If we train…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Tianxiao Zhang , Wenchi Ma , Guanghui Wang

Existing models for unsupervised image translation with Generative Adversarial Networks (GANs) can learn the mapping from the source domain to the target domain using a cycle-consistency loss. However, these methods always adopt a symmetric…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Hao Tang , Nicu Sebe

Recently, image-to-image translation research has witnessed remarkable progress. Although current approaches successfully generate diverse outputs or perform scalable image transfer, these properties have not been combined into a single…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Yaxing Wang , Abel Gonzalez-Garcia , Joost van de Weijer , Luis Herranz

Text-to-image generation and image captioning are recently emerged as a new experimental paradigm to assess machine intelligence. They predict continuous quantity accompanied by their sampling techniques in the generation, making evaluation…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jin-Hwa Kim , Yunji Kim , Jiyoung Lee , Kang Min Yoo , Sang-Woo Lee

Image-to-Image (I2I) multi-domain translation models are usually evaluated also using the quality of their semantic interpolation results. However, state-of-the-art models frequently show abrupt changes in the image appearance during…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Yahui Liu , Enver Sangineto , Yajing Chen , Linchao Bao , Haoxian Zhang , Nicu Sebe , Bruno Lepri , Wei Wang , Marco De Nadai

In the field of computer vision, multimodal image generation has become a research hotspot, especially the task of integrating text, image, and style. In this study, we propose a multimodal image generation method based on Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chaoyi Tan , Wenqing Zhang , Zhen Qi , Kowei Shih , Xinshi Li , Ao Xiang

Despite the successes of deep neural networks on many challenging vision tasks, they often fail to generalize to new test domains that are not distributed identically to the training data. The domain adaptation becomes more challenging for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Devavrat Tomar , Manana Lortkipanidze , Guillaume Vray , Behzad Bozorgtabar , Jean-Philippe Thiran

Multi-domain image-to-image (I2I) translations can transform a source image according to the style of a target domain. One important, desired characteristic of these transformations, is their graduality, which corresponds to a smooth change…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Yahui Liu , Enver Sangineto , Yajing Chen , Linchao Bao , Haoxian Zhang , Nicu Sebe , Bruno Lepri , Marco De Nadai

Accurate and efficient tools for calculating the ground state properties of interacting quantum systems are essential in the design of nanoelectronic devices. The exact diagonalization method fully accounts for the Coulomb interaction…

Mesoscale and Nanoscale Physics · Physics 2023-05-23 Calin-Andrei Pantis-Simut , Amanda Teodora Preda , Lucian Ion , Andrei Manolescu , George Alexandru Nemnes

This paper describes InfoGAN, an information-theoretic extension to the Generative Adversarial Network that is able to learn disentangled representations in a completely unsupervised manner. InfoGAN is a generative adversarial network that…

Machine Learning · Computer Science 2016-06-14 Xi Chen , Yan Duan , Rein Houthooft , John Schulman , Ilya Sutskever , Pieter Abbeel

Recently image-to-image translation has attracted significant interests in the literature, starting from the successful use of the generative adversarial network (GAN), to the introduction of cyclic constraint, to extensions to multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Zengming Shen , S. Kevin Zhou , Yifan Chen , Bogdan Georgescu , Xuqi Liu , Thomas S. Huang

Focusing on text-to-image (T2I) generation, we propose Text and Image Mutual-Translation Adversarial Networks (TIME), a lightweight but effective model that jointly learns a T2I generator G and an image captioning discriminator D under the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Bingchen Liu , Kunpeng Song , Yizhe Zhu , Gerard de Melo , Ahmed Elgammal

Despite astonishing progress, generating realistic images of complex scenes remains a challenging problem. Recently, layout-to-image synthesis approaches have attracted much interest by conditioning the generator on a list of bounding boxes…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Stanislav Frolov , Prateek Bansal , Jörn Hees , Andreas Dengel

Conditional generative adversarial networks (cGANs) target at synthesizing diverse images given the input conditions and latent codes, but unfortunately, they usually suffer from the issue of mode collapse. To solve this issue, previous…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Rui Liu , Yixiao Ge , Ching Lam Choi , Xiaogang Wang , Hongsheng Li

In this paper, we approach an overlooked yet critical task Graph2Image: generating images from multimodal attributed graphs (MMAGs). This task poses significant challenges due to the explosion in graph size, dependencies among graph…

Artificial Intelligence · Computer Science 2024-10-10 Bowen Jin , Ziqi Pang , Bingjun Guo , Yu-Xiong Wang , Jiaxuan You , Jiawei Han

Generative Adversarial Networks (GANs) are a class of neural networks that have been widely used in the field of image-to-image translation. In this paper, we propose a streamlined image-to-image translation network with a simpler…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Guangzong Chen , Mingui Sun , Zhi-Hong Mao , Kangni Liu , Wenyan Jia

SCONE-GAN presents an end-to-end image translation, which is shown to be effective for learning to generate realistic and diverse scenery images. Most current image-to-image translation approaches are devised as two mappings: a translation…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Iman Abbasnejad , Fabio Zambetta , Flora Salim , Timothy Wiley , Jeffrey Chan , Russell Gallagher , Ehsan Abbasnejad

Cross-modality data translation has attracted great interest in image computing. Deep generative models (\textit{e.g.}, GANs) show performance improvement in tackling those problems. Nevertheless, as a fundamental challenge in image…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Zihao Wang , Yingyu Yang , Maxime Sermesant , Hervé Delingette , Ona Wu