English
Related papers

Related papers: Unsupervised Image-to-Image Translation with Gener…

200 papers

In this work, we introduce Vision-Language Generative Pre-trained Transformer (VL-GPT), a transformer model proficient at concurrently perceiving and generating visual and linguistic data. VL-GPT achieves a unified pre-training approach for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Jinguo Zhu , Xiaohan Ding , Yixiao Ge , Yuying Ge , Sijie Zhao , Hengshuang Zhao , Xiaohua Wang , Ying Shan

The multi-domain image-to-image translation is a challenging task where the goal is to translate an image into multiple different domains. The target-only characteristics are desired for translated images, while the source-only…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Defa Zhu , Si Liu , Wentao Jiang , Chen Gao , Tianyi Wu , Qaingchang Wang , Guodong Guo

Image-to-image translation models transfer images from input domain to output domain in an endeavor to retain the original content of the image. Contrastive Unpaired Translation is one of the existing methods for solving such problems.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Bernard Spiegl

Systems that perform image manipulation using deep convolutional networks have achieved remarkable realism. Perceptual losses and losses based on adversarial discriminators are the two main classes of learning objectives behind these…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Diana Sungatullina , Egor Zakharov , Dmitry Ulyanov , Victor Lempitsky

The motivation of our research is to explore the possibilities of automatic sound-to-image (S2I) translation for enabling a human receiver to visually infer the occurrence of sound related events. We expect the computer to 'imagine' the…

Sound · Computer Science 2022-03-10 Leonardo A. Fanzeres , Climent Nadeu

Despite significant advances in image-to-image (I2I) translation with generative adversarial networks (GANs), it remains challenging to effectively translate an image to a set of diverse images in multiple target domains using a single pair…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Shihua Huang , Cheng He , Ran Cheng

Unpaired image-to-image translation is a class of vision problems whose goal is to find the mapping between different image domains using unpaired training data. Cycle-consistency loss is a widely used constraint for such problems. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Yihao Zhao , Ruihai Wu , Hao Dong

Most deep learning models are data-driven and the excellent performance is highly dependent on the abundant and diverse datasets. However, it is very hard to obtain and label the datasets of some specific scenes or applications. If we train…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Tianxiao Zhang , Wenchi Ma , Guanghui Wang

Text-to-image generation has made significant advancements with the introduction of text-to-image diffusion models. These models typically consist of a language model that interprets user prompts and a vision model that generates…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Shihao Zhao , Shaozhe Hao , Bojia Zi , Huaizhe Xu , Kwan-Yee K. Wong

Existing models for unsupervised image translation with Generative Adversarial Networks (GANs) can learn the mapping from the source domain to the target domain using a cycle-consistency loss. However, these methods always adopt a symmetric…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Hao Tang , Nicu Sebe

Large-scale text-to-image models pre-trained on massive text-image pairs show excellent performance in image synthesis recently. However, image can provide more intuitive visual concepts than plain text. People may ask: how can we integrate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Bin Cheng , Zuhao Liu , Yunbo Peng , Yue Lin

Understanding images without explicit supervision has become an important problem in computer vision. In this paper, we address image captioning by generating language descriptions of scenes without learning from annotated pairs of images…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Iro Laina , Christian Rupprecht , Nassir Navab

Exemplar-based image translation refers to the task of generating images with the desired style, while conditioning on certain input image. Most of the current methods learn the correspondence between two input domains and lack the mining…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Tianxiang Ma , Bingchuan Li , Wei Liu , Miao Hua , Jing Dong , Tieniu Tan

In this work, we address the problem of multi-domain image-to-image translation with particular attention paid to computational cost. In particular, current state of the art models require a large and deep model in order to handle the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 The-Phuc Nguyen , Stéphane Lathuilière , Elisa Ricci

Semantic Image Synthesis (SIS) is a subclass of image-to-image translation where a photorealistic image is synthesized from a segmentation mask. SIS has mostly been addressed as a supervised problem. However, state-of-the-art methods depend…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 George Eskandar , Mohamed Abdelsamad , Karim Armanious , Bin Yang

Recent studies have shown remarkable success in the unsupervised image to image (I2I) translation. However, due to the imbalance in the data, learning joint distribution for various domains is still very challenging. Although existing…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Jihye Back

Various stuff and things in visual data possess specific traits, which can be learned by deep neural networks and are implicitly represented as the visual prior, e.g., object location and shape, in the model. Such prior potentially impacts…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Jinheng Xie , Kai Ye , Yudong Li , Yuexiang Li , Kevin Qinghong Lin , Yefeng Zheng , Linlin Shen , Mike Zheng Shou

Cross-contrast image translation is an important task for completing missing contrasts in clinical diagnosis. However, most existing methods learn separate translator for each pair of contrasts, which is inefficient due to many possible…

Image and Video Processing · Electrical Eng. & Systems 2021-07-27 Heran Yang , Jian Sun , Liwei Yang , Zongben Xu

Acquisition of data in task-specific applications of machine learning like plant disease recognition is a costly endeavor owing to the requirements of professional human diligence and time constraints. In this paper, we present a simple…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Haseeb Nazki , Sook Yoon , Alvaro Fuentes , Dong Sun Park

Generative models have shown a giant leap in synthesizing photo-realistic images with minimal expertise, sparking concerns about the authenticity of online information. This study aims to develop a universal AI-generated image detector…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Zihan Liu , Hanyi Wang , Yaoyu Kang , Shilin Wang