English
Related papers

Related papers: Generating Compositional Color Representations fro…

200 papers

Novel photo-realistic texture synthesis is an important task for generating novel scenes, including asset generation for 3D simulations. However, to date, these methods predominantly generate textured objects in 2D space. If we rely on 2D…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Dharma KC , Clayton T. Morrison , Bradley Walls

Recent findings in neuroscience suggest that the human brain represents information in a geometric structure (for instance, through conceptual spaces). In order to communicate, we flatten the complex representation of entities and their…

Machine Learning · Computer Science 2020-02-05 Agnieszka Słowik , Abhinav Gupta , William L. Hamilton , Mateja Jamnik , Sean B. Holden

In this paper, we propose a novel generative network (SegAttnGAN) that utilizes additional segmentation information for the text-to-image synthesis task. As the segmentation data introduced to the model provides useful guidance on the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-27 Yuchuan Gou , Qiancheng Wu , Minghao Li , Bo Gong , Mei Han

In this paper, we propose a model using generative adversarial net (GAN) to generate realistic text. Instead of using standard GAN, we combine variational autoencoder (VAE) with generative adversarial net. The use of high-level latent…

Computation and Language · Computer Science 2018-11-08 Heng Wang , Zengchang Qin , Tao Wan

Handling various objects with different colors is a significant challenge for image colorization techniques. Thus, for complex real-world scenes, the existing image colorization algorithms often fail to maintain color consistency. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Subhankar Ghosh , Saumik Bhattacharya , Prasun Roy , Umapada Pal , Michael Blumenstein

Colorization is the method of converting an image in grayscale to a fully color image. There are multiple methods to do the same. Old school methods used machine learning algorithms and optimization techniques to suggest possible colors to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Shreyank Narayana Gowda

Text-to-image generation is conducted through Generative Adversarial Networks (GANs) or transformer models. However, the current challenge lies in accurately generating images based on textual descriptions, especially in scenarios where the…

Human-Computer Interaction · Computer Science 2024-01-10 Yang Li , Huaqiang Jiang , Yangkai Wu

We present an approach named the Cycled Composition Network that can measure the semantic distance of the composition of image-text embedding. First, the Composition Network transit a reference image to target image in an embedding space…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Jongseok Kim , Youngjae Yu , Seunghwan Lee , GunheeKim

In this paper, we address the limitations of existing text-to-image diffusion models in generating demographically fair results when given human-related descriptions. These models often struggle to disentangle the target language context…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Jia Li , Lijie Hu , Jingfeng Zhang , Tianhang Zheng , Hua Zhang , Di Wang

Existing text generation methods tend to produce repeated and "boring" expressions. To tackle this problem, we propose a new text generation model, called Diversity-Promoting Generative Adversarial Network (DP-GAN). The proposed model…

Computation and Language · Computer Science 2018-08-22 Jingjing Xu , Xuancheng Ren , Junyang Lin , Xu Sun

Conditional image modeling based on textual descriptions is a relatively new domain in unsupervised learning. Previous approaches use a latent variable model and generative adversarial networks. While the formers are approximated by using…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Tehseen Zia , Shahan Arif , Shakeeb Murtaza , Mirza Ahsan Ullah

In this paper, we propose a novel way to interpret text information by extracting visual feature presentation from multiple high-resolution and photo-realistic synthetic images generated by Text-to-image Generative Adversarial Network (GAN)…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Tao Hu , Chengjiang Long , Leheng Zhang , Chunxia Xiao

Text-conditioned image generation has made significant progress in recent years with generative adversarial networks and more recently, diffusion models. While diffusion models conditioned on text prompts have produced impressive and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Azade Farshad , Yousef Yeganeh , Yu Chi , Chengzhi Shen , Björn Ommer , Nassir Navab

For realistic and vivid colorization, generative priors have recently been exploited. However, such generative priors often fail for in-the-wild complex images due to their limited representation space. In this paper, we propose BigColor, a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Geonung Kim , Kyoungkook Kang , Seongtae Kim , Hwayoon Lee , Sehoon Kim , Jonghyun Kim , Seung-Hwan Baek , Sunghyun Cho

In creativity support and computational co-creativity contexts, the task of discovering appropriate prompts for use with text-to-image generative models remains difficult. In many cases the creator wishes to evoke a certain impression with…

Artificial Intelligence · Computer Science 2023-02-21 Francisco Ibarrola , Rohan Lulham , Kazjon Grace

This paper develops a deep-learning framework to synthesize a ground-level view of a location given an overhead image. We propose a novel conditional generative adversarial network (cGAN) in which the trained generator generates realistic…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 Xueqing Deng , Yi Zhu , Shawn Newsam

For many computer vision applications such as image captioning, visual question answering, and person search, learning discriminative feature representations at both image and text level is an essential yet challenging problem. Its…

Computer Vision and Pattern Recognition · Computer Science 2019-08-29 Nikolaos Sarafianos , Xiang Xu , Ioannis A. Kakadiaris

Recent years witness the tremendous success of generative adversarial networks (GANs) in synthesizing photo-realistic images. GAN generator learns to compose realistic images and reproduce the real data distribution. Through that, a…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Yinghao Xu , Yujun Shen , Jiapeng Zhu , Ceyuan Yang , Bolei Zhou

We present a model of pragmatic referring expression interpretation in a grounded communication task (identifying colors from descriptions) that draws upon predictions from two recurrent neural network classifiers, a speaker and a listener,…

Computation and Language · Computer Science 2017-05-17 Will Monroe , Robert X. D. Hawkins , Noah D. Goodman , Christopher Potts

The task of image generation started to receive some attention from artists and designers to inspire them in new creations. However, exploiting the results of deep generative models such as Generative Adversarial Networks can be long and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Baptiste Rozière , Morgane Riviere , Olivier Teytaud , Jérémy Rapin , Yann LeCun , Camille Couprie