English

Text to artistic image generation

Computer Vision and Pattern Recognition 2022-05-06 v1 Artificial Intelligence

Abstract

Painting is one of the ways for people to express their ideas, but what if people with disabilities in hands want to paint? To tackle this challenge, we create an end-to-end solution that can generate artistic images from text descriptions. However, due to the lack of datasets with paired text description and artistic images, it is hard to directly train an algorithm which can create art based on text input. To address this issue, we split our task into three steps: (1) Generate a realistic image from a text description by using Dynamic Memory Generative Adversarial Network (arXiv:1904.01310), (2) Classify the image as a genre that exists in the WikiArt dataset using Resnet (arXiv: 1512.03385), (3) Select a style that is compatible with the genre and transfer it to the generated image by using neural artistic stylization network (arXiv:1705.06830).

Keywords

Cite

@article{arxiv.2205.02439,
  title  = {Text to artistic image generation},
  author = {Qinghe Tian and Jean-Claude Franchitti},
  journal= {arXiv preprint arXiv:2205.02439},
  year   = {2022}
}

Comments

7 pages, 8 figures

R2 v1 2026-06-24T11:07:49.556Z