AffectGAN: Affect-Based Generative Art Driven by Semantics
Abstract
This paper introduces a novel method for generating artistic images that express particular affective states. Leveraging state-of-the-art deep learning methods for visual generation (through generative adversarial networks), semantic models from OpenAI, and the annotated dataset of the visual art encyclopedia WikiArt, our AffectGAN model is able to generate images based on specific or broad semantic prompts and intended affective outcomes. A small dataset of 32 images generated by AffectGAN is annotated by 50 participants in terms of the particular emotion they elicit, as well as their quality and novelty. Results show that for most instances the intended emotion used as a prompt for image generation matches the participants' responses. This small-scale study brings forth a new vision towards blending affective computing with computational creativity, enabling generative systems with intentionality in terms of the emotions they wish their output to elicit.
Cite
@article{arxiv.2109.14845,
title = {AffectGAN: Affect-Based Generative Art Driven by Semantics},
author = {Theodoros Galanos and Antonios Liapis and Georgios N. Yannakakis},
journal= {arXiv preprint arXiv:2109.14845},
year = {2021}
}
Comments
Published in the "What's Next in Affect Modeling?" workshop at the Affective Computing & Intelligent Interaction (ACII) 2021 conference, 7 pages, 3 figures