English

Visual Conceptual Blending with Large-scale Language and Vision Models

Computation and Language 2021-06-29 v1 Artificial Intelligence Computer Vision and Pattern Recognition

Abstract

We ask the question: to what extent can recent large-scale language and image generation models blend visual concepts? Given an arbitrary object, we identify a relevant object and generate a single-sentence description of the blend of the two using a language model. We then generate a visual depiction of the blend using a text-based image generation model. Quantitative and qualitative evaluations demonstrate the superiority of language models over classical methods for conceptual blending, and of recent large-scale image generation models over prior models for the visual depiction.

Keywords

Cite

@article{arxiv.2106.14127,
  title  = {Visual Conceptual Blending with Large-scale Language and Vision Models},
  author = {Songwei Ge and Devi Parikh},
  journal= {arXiv preprint arXiv:2106.14127},
  year   = {2021}
}
R2 v1 2026-06-24T03:38:00.477Z