English

ELODIN: Naming Concepts in Embedding Spaces

Computer Vision and Pattern Recognition 2023-03-10 v2 Computation and Language Graphics Machine Learning

Abstract

Despite recent advancements, the field of text-to-image synthesis still suffers from lack of fine-grained control. Using only text, it remains challenging to deal with issues such as concept coherence and concept contamination. We propose a method to enhance control by generating specific concepts that can be reused throughout multiple images, effectively expanding natural language with new words that can be combined much like a painter's palette. Unlike previous contributions, our method does not copy visuals from input data and can generate concepts through text alone. We perform a set of comparisons that finds our method to be a significant improvement over text-only prompts.

Keywords

Cite

@article{arxiv.2303.04001,
  title  = {ELODIN: Naming Concepts in Embedding Spaces},
  author = {Rodrigo Mello and Filipe Calegario and Geber Ramalho},
  journal= {arXiv preprint arXiv:2303.04001},
  year   = {2023}
}

Comments

Added quantitative data, fixed formatting issues

R2 v1 2026-06-28T09:05:48.814Z