English

WordArt Designer: User-Driven Artistic Typography Synthesis using Large Language Models

Computation and Language 2023-11-28 v2 Artificial Intelligence Computer Vision and Pattern Recognition Graphics

Abstract

This paper introduces WordArt Designer, a user-driven framework for artistic typography synthesis, relying on the Large Language Model (LLM). The system incorporates four key modules: the LLM Engine, SemTypo, StyTypo, and TexTypo modules. 1) The LLM Engine, empowered by the LLM (e.g., GPT-3.5), interprets user inputs and generates actionable prompts for the other modules, thereby transforming abstract concepts into tangible designs. 2) The SemTypo module optimizes font designs using semantic concepts, striking a balance between artistic transformation and readability. 3) Building on the semantic layout provided by the SemTypo module, the StyTypo module creates smooth, refined images. 4) The TexTypo module further enhances the design's aesthetics through texture rendering, enabling the generation of inventive textured fonts. Notably, WordArt Designer highlights the fusion of generative AI with artistic typography. Experience its capabilities on ModelScope: https://www.modelscope.cn/studios/WordArt/WordArt.

Keywords

Cite

@article{arxiv.2310.18332,
  title  = {WordArt Designer: User-Driven Artistic Typography Synthesis using Large Language Models},
  author = {Jun-Yan He and Zhi-Qi Cheng and Chenyang Li and Jingdong Sun and Wangmeng Xiang and Xianhui Lin and Xiaoyang Kang and Zengke Jin and Yusen Hu and Bin Luo and Yifeng Geng and Xuansong Xie and Jingren Zhou},
  journal= {arXiv preprint arXiv:2310.18332},
  year   = {2023}
}

Comments

Accepted by EMNLP 2023, 10 pages, 11 figures, 1 table, the system is at https://www.modelscope.cn/studios/WordArt/WordArt

R2 v1 2026-06-28T13:04:06.450Z