English

DuetSVG: Unified Multimodal SVG Generation with Internal Visual Guidance

Computer Vision and Pattern Recognition 2025-12-12 v1

Abstract

Recent vision-language model (VLM)-based approaches have achieved impressive results on SVG generation. However, because they generate only text and lack visual signals during decoding, they often struggle with complex semantics and fail to produce visually appealing or geometrically coherent SVGs. We introduce DuetSVG, a unified multimodal model that jointly generates image tokens and corresponding SVG tokens in an end-to-end manner. DuetSVG is trained on both image and SVG datasets. At inference, we apply a novel test-time scaling strategy that leverages the model's native visual predictions as guidance to improve SVG decoding quality. Extensive experiments show that our method outperforms existing methods, producing visually faithful, semantically aligned, and syntactically clean SVGs across a wide range of applications.

Keywords

Cite

@article{arxiv.2512.10894,
  title  = {DuetSVG: Unified Multimodal SVG Generation with Internal Visual Guidance},
  author = {Peiying Zhang and Nanxuan Zhao and Matthew Fisher and Yiran Xu and Jing Liao and Difan Liu},
  journal= {arXiv preprint arXiv:2512.10894},
  year   = {2025}
}

Comments

Project page: https://intchous.github.io/DuetSVG-site

R2 v1 2026-07-01T08:20:59.534Z