In this demo, we present Chat-to-Design, a new multimodal interaction system for personalized fashion design. Compared to classic systems that recommend apparel based on keywords, Chat-to-Design enables users to design clothes in two steps: 1) coarse-grained selection via conversation and 2) fine-grained editing via an interactive interface. It encompasses three sub-systems to deliver an immersive user experience: A conversation system empowered by natural language understanding to accept users' requests and manages dialogs; A multimodal fashion retrieval system empowered by a large-scale pretrained language-image network to retrieve requested apparel; A fashion design system empowered by emerging generative techniques to edit attributes of retrieved clothes.
@article{arxiv.2207.01058,
title = {Chat-to-Design: AI Assisted Personalized Fashion Design},
author = {Weiming Zhuang and Chongjie Ye and Ying Xu and Pengzhi Mao and Shuai Zhang},
journal= {arXiv preprint arXiv:2207.01058},
year = {2022}
}