English

pix2code: Generating Code from a Graphical User Interface Screenshot

Machine Learning 2017-09-20 v2 Artificial Intelligence Computation and Language Computer Vision and Pattern Recognition Neural and Evolutionary Computing

Abstract

Transforming a graphical user interface screenshot created by a designer into computer code is a typical task conducted by a developer in order to build customized software, websites, and mobile applications. In this paper, we show that deep learning methods can be leveraged to train a model end-to-end to automatically generate code from a single input image with over 77% of accuracy for three different platforms (i.e. iOS, Android and web-based technologies).

Keywords

Cite

@article{arxiv.1705.07962,
  title  = {pix2code: Generating Code from a Graphical User Interface Screenshot},
  author = {Tony Beltramelli},
  journal= {arXiv preprint arXiv:1705.07962},
  year   = {2017}
}