English
Related papers

Related papers: Auto-Icon+: An Automated End-to-End Code Generatio…

200 papers

GUI design is an integral part of software development. The process of designing a mobile application typically starts with the ideation and inspiration search from existing designs. However, existing information-retrieval based, and…

Software Engineering · Computer Science 2022-04-15 Sidong Feng , Chunyang Chen , Zhenchang Xing

For a full-stack web or app development, it requires a software firm or more specifically a team of experienced developers to contribute a large portion of their time and resources to design the website and then convert it to code. As a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Somoy Subandhu Barua , Imam Mohammad Zulkarnain , Abhishek Roy , Md. Golam Rabiul Alam , Md Zia Uddin

Computational approaches are beginning to be used to design dynamic visual identities fuelled by data and generative processes. In this work, we explore these computational approaches in order to generate a visual identity that creates…

Multimedia · Computer Science 2022-09-09 Sérgio M. Rebelo , Tiago Martins , Artur Rebelo , João Bicker , Penousal Machado

Automatic documentation generation tools, or auto docs, are widely used to visualize information about APIs. However, each auto doc tool comes with its own unique representation of API information. In this paper, I use an information…

Software Engineering · Computer Science 2020-11-12 Will Crichton

Customizing pre-trained text-to-image generation model has attracted massive research interest recently, due to its huge potential in real-world applications. Although existing methods are able to generate creative content for a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yufan Zhou , Ruiyi Zhang , Jiuxiang Gu , Tong Sun

Graphic design generation demands a delicate balance between high visual fidelity and fine-grained structural editability. However, existing approaches typically bifurcate into either non-editable raster image synthesis or abstract layout…

Graphics · Computer Science 2026-02-24 Ziyuan Liu , Shizhao Sun , Danqing Huang , Yingdong Shi , Meisheng Zhang , Ji Li , Jingsong Yu , Jiang Bian

UI-to-Code generation requires vision-language models (VLMs) to produce thousands of tokens of structured HTML/CSS from a single screenshot, making visual token efficiency critical. Existing compression methods either select tokens at…

Computation and Language · Computer Science 2026-04-13 Dasen Dai , Shuoqi Li , Ronghao Chen , Huacan Wang , Biao Wu , Qizhen Lan

UI-to-code aims to translate UI screenshots into executable front-end code. Despite progress with vision-language models (VLMs), most existing methods formulate UI-to-code as a single-pass generation, which mismatches real-world UI…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Zhen Yang , Wenyi Hong , Mingde Xu , Xinyue Fan , Weihan Wang , Jiale Cheng , Xiaotao Gu , Jie Tang

Recently, deep learning techniques have shown great success in automatic code generation. Inspired by the code reuse, some researchers propose copy-based approaches that can copy the content from similar code snippets to obtain better…

Software Engineering · Computer Science 2023-09-08 Jia Li , Yongmin Li , Ge Li , Zhi Jin , Yiyang Hao , Xing Hu

Constructive visualization uses physical data units - tokens - to enable non-experts to create personalized visualizations engagingly. However, its physical nature limits efficiency and scalability. One potential solution to address this…

Human-Computer Interaction · Computer Science 2023-08-09 Wei Wei , Samuel Huron , Yvonne Jansen

Given a large and evolving codebase, the ability to automatically generate holistic, architecture-aware documentation that captures not only individual functions but also cross-file, cross-module, and system-level interactions remains an…

Software Engineering · Computer Science 2026-04-07 Anh Nguyen Hoang , Minh Le-Anh , Bach Le , Nghi D. Q. Bui

Text logo design heavily relies on the creativity and expertise of professional designers, in which arranging element layouts is one of the most important procedures. However, few attention has been paid to this task which needs to take…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yizhi Wang , Guo Pu , Wenhan Luo , Yexin Wang , Pengfei Xiong , Hongwen Kang , Zhouhui Lian

Improving the accessibility and automation capabilities of mobile devices can have a significant positive impact on the daily lives of countless users. To stimulate research in this direction, we release a human-annotated dataset with…

Human-Computer Interaction · Computer Science 2022-10-07 Srinivas Sunkara , Maria Wang , Lijuan Liu , Gilles Baechler , Yu-Chung Hsiao , Jindong , Chen , Abhanshu Sharma , James Stout

Automatic code generation has recently attracted large attention and is becoming more significant to the software development process. Solutions based on Machine Learning and Artificial Intelligence are being used to increase human and…

Software Engineering · Computer Science 2023-05-22 Leon Chemnitz , David Reichenbach , Hani Aldebes , Mariam Naveed , Krishna Narasimhan , Mira Mezini

A great part of software development involves conceptualizing or communicating the underlying procedures and logic that needs to be expressed in programs. One major difficulty of programming is turning concept into code, especially when…

Software Engineering · Computer Science 2021-09-23 Frank F. Xu , Bogdan Vasilescu , Graham Neubig

Large language models (LLMs) struggle to consistently generate UI code that compiles and produces visually relevant designs. Existing approaches to improve generation rely on expensive human feedback or distilling a proprietary model. In…

Computation and Language · Computer Science 2024-06-13 Jason Wu , Eldon Schoop , Alan Leung , Titus Barik , Jeffrey P. Bigham , Jeffrey Nichols

Declarative UI frameworks have gained widespread adoption in mobile app development, offering benefits such as improved code readability and easier maintenance. Despite these advantages, the process of translating UI designs into functional…

Software Engineering · Computer Science 2024-09-19 Ting Zhou , Yanjie Zhao , Xinyi Hou , Xiaoyu Sun , Kai Chen , Haoyu Wang

UI design is an integral part of software development. For many developers who do not have much UI design experience, exposing them to a large database of real-application UI designs can help them quickly build up a realistic understanding…

Software Engineering · Computer Science 2021-03-15 Jieshan Chen , Chunyang Chen , Zhenchang Xing , Xin Xia , Liming Zhu , John Grundy , Jinshui Wang

A code completion system suggests future code elements to developers given a partially-complete code snippet. Code completion is one of the most useful features in Integrated Development Environments (IDEs). Currently, most code completion…

Software Engineering · Computer Science 2020-09-21 Wenhan Wang , Sijie Shen , Ge Li , Zhi Jin

Font design is now still considered as an exclusive privilege of professional designers, whose creativity is not possessed by existing software systems. Nevertheless, we also notice that most commercial font products are in fact manually…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Yizhi Wang , Yue Gao , Zhouhui Lian