Human-Computer Interaction · Computer Science
Automatic code generation from sketches of mobile applications in end-user development using Deep Learning
Daniel Baulé, Christiane Gresse von Wangenheim, Aldo von Wangenheim, Jean C. R. Hauck +1
2021-03-11
Computer Vision and Pattern Recognition · Computer Science
Sketch2Code: Transformation of Sketches to UI in Real-time Using Deep Neural Network
Vanita Jain, Piyush Agrawal, Subham Banga, Rishabh Kapoor +1
2019-10-22
Software Engineering · Computer Science
Automatically Generating UI Code from Screenshot: A Divide-and-Conquer-Based Approach
Yuxuan Wan, Chaozheng Wang, Yi Dong, Wenxuan Wang +3
2025-04-28
Human-Computer Interaction · Computer Science
Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots
Jason Wu, Xiaoyi Zhang, Jeff Nichols, Jeffrey P. Bigham
2021-09-21
Computer Vision and Pattern Recognition · Computer Science
Sketch2FullStack: Generating Skeleton Code of Full Stack Website and Application from Sketch using Deep Learning and Computer Vision
Somoy Subandhu Barua, Imam Mohammad Zulkarnain, Abhishek Roy, Md. Golam Rabiul Alam +1
2022-11-29
Human-Computer Interaction · Computer Science
Auto-Icon+: An Automated End-to-End Code Generation Tool for Icon Designs in UI Development
Sidong Feng, Minmin Jiang, Tingting Zhou, Yankun Zhen +1
2022-04-20
Human-Computer Interaction · Computer Science
Creating User Interface Mock-ups from High-Level Text Descriptions with Deep-Learning Models
Forrest Huang, Gang Li, Xin Zhou, John F. Canny +1
2021-10-18
Software Engineering · Computer Science
Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Apps
Kevin Moran, Carlos Bernal-Cárdenas, Michael Curcio, Richard Bonett +1
2018-07-30
Software Engineering · Computer Science
SkCoder: A Sketch-based Approach for Automatic Code Generation
Jia Li, Yongmin Li, Ge Li, Zhi Jin +2
2023-09-08
Software Engineering · Computer Science
Prototype2Code: End-to-end Front-end Code Generation from UI Design Prototypes
Shuhong Xiao, Yunnong Chen, Jiazhi Li, Liuqing Chen +2
2024-05-09
Computer Vision and Pattern Recognition · Computer Science
ScreenCoder: Advancing Visual-to-Code Generation for Front-End Automation via Modular Multimodal Agents
Yilei Jiang, Yaozhi Zheng, Yuxuan Wan, Jiaming Han +3
2025-10-21
Software Engineering · Computer Science
MLLM-Based UI2Code Automation Guided by UI Layout Information
Fan Wu, Cuiyun Gao, Shuqing Li, Xin-Cheng Wen +1
2025-06-13
Software Engineering · Computer Science
Fine-grained Pseudo-code Generation Method via Code Feature Extraction and Transformer
Guang Yang, Yanlin Zhou, Xiang Chen, Chi Yu
2021-09-22
Computer Vision and Pattern Recognition · Computer Science
UI2Code^N: UI-to-Code Generation as Interactive Visual Optimization
Zhen Yang, Wenyi Hong, Mingde Xu, Xinyue Fan +4
2026-05-07
Software Engineering · Computer Science
Figma2Code: Automating Multimodal Design to Code in the Wild
Yi Gui, Jiawan Zhang, Yina Wang, Tianran Ma +8
2026-04-16
Human-Computer Interaction · Computer Science
Sketch-based Creativity Support Tools using Deep Learning
Forrest Huang, Eldon Schoop, David Ha, Jeffrey Nichols +1
2021-11-22
Computer Vision and Pattern Recognition · Computer Science
Sketch2Scene: Automatic Generation of Interactive 3D Game Scenes from User's Casual Sketches
Yongzhi Xu, Yonhon Ng, Yifu Wang, Inkyu Sa +5
2026-02-09