English
Related papers

Related papers: Automatically Generating Codes from Graphical Scre…

200 papers

Large language models (LLMs) have shown great potential in automating significant aspects of coding by producing natural code from informal natural language (NL) intent. However, given NL is informal, it does not lend easily to checking…

Software Engineering · Computer Science 2024-10-04 Sarah Fakhoury , Aaditya Naik , Georgios Sakkas , Saikat Chakraborty , Shuvendu K. Lahiri

The current paper presents how a predictive coding type deep recurrent neural networks can generate vision-based goal-directed plans based on prior learning experience by examining experiment results using a real arm robot. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2018-06-06 Minkyu Choi , Takazumi Matsumoto , Minju Jung , Jun Tani

UI-to-code technology has streamlined the front-end development process, reducing repetitive tasks for engineers. prior research mainly use design prototypes as inputs, with the effectiveness of the generated code heavily dependent on these…

Software Engineering · Computer Science 2024-05-09 Shuhong Xiao , Yunnong Chen , Jiazhi Li , Liuqing Chen , Lingyun Sun , Tingting Zhou

Computer-Use Agents (CUA) are becoming increasingly capable of autonomously operating digital environments through Graphical User Interfaces (GUI). Yet, most GUI remain designed primarily for humans--prioritizing aesthetics and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Kevin Qinghong Lin , Siyuan Hu , Linjie Li , Zhengyuan Yang , Lijuan Wang , Philip Torr , Mike Zheng Shou

Recently, AIGC image quality assessment (AIGCIQA), which aims to assess the quality of AI-generated images (AIGIs) from a human perception perspective, has emerged as a new topic in computer vision. Unlike common image quality assessment…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Jiquan Yuan , Xinyan Cao , Jinming Che , Qinyuan Wang , Sen Liang , Wei Ren , Jinlong Lin , Xixin Cao

Efficient creation of accurate and editable 3D CAD models is critical in engineering design, significantly impacting cost and time-to-market in product innovation. Current manual workflows remain highly time-consuming and demand extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Anna C. Doris , Md Ferdous Alam , Amin Heyrani Nobari , Faez Ahmed

Deep generative models have become increasingly effective at producing realistic images from randomly sampled seeds, but using such models for controllable manipulation of existing images remains challenging. We propose the Swapping…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Taesung Park , Jun-Yan Zhu , Oliver Wang , Jingwan Lu , Eli Shechtman , Alexei A. Efros , Richard Zhang

Text-to-image (T2I) diffusion models have shown significant success in personalized text-to-image generation, which aims to generate novel images with human identities indicated by the reference images. Despite promising identity fidelity…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yuxiang Wei , Zhilong Ji , Jinfeng Bai , Hongzhi Zhang , Lei Zhang , Wangmeng Zuo

Deep learning on graphs has become a popular research topic with many applications. However, past work has concentrated on learning graph embedding tasks, which is in contrast with advances in generative models for images and text. Is it…

Machine Learning · Computer Science 2018-02-13 Martin Simonovsky , Nikos Komodakis

Generative AI has made rapid advancements in recent years, achieving unprecedented capabilities in multimodal understanding and code generation. This can enable a new paradigm of front-end development in which multimodal large language…

Computation and Language · Computer Science 2025-02-11 Chenglei Si , Yanzhe Zhang , Ryan Li , Zhengyuan Yang , Ruibo Liu , Diyi Yang

Benefited from the deep learning, image Super-Resolution has been one of the most developing research fields in computer vision. Depending upon whether using a discriminator or not, a deep convolutional neural network can provide an image…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Zhi-Song Liu , Wan-Chi Siu , Li-Wen Wang , Chu-Tak Li , Marie-Paule Cani , Yui-Lam Chan

Large Language Models (LLMs) have shown strong potential for code generation, yet they remain limited in private-library-oriented code generation, where the goal is to generate code using APIs from private libraries. Existing approaches…

Software Engineering · Computer Science 2026-03-30 Yitong Zhang , Chengze Li , Ruize Chen , Guowei Yang , Xiaoran Jia , Yijie Ren , Jia Li

Due to the growing complexity of modern Integrated Circuits (ICs), automating hardware design can prevent a significant amount of human error from the engineering process and result in less errors. Verilog is a popular hardware description…

Artificial Intelligence · Computer Science 2025-03-06 Chia-Tung Ho , Haoxing Ren , Brucek Khailany

GPU compilers are complex software programs with many optimizations specific to target hardware. These optimizations are often controlled by heuristics hand-designed by compiler experts using time- and resource-intensive processes. In this…

Machine Learning · Computer Science 2021-11-24 Ian Colbert , Jake Daly , Norm Rubin

The emergence of GUI is a great progress in the history of computer science and software design. GUI makes human computer interaction more simple and interesting. Python, as a popular programming language in recent years, has not been…

Human-Computer Interaction · Computer Science 2018-09-04 Jinwei Lin , Aimin Zhou

Mobile GUI agents have shown strong potential in real-world automation and practical applications. However, most existing agents remain reactive, making decisions mainly from current screen, which limits their performance on long-horizon…

Artificial Intelligence · Computer Science 2026-01-08 Yilin Cao , Yufeng Zhong , Zhixiong Zeng , Liming Zheng , Jing Huang , Haibo Qiu , Peng Shi , Wenji Mao , Wan Guanglu

Automatic code generation has recently attracted large attention and is becoming more significant to the software development process. Solutions based on Machine Learning and Artificial Intelligence are being used to increase human and…

Software Engineering · Computer Science 2023-05-22 Leon Chemnitz , David Reichenbach , Hani Aldebes , Mariam Naveed , Krishna Narasimhan , Mira Mezini

Text-to-video generation has shown promising results. However, by taking only natural languages as input, users often face difficulties in providing detailed information to precisely control the model's output. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Hsin-Ping Huang , Yu-Chuan Su , Deqing Sun , Lu Jiang , Xuhui Jia , Yukun Zhu , Ming-Hsuan Yang

Recent advances in Generative AI (GenAI) have led to significant improvements in the quality of generated visual content. As AI-generated visual content becomes increasingly indistinguishable from real content, the challenge of detecting…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Keerthi Veeramachaneni , Praveen Tirupattur , Amrit Singh Bedi , Mubarak Shah

Front-end development constitutes a substantial portion of software engineering, yet converting design mockups into production-ready User Interface (UI) code remains tedious and costly. While recent work has explored automating this process…

Software Engineering · Computer Science 2026-04-16 Yi Gui , Jiawan Zhang , Yina Wang , Tianran Ma , Yao Wan , Shilin He , Dongping Chen , Zhou Zhao , Wenbin Jiang , Xuanhua Shi , Hai Jin , Philip S Yu