English
Related papers

Related papers: Automatically Generating UI Code from Screenshot: …

200 papers

Most large language models (LLMs) today excel at generating raw, sequential code with minimal abstractions and custom structures. However, there has been little work on graph-based abstract code generation, where significant logic is…

Computation and Language · Computer Science 2025-10-16 Nyx Iskandar , Hisham Bedri , Andy Tsen

Computer-aided design (CAD) is the most widely used modeling approach for technical design. The typical starting point in these designs is 2D sketches which can later be extruded and combined to obtain complex three-dimensional assemblies.…

Machine Learning · Computer Science 2021-06-08 Wamiq Reyaz Para , Shariq Farooq Bhat , Paul Guerrero , Tom Kelly , Niloy Mitra , Leonidas Guibas , Peter Wonka

It is a challenging task to accurately perform semantic segmentation due to the complexity of real picture scenes. Many semantic segmentation methods based on traditional deep learning insufficiently captured the semantic and appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Haitong Tang , Shuang He , Mengduo Yang , Xia Lu , Qin Yu , Kaiyue Liu , Hongjie Yan , Nizhuan Wang

Unlike bitmap images, scalable vector graphics (SVG) maintain quality when scaled, frequently employed in computer vision and artistic design in the representation of SVG code. In this era of proliferating AI-powered systems, enabling AI to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jinke Li , Jiarui Yu , Chenxing Wei , Hande Dong , Qiang Lin , Liangjing Yang , Zhicai Wang , Yanbin Hao

Recent developments in large language models (LLM) and generative AI have unleashed the astonishing capabilities of text-to-image generation systems to synthesize high-quality images that are faithful to a given reference text, known as a…

Human-Computer Interaction · Computer Science 2023-03-17 Yutong Xie , Zhaoying Pan , Jinge Ma , Luo Jie , Qiaozhu Mei

The rapid advancement of large language models (LLMs) has significantly improved their performance in code generation tasks. However, existing code benchmarks remain static, consisting of fixed datasets with predefined problems. This makes…

Computation and Language · Computer Science 2025-05-30 Wenhao Hu , Jinhao Duan , Chunchen Wei , Li Zhang , Yue Zhang , Kaidi Xu

We approach the important challenge of code autocompletion as an open-domain task, in which a sequence-to-sequence code generator model is enhanced with the ability to attend to reference code snippets supplied by a semantic code search…

Information Retrieval · Computer Science 2021-04-14 Dawn Drain , Changran Hu , Chen Wu , Mikhail Breslav , Neel Sundaresan

Generating diverse, readable statistical charts from tabular data remains challenging for LLMs, as many failures become apparent after rendering and are not detectable from data or code alone. Existing chart datasets also rarely provide…

Machine Learning · Computer Science 2026-05-04 Pavlin G. Poličar , Andraž Pevcin , Blaž Zupan

Web development involves turning UI designs into functional webpages, which can be difficult for both beginners and experienced developers due to the complexity of HTML's hierarchical structures and styles. While Large Language Models…

Software Engineering · Computer Science 2026-03-04 Shanchao Liang , Nan Jiang , Shangshu Qian , Lin Tan

In recent years, Large Language Models (LLMs) have achieved remarkable progress in automated code generation. In real-world software engineering, the growing demand for rapid iteration and continuous delivery underscores the importance of…

Software Engineering · Computer Science 2025-11-06 Qianhui Zhao , Li Zhang , Fang Liu , Junhang Cheng , Chengru Wu , Junchen Ai , Qiaoyuanhe Meng , Lichen Zhang , Xiaoli Lian , Shubin Song , Yuanping Guo

Video large language models (Vid-LLMs), which excel in diverse video-language tasks, can be effectively constructed by adapting image-pretrained vision-language models (VLMs). However, this adaptation remains challenging, as it requires…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Yiyang Huang , Yizhou Wang , Yun Fu

Style-conditioned scene text generation faces unique challenges in extracting precise text styles from complex backgrounds and maintaining fine-grained style consistency across characters, especially for multilingual scripts. We propose…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zeyu Chen , Fangmin Zhao , Yan Shu , Yichao Liu , Liu Yu , Yu Zhou

Computer-aided design (CAD) is fundamental to modern engineering and manufacturing, but creating CAD models still requires expert knowledge and specialized software. Recent advances in large language models (LLMs) open up the possibility of…

Artificial Intelligence · Computer Science 2025-05-13 Haoyang Xie , Feng Ju

The practical use of text-to-image generation has evolved from simple, monolithic models to complex workflows that combine multiple specialized components. While workflow-based approaches can lead to improved image quality, crafting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Rinon Gal , Adi Haviv , Yuval Alaluf , Amit H. Bermano , Daniel Cohen-Or , Gal Chechik

Multi-agent systems, where multiple agents (generative AI models + tools) collaborate, are emerging as an effective pattern for solving long-running, complex tasks in numerous domains. However, specifying their parameters (such as models,…

Software Engineering · Computer Science 2024-08-29 Victor Dibia , Jingya Chen , Gagan Bansal , Suff Syed , Adam Fourney , Erkang Zhu , Chi Wang , Saleema Amershi

In the advanced technology nodes, the integrated design rule checker (DRC) is often utilized in place and route tools for fast optimization loops for power-performance-area. Implementing integrated DRC checkers to meet the standard of…

Hardware Architecture · Computer Science 2024-12-10 Chen-Chia Chang , Chia-Tung Ho , Yaguang Li , Yiran Chen , Haoxing Ren

We present WebMMU, a multilingual benchmark that evaluates three core web tasks: (1) website visual question answering, (2) code editing involving HTML/CSS/JavaScript, and (3) mockup-to-code generation. Unlike prior benchmarks that treat…

Analyzing network topologies and communication graphs plays a crucial role in contemporary network management. However, the absence of a cohesive approach leads to a challenging learning curve, heightened errors, and inefficiencies. In this…

Networking and Internet Architecture · Computer Science 2023-08-14 Sathiya Kumaran Mani , Yajie Zhou , Kevin Hsieh , Santiago Segarra , Ranveer Chandra , Srikanth Kandula

Fashion is now among the largest industries worldwide, for it represents human history and helps tell the worlds story. As a result of the Fourth Industrial Revolution, the Internet has become an increasingly important source of fashion…

Information Retrieval · Computer Science 2022-04-11 Narges Norouzi , Reza Azmi , Sara Saberi Tehrani Moghadam , Maral Zarvani

The generative capabilities of Large Language Models (LLMs) are rapidly expanding from static code to dynamic, interactive visual artifacts. This progress is bottlenecked by a critical evaluation gap: established benchmarks focus on…