English
Related papers

Related papers: DesignAsCode: Bridging Structural Editability and …

200 papers

Text-to-CAD code generation is a long-horizon task that translates textual instructions into long sequences of interdependent operations. Existing methods typically decode text directly into executable code (e.g., bpy) without explicitly…

Artificial Intelligence · Computer Science 2026-04-14 Shengjie Gong , Wenjie Peng , Hongyuan Chen , Gangyu Zhang , Yunqing Hu , Huiyuan Zhang , Shuangping Huang , Tianshui Chen

Recent large-scale generative models learned on big data are capable of synthesizing incredible images yet suffer from limited controllability. This work offers a new generation paradigm that allows flexible control of the output image,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Lianghua Huang , Di Chen , Yu Liu , Yujun Shen , Deli Zhao , Jingren Zhou

UI-to-code technology has streamlined the front-end development process, reducing repetitive tasks for engineers. prior research mainly use design prototypes as inputs, with the effectiveness of the generated code heavily dependent on these…

Software Engineering · Computer Science 2024-05-09 Shuhong Xiao , Yunnong Chen , Jiazhi Li , Liuqing Chen , Lingyun Sun , Tingting Zhou

The crux of text-to-image synthesis stems from the difficulty of preserving the cross-modality semantic consistency between the input text and the synthesized image. Typical methods, which seek to model the text-to-image mapping directly,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Jiadong Liang , Wenjie Pei , Feng Lu

Apparel's significant role in human appearance underscores the importance of garment digitalization for digital human creation. Recent advances in 3D content creation are pivotal for digital human creation. Nonetheless, garment generation…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Kai He , Kaixin Yao , Qixuan Zhang , Jingyi Yu , Lingjie Liu , Lan Xu

The task of crafting procedural programs capable of generating structurally valid 3D shapes easily and intuitively remains an elusive goal in computer vision and graphics. Within the graphics community, generating procedural 3D models has…

Graphics · Computer Science 2025-03-21 Ofek Pearl , Itai Lang , Yuhua Hu , Raymond A. Yeh , Rana Hanocka

Graphic design plays a vital role in visual communication across advertising, marketing, and multimedia entertainment. Prior work has explored automated graphic design generation using diffusion models, aiming to streamline creative…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Hui Zhang , Dexiang Hong , Maoke Yang , Yutao Cheng , Zhao Zhang , Weidong Chen , Jie Shao , Xinglong Wu , Zuxuan Wu , Yu-Gang Jiang

Approximately 50% of development resources are devoted to UI development tasks [9]. Occupying a large proportion of development resources, developing icons can be a time-consuming task, because developers need to consider not only effective…

Human-Computer Interaction · Computer Science 2022-04-20 Sidong Feng , Minmin Jiang , Tingting Zhou , Yankun Zhen , Chunyang Chen

Developing an algorithm for a visualization prototype often involves the direct comparison of different development stages and design decisions, and even minor modifications may dramatically affect the results. While existing development…

Software Engineering · Computer Science 2020-01-08 Fabian Bolte , Stefan Bruckner

The automation of user interface development has the potential to accelerate software delivery by mitigating intensive manual implementation. Despite the advancements in Large Multimodal Models for design-to-code translation, existing…

Information Retrieval · Computer Science 2025-12-24 Xian Wu , Ming Zhang , Zhiyu Fang , Fei Li , Bin Wang , Yong Jiang , Hao Zhou

Characterizing creativity in visualization design can lead to the design of more expressive representations and visualization authoring tools that prioritize human creativity. In this paper, we examine how creativity manifests itself in…

Human-Computer Interaction · Computer Science 2026-04-14 Tianwei Ma , Zinat Ara , Safwat Ali Khan , Fanny Chevalier , Niklas Elmqvist , Naimul Hoque

Achieving high code reuse in physical design flows is challenging but increasingly necessary to build complex systems. Unfortunately, existing approaches based on parameterized Tcl generators support very limited reuse and struggle to…

Hardware Architecture · Computer Science 2021-11-30 Alex Carsello , James Thomas , Ankita Nayak , Po-Han Chen , Mark Horowitz , Priyanka Raina , Christopher Torng

Manual slide creation is labor-intensive and requires expert prior knowledge. Existing natural language-based LLM generation methods struggle to capture the visual and structural nuances of slide designs. To address this, we formalize the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Wenxin Tang , Jingyu Xiao , Wenxuan Jiang , Xi Xiao , Yuhang Wang , Xuxin Tang , Qing Li , Yuehe Ma , Junliang Liu , Shisong Tang , Michael R. Lyu

The ability to think abstractly and reason by analogy is a prerequisite to rapidly adapt to new conditions, tackle newly encountered problems by decomposing them, and synthesize knowledge to solve problems comprehensively. We present…

Artificial Intelligence · Computer Science 2024-10-08 Jakub Bednarek , Krzysztof Krawiec

Text logo design heavily relies on the creativity and expertise of professional designers, in which arranging element layouts is one of the most important procedures. However, few attention has been paid to this task which needs to take…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yizhi Wang , Guo Pu , Wenhan Luo , Yexin Wang , Pengfei Xiong , Hongwen Kang , Zhouhui Lian

Generating realistic building layouts for automatic building design has been studied in both the computer vision and architecture domains. Traditional approaches from the architecture domain, which are based on optimization techniques or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Jiachen Liu , Yuan Xue , Haomiao Ni , Rui Yu , Zihan Zhou , Sharon X. Huang

Enabling machines to understand structured visuals like slides and user interfaces is essential for making them accessible to people with disabilities. However, achieving such understanding computationally has required manual data…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Yi-Hao Peng , Faria Huq , Yue Jiang , Jason Wu , Amanda Xin Yue Li , Jeffrey Bigham , Amy Pavel

Generating visually grounded image captions with specific linguistic styles using unpaired stylistic corpora is a challenging task, especially since we expect stylized captions with a wide variety of stylistic patterns. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Kanzhi Cheng , Zheng Ma , Shi Zong , Jianbing Zhang , Xinyu Dai , Jiajun Chen

Creating and understanding art has long been a hallmark of human ability. When presented with finished digital artwork, professional graphic artists can intuitively deconstruct and replicate it using various drawing tools, such as the line…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Qi Bing , Chaoyi Zhang , Weidong Cai

Code is seldom written in a single left-to-right pass and is instead repeatedly edited and refined. We introduce InCoder, a unified generative model that can perform program synthesis (via left-to-right generation) as well as editing (via…

Software Engineering · Computer Science 2023-04-11 Daniel Fried , Armen Aghajanyan , Jessy Lin , Sida Wang , Eric Wallace , Freda Shi , Ruiqi Zhong , Wen-tau Yih , Luke Zettlemoyer , Mike Lewis