English
Related papers

Related papers: DesignAsCode: Bridging Structural Editability and …

200 papers

Generative AI has made rapid advancements in recent years, achieving unprecedented capabilities in multimodal understanding and code generation. This can enable a new paradigm of front-end development in which multimodal large language…

Computation and Language · Computer Science 2025-02-11 Chenglei Si , Yanzhe Zhang , Ryan Li , Zhengyuan Yang , Ruibo Liu , Diyi Yang

Design generation requires tight integration of neural and symbolic reasoning, as good design must meet explicit user needs and honor implicit rules for aesthetics, utility, and convenience. Current automated design tools driven by neural…

Artificial Intelligence · Computer Science 2024-11-18 Maxwell Joseph Jacobson , Yexiang Xue

Sewing patterns, the essential blueprints for fabric cutting and tailoring, act as a crucial bridge between design concepts and producible garments. However, existing uni-modal sewing pattern generation models struggle to effectively encode…

Graphics · Computer Science 2025-04-10 Feng Zhou , Ruiyang Liu , Chen Liu , Gaofeng He , Yong-Lu Li , Xiaogang Jin , Huamin Wang

It is common in graphic design humans visually arrange various elements according to their design intent and semantics. For example, a title text almost always appears on top of other elements in a document. In this work, we generate…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Kotaro Kikuchi , Edgar Simo-Serra , Mayu Otani , Kota Yamaguchi

By optimizing aesthetics, graph diagrams can be generated that are easier to read and understand. However, the challenge lies in identifying suitable aesthetics. We present a novel approach based on repertory grids to explore the design…

Human-Computer Interaction · Computer Science 2020-08-19 David Baum

Recent advancements in Unified Multimodal Models (UMMs) have significantly advanced text-to-image (T2I) generation, particularly through the integration of Chain-of-Thought (CoT) reasoning. However, existing CoT-based T2I methods largely…

Artificial Intelligence · Computer Science 2026-03-10 Haodong Li , Chunmei Qing , Huanyu Zhang , Dongzhi Jiang , Yihang Zou , Hongbo Peng , Dingming Li , Yuhong Dai , ZePeng Lin , Juanxi Tian , Yi Zhou , Siqi Dai , Jingwei Wu

We introduce CODS (Computational Optimization in Design Space), a theoretical model that frames computational design as a constrained optimization problem over a structured, multi-dimensional design space. Unlike existing methods that rely…

Human-Computer Interaction · Computer Science 2025-06-24 Nan Cao , Xiaoyu Qi , Chuer Chen , Xiaoke Yan

Code completion is a prominent application of Large Language Models (LLMs) in software engineering. Due to the near real-time response requirements of this task, base models with small to medium-sized parameters are typically employed,…

Software Engineering · Computer Science 2025-09-18 Dongjun Yu , Xiao Yan , Zhenrui Li , Jipeng Xiao , Haochuan He , Yongda Yu , Hao Zhang , Guoping Rong , Xiaobo Huang

Generative AI is reshaping product design practices through "vibe coding," where product team members express intent in natural language and AI translates it into functional prototypes and code. Despite rapid adoption, little research has…

Human-Computer Interaction · Computer Science 2026-05-04 Jie Li , Youyang Hou , Laura Lin , Ruihao Zhu , Hancheng Cao , Abdallah El Ali

Parametric CAD sequences are reusable because dimensional and geometric constraints govern how parameter changes propagate. Existing CAD generation datasets and benchmarks emphasize reconstruction fidelity, execution validity, or static…

Graphics · Computer Science 2026-05-05 Xintong Dong , Chuanyang Li , Peng Zheng , Chuqi Han , Jiaxin Jing , Hailong Shen , Yanzhi Song , Zhouwang Yang

The customization of text-to-image models has seen significant advancements, yet generating multiple personalized concepts remains a challenging task. Current methods struggle with attribute leakage and layout confusion when handling…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zebin Yao , Fangxiang Feng , Ruifan Li , Xiaojie Wang

As AI systems move into high stakes domains such as legal reasoning, medical diagnosis, and financial decision making, regulators and practitioners increasingly demand auditability. Auditability means the ability to trace exactly what each…

Artificial Intelligence · Computer Science 2026-01-05 Xin Guan , Yunshan Li , Zekun Wu , Ruibo Zhang

Graphic design plays a crucial role in both commercial and personal contexts, yet creating high-quality, editable, and aesthetically pleasing graphic compositions remains a time-consuming and skill-intensive task, especially for beginners.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Zhao Zhang , Yutao Cheng , Dexiang Hong , Maoke Yang , Gonglei Shi , Lei Ma , Hui Zhang , Jie Shao , Xinglong Wu

Converting webpage designs into code (design-to-code) plays a vital role in User Interface (UI) development for front-end developers, bridging the gap between visual design and functional implementation. While recent Multimodal Large…

Software Engineering · Computer Science 2025-08-06 Yi Gui , Zhen Li , Zhongyi Zhang , Guohao Wang , Tianpeng Lv , Gaoyang Jiang , Yi Liu , Dongping Chen , Yao Wan , Hongyu Zhang , Wenbin Jiang , Xuanhua Shi , Hai Jin

Multimodal Large Language Models (MLLMs) struggle with precise reasoning for structured visuals like charts and diagrams, as pixel-based perception lacks a mechanism for verification. To address this, we propose to leverage derendering --…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Junhong Shen , Mu Cai , Bo Hu , Ameet Talwalkar , David A Ross , Cordelia Schmid , Alireza Fathi

Despite the continuous efforts in improving both the effectiveness and efficiency of code search, two issues remained unsolved. First, programming languages have inherent strong structural linkages, and feature mining of code as text form…

Software Engineering · Computer Science 2022-08-09 Yi Hu , Bo Cai , Yaoxiang Yu

Recently, with the development of Neural Radiance Fields and Gaussian Splatting, 3D reconstruction techniques have achieved remarkably high fidelity. However, the latent representations learnt by these methods are highly entangled and lack…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Shuyi Jiang , Qihao Zhao , Hossein Rahmani , De Wen Soh , Jun Liu , Na Zhao

Humans write code in a fundamentally interactive manner and rely on constant execution feedback to correct errors, resolve ambiguities, and decompose tasks. While LLMs have recently exhibited promising coding capabilities, current coding…

Computation and Language · Computer Science 2023-10-31 John Yang , Akshara Prabhakar , Karthik Narasimhan , Shunyu Yao

Large Language Models (LLMs) have become valuable assistants for developers in code-related tasks. While LLMs excel at traditional programming tasks such as code generation and bug fixing, they struggle with visually-oriented coding tasks,…

Computation and Language · Computer Science 2025-10-28 Bang Xiao , Lingjie Jiang , Shaohan Huang , Tengchao Lv , Yupan Huang , Xun Wu , Lei Cui , Furu Wei

We introduce KodCode, a synthetic dataset that addresses the persistent challenge of acquiring high-quality, verifiable training data across diverse difficulties and domains for training Large Language Models for coding. Existing…

Machine Learning · Computer Science 2025-07-15 Zhangchen Xu , Yang Liu , Yueqin Yin , Mingyuan Zhou , Radha Poovendran