English

Enabling Generative Design Tools with LLM Agents for Mechanical Computation Devices: A Case Study

Human-Computer Interaction 2024-10-31 v3

Abstract

In the field of Human-Computer Interaction (HCI), interactive devices with embedded mechanical computation are gaining attention. The rise of these cutting-edge devices has created a need for specialized design tools that democratize the prototyping process. While current tools streamline prototyping through parametric design and simulation, they often come with a steep learning curve and may not fully support creative ideation. In this study, we use fluidic computation interfaces as a case study to explore how design tools for such devices can be augmented by Large Language Model agents (LLMs). Integrated with LLMs, the Generative Design Tool (GDT) better understands the capabilities and limitations of new technologies, proposes diverse and practical applications, and suggests designs that are technically and contextually appropriate. Additionally, it generates design parameters for visualizing results and producing fabrication-ready support files. This paper details the GDT's framework, implementation, and performance while addressing its potential and challenges.

Keywords

Cite

@article{arxiv.2405.17837,
  title  = {Enabling Generative Design Tools with LLM Agents for Mechanical Computation Devices: A Case Study},
  author = {Qiuyu Lu and Jiawei Fang and Zhihao Yao and Yue Yang and Shiqing Lyu and Haipeng Mi and Lining Yao},
  journal= {arXiv preprint arXiv:2405.17837},
  year   = {2024}
}

Comments

38 pages, 12 figures

R2 v1 2026-06-28T16:43:17.197Z