English

On the Utility of Domain Modeling Assistance with Large Language Models

Software Engineering 2024-10-17 v1 Artificial Intelligence Human-Computer Interaction

Abstract

Model-driven engineering (MDE) simplifies software development through abstraction, yet challenges such as time constraints, incomplete domain understanding, and adherence to syntactic constraints hinder the design process. This paper presents a study to evaluate the usefulness of a novel approach utilizing large language models (LLMs) and few-shot prompt learning to assist in domain modeling. The aim of this approach is to overcome the need for extensive training of AI-based completion models on scarce domain-specific datasets and to offer versatile support for various modeling activities, providing valuable recommendations to software modelers. To support this approach, we developed MAGDA, a user-friendly tool, through which we conduct a user study and assess the real-world applicability of our approach in the context of domain modeling, offering valuable insights into its usability and effectiveness.

Keywords

Cite

@article{arxiv.2410.12577,
  title  = {On the Utility of Domain Modeling Assistance with Large Language Models},
  author = {Meriem Ben Chaaben and Lola Burgueño and Istvan David and Houari Sahraoui},
  journal= {arXiv preprint arXiv:2410.12577},
  year   = {2024}
}