English
Related papers

Related papers: Athena: Intermediate Representations for Iterative…

200 papers

GUI prototyping serves as one of the most valuable techniques for enhancing the elicitation of requirements and facilitating the visualization and refinement of customer needs. While GUI prototyping has a positive impact on the software…

Software Engineering · Computer Science 2025-03-03 Kristian Kolthoff , Felix Kretzer , Christian Bartelt , Alexander Maedche , Simone Paolo Ponzetto

The integration of Large Language Models (LLMs) into interactive systems opens new opportunities for adaptive user experiences, yet it also raises challenges regarding accessibility, explainability, and normative compliance. This paper…

Human-Computer Interaction · Computer Science 2026-01-13 Blessing Jerry , Lourdes Moreno , Virginia Francisco , Raquel Hervas

Large language model (LLM) applications, such as ChatGPT, are a powerful tool for online information-seeking (IS) and problem-solving tasks. However, users still face challenges initializing and refining prompts, and their cognitive…

Human-Computer Interaction · Computer Science 2024-02-12 Ben Wang , Jiqun Liu , Jamshed Karimnazarov , Nicolas Thompson

Large Language Models (LLMs) have demonstrated their remarkable capabilities in numerous fields. This survey focuses on how LLMs empower users, regardless of their technical background, to use human languages to automatically generate…

Software Engineering · Computer Science 2025-04-03 Nam Huynh , Beiyu Lin

The recent advances in Large Language Models (LLMs) have stimulated interest among researchers and industry professionals, particularly in their application to tasks concerning mobile user interfaces (UIs). This position paper investigates…

Human-Computer Interaction · Computer Science 2023-10-25 Yuwen Lu , Ziang Tong , Qinyi Zhao , Chengzhi Zhang , Toby Jia-Jun Li

Large Language Models (LLMs) have helped programmers increase efficiency through code generation, comprehension, and repair. However, their application to large-scale projects remains challenging due to complex interdependencies and the…

Software Engineering · Computer Science 2025-02-26 Wuyang Zhang , Yansong Li , Zeyu Dong , Yu Wu , Yingyao Zhou , Duolei Wang , Songsirou Xing , Chichun Zhou , Da Shen

The advancement of Large Language Models (LLM) has also resulted in an equivalent proliferation in its applications. Software design, being one, has gained tremendous benefits in using LLMs as an interface component that extends fixed user…

Software Engineering · Computer Science 2024-07-01 Claudionor N. Coelho , Hanchen Xiong , Tushar Karayil , Sree Koratala , Rex Shang , Jacob Bollinger , Mohamed Shabar , Syam Nair

We aim to evaluate Large Language Models (LLMs) for embodied decision making. While a significant body of work has been leveraging LLMs for decision making in embodied environments, we still lack a systematic understanding of their…

Dialogue-based Role Playing Games (RPGs) require powerful storytelling. The narratives of these may take years to write and typically involve a large creative team. In this work, we demonstrate the potential of large generative text models…

Computation and Language · Computer Science 2024-06-07 Jorge Leandro , Sudha Rao , Michael Xu , Weijia Xu , Nebosja Jojic , Chris Brockett , Bill Dolan

To enhance productivity and to streamline workflows, there is a growing trend to embed large language model (LLM) functionality into applications, from browser-based web apps to native apps that run on personal computers. Here, we introduce…

Human-Computer Interaction · Computer Science 2024-08-01 Lukas Teufelberger , Xintong Liu , Zhipeng Li , Max Moebus , Christian Holz

Conversational AI interfaces powered by large language models (LLMs) are increasingly used as coding assistants. However, questions remain about how programmers interact with LLM-based conversational agents, the challenges they encounter,…

Human-Computer Interaction · Computer Science 2025-03-24 Mehmet Akhoroz , Caglar Yildirim

Programming social robots is challenging for novice robot programmers due to required expertise in planning, interaction design, and programming. While large language models (LLMs) hold significant promise through code generation from…

Human-Computer Interaction · Computer Science 2026-05-28 Arissa J. Sato , Callie Y. Kim , Nathan Thomas White , Abhinav Maneesh , Yuqing Wang , Hui-Ru Ho , Bilge Mutlu

With the advancement of Multimodal Large Language Models (MLLM), LLM-driven visual agents are increasingly impacting software interfaces, particularly those with graphical user interfaces. This work introduces a novel LLM-based multimodal…

Human-Computer Interaction · Computer Science 2025-09-18 Yanda Li , Chi Zhang , Wenjia Jiang , Wanqi Yang , Bin Fu , Pei Cheng , Xin Chen , Ling Chen , Yunchao Wei

Large Language Models (LLMs) are frequently discussed in academia and the general public as support tools for virtually any use case that relies on the production of text, including software engineering. Currently there is much debate, but…

Software Engineering · Computer Science 2024-05-22 Ranim Khojah , Mazen Mohamad , Philipp Leitner , Francisco Gomes de Oliveira Neto

Large Language Models (LLMs) such as ChatGPT and Llama have become prevalent in real-world applications, exhibiting impressive text generation performance. LLMs are fundamentally developed from a scenario where the input data remains static…

Artificial Intelligence · Computer Science 2024-09-09 Cheng'an Wei , Yue Zhao , Yujia Gong , Kai Chen , Lu Xiang , Shenchen Zhu

The rapid appearance of large language models (LLMs) has led to systems that turn natural-language intent into real user interfaces (UIs). Free-form code generation maximizes expressiveness but often hurts reliability, security, and…

Human-Computer Interaction · Computer Science 2025-11-04 Xinsong Li , Ning Jiang , Jay Selvaraj

This paper presents a novel approach to represent enterprise web application structures using Large Language Models (LLMs) to enable intelligent quality engineering at scale. We introduce a hierarchical representation methodology that…

Artificial Intelligence · Computer Science 2025-01-14 Zaber Al Hassan Ayon , Gulam Husain , Roshankumar Bisoi , Waliur Rahman , Dr Tom Osborn

The emergence of synthetic data represents a pivotal shift in modern machine learning, offering a solution to satisfy the need for large volumes of data in domains where real data is scarce, highly private, or difficult to obtain. We…

Computation and Language · Computer Science 2024-08-19 Krisztian Balog , John Palowitch , Barbara Ikica , Filip Radlinski , Hamidreza Alvari , Mehdi Manshadi

As Large Language Models (LLMs) and other forms of Generative AI permeate various aspects of our lives, their application for learning and education has provided opportunities and challenges. This paper presents an investigation into the…

Computers and Society · Computer Science 2023-06-06 Daniel Leiker , Sara Finnigan , Ashley Ricker Gyllen , Mutlu Cukurova

Large language models (LLMs) are capable of generating multiple responses to a single prompt, yet little effort has been expended to help end-users or system designers make use of this capability. In this paper, we explore how to present…

Human-Computer Interaction · Computer Science 2024-01-26 Katy Ilonka Gero , Chelse Swoopes , Ziwei Gu , Jonathan K. Kummerfeld , Elena L. Glassman