English
Related papers

Related papers: Visualizationary: Automating Design Feedback for V…

200 papers

Large language models (LLMs) have recently soared in popularity due to their ease of access and the unprecedented ability to synthesize text responses to diverse user questions. However, LLMs like ChatGPT present significant limitations in…

Human-Computer Interaction · Computer Science 2023-08-08 Peiling Jiang , Jude Rayan , Steven P. Dow , Haijun Xia

Large Language Models (LLMs) are increasingly used in complex knowledge work, yet linear transcript interfaces limit support for reflection. Schon's Reflective Practice distinguishes between reflection-in-action (during a task) and…

Human-Computer Interaction · Computer Science 2025-12-30 Geoff Kimm , Linus Tan

Large language models (LLMs) are now accessible to anyone with a computer, a web browser, and an internet connection via browser-based interfaces, shifting the dynamics of participation in AI development. This article examines how…

Human-Computer Interaction · Computer Science 2025-10-31 Ned Cooper , Alexandra Zafiroglu

Large Language Models (LLMs) are transforming Conversational Visual Analytics (CVA) by enabling data analysis through natural language. However, evaluating LLMs for CVA remains a challenge: requiring programming expertise, overlooking…

Human-Computer Interaction · Computer Science 2026-03-09 Srishti Palani , Vidya Setlur

Multimodal Vision-Language Models (VLMs) enable powerful applications from their fused understanding of images and language, but many perform poorly on UI tasks due to the lack of UI training data. In this paper, we adapt a recipe for…

Human-Computer Interaction · Computer Science 2023-10-10 Yue Jiang , Eldon Schoop , Amanda Swearngin , Jeffrey Nichols

Recent advances in large language models (LLMs) have shown great potential in automating the process of visualization authoring through simple natural language utterances. However, instructing LLMs using natural language is limited in…

Human-Computer Interaction · Computer Science 2025-04-21 Zhen Wen , Luoxuan Weng , Yinghao Tang , Runjin Zhang , Yuxin Liu , Bo Pan , Minfeng Zhu , Wei Chen

Immersive virtual reality (VR) offers affordances that may reduce cognitive complexity in binary reverse engineering (RE), enabling embodied and external cognition to augment the RE process through enhancing memory, hypothesis testing, and…

Human-Computer Interaction · Computer Science 2025-08-20 Dennis Brown , Samuel Mulder

The recent success of large language models (LLMs) has shown great potential to develop more powerful conversational recommender systems (CRSs), which rely on natural language conversations to satisfy user needs. In this paper, we embark on…

Computation and Language · Computer Science 2024-06-21 Xiaolei Wang , Xinyu Tang , Wayne Xin Zhao , Jingyuan Wang , Ji-Rong Wen

Generative Large Language Models (LLMs) show potential in data analysis, yet their full capabilities remain uncharted. Our work explores the capabilities of LLMs for creating and refining visualizations via conversational interfaces. We…

Human-Computer Interaction · Computer Science 2023-11-10 Matt-Heun Hong , Anamaria Crisan

As large language models (LLMs) like ChatGPT exhibited unprecedented machine intelligence, it also shows great performance in assisting hardware engineers to realize higher-efficiency logic design via natural language interaction. To…

Artificial Intelligence · Computer Science 2025-10-14 Kaiyan Chang , Ying Wang , Haimeng Ren , Mengdi Wang , Shengwen Liang , Yinhe Han , Huawei Li , Xiaowei Li

This paper studies how large language models (LLMs) can act as effective, high-level creative collaborators and ``muses'' for game design. We model the design of this study after the exercises artists use by looking at amorphous ink…

Artificial Intelligence · Computer Science 2024-03-06 Asad Anjum , Yuting Li , Noelle Law , M Charity , Julian Togelius

Large language models (LLMs) struggle to consistently generate UI code that compiles and produces visually relevant designs. Existing approaches to improve generation rely on expensive human feedback or distilling a proprietary model. In…

Computation and Language · Computer Science 2024-06-13 Jason Wu , Eldon Schoop , Alan Leung , Titus Barik , Jeffrey P. Bigham , Jeffrey Nichols

Scientific workflow systems are increasingly popular for expressing and executing complex data analysis pipelines over large datasets, as they offer reproducibility, dependability, and scalability of analyses by automatic parallelization on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-09 Mario Sänger , Ninon De Mecquenem , Katarzyna Ewa Lewińska , Vasilis Bountris , Fabian Lehmann , Ulf Leser , Thomas Kosch

We present a work in progress that explores using a Large Language Model (LLM) as a design material for an interactive museum installation. LLMs offer the possibility of creating chatbots that can facilitate dynamic and human-like…

Human-Computer Interaction · Computer Science 2025-03-31 Maria Padilla Engstrøm , Anders Sundnes Løvlie

Large language models (LLMs) provide a new way to build chatbots by accepting natural language prompts. Yet, it is unclear how to design prompts to power chatbots to carry on naturalistic conversations while pursuing a given goal, such as…

Human-Computer Interaction · Computer Science 2024-05-08 Jing Wei , Sungdong Kim , Hyunhoon Jung , Young-Ho Kim

Large Language Models (LLMs) offer a promising basis for creating agents that can tackle complex tasks through iterative environmental interaction. Existing methods either require these agents to mimic expert-provided trajectories or rely…

Computation and Language · Computer Science 2024-12-02 Dihong Gong , Pu Lu , Zelong Wang , Meng Zhou , Xiuqiang He

Large language models (LLMs) have proven effective for layout generation due to their ability to produce structure-description languages, such as HTML or JSON. In this paper, we argue that while LLMs can perform reasonably well in certain…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jiahao Zhang , Ryota Yoshihashi , Shunsuke Kitada , Atsuki Osanai , Yuta Nakashima

This paper assesses the potential for large language models (LLMs) to serve as assistive tools in the creative writing process, by means of a single, in-depth case study. In the course of the study, we develop interactive and multi-voice…

Computation and Language · Computer Science 2023-12-08 Murray Shanahan , Catherine Clarke

Large Language Models (LLMs), such as ChatGPT, have become widely popular and widely used in various software engineering tasks such as refactoring, testing, code review, and program comprehension. Although recent studies have examined the…

Software Engineering · Computer Science 2025-09-11 Eman Abdullah AlOmar , Luo Xu , Sofia Martinez , Anthony Peruma , Mohamed Wiem Mkaouer , Christian D. Newman , Ali Ouni

The development of large language models (LLMs) capable of following instructions and engaging in conversational interactions sparked increased interest in their utilization across various support tools. We investigate the utility of modern…

Human-Computer Interaction · Computer Science 2024-01-31 Tuhin Chakrabarty , Vishakh Padmakumar , Faeze Brahman , Smaranda Muresan