English
Related papers

Related papers: Insights into User Interface Innovations from a De…

200 papers

We present a comprehensive, in-depth review of ideation assisted by large language models (LLMs), highlighting emerging trends and identifying unaddressed research gaps. In total, we examined 61 studies investigating the application of LLMs…

Human-Computer Interaction · Computer Science 2025-07-29 Sitong Li , Stefano Padilla , Pierre Le Bras , Junyu Dong , Mike Chantler

The advancement of Large Language Models (LLM) has also resulted in an equivalent proliferation in its applications. Software design, being one, has gained tremendous benefits in using LLMs as an interface component that extends fixed user…

Software Engineering · Computer Science 2024-07-01 Claudionor N. Coelho , Hanchen Xiong , Tushar Karayil , Sree Koratala , Rex Shang , Jacob Bollinger , Mohamed Shabar , Syam Nair

Traditional UX development methodologies focus on developing ``one size fits all" solutions and lack the flexibility to cater to diverse user needs. In response, a growing interest has arisen in developing more dynamic UX frameworks.…

Software Engineering · Computer Science 2024-05-03 Yutan Huang

LLMs are popular among clinicians for decision-support because of simple text-based interaction. However, their impact on clinicians' performance is ambiguous. Not knowing how clinicians use this new technology and how they compare it to…

Human-Computer Interaction · Computer Science 2026-02-02 Behnam Rahdari , Sameer Shaikh , Jonathan H Chen , Tobias Gerstenberg , Shriti Raj

Architects adopt visual scripting and parametric design tools to explore more expansive design spaces (Coates, 2010), refine their thinking about the geometric logic of their design (Woodbury, 2010), and overcome conventional software…

Computation and Language · Computer Science 2024-12-05 Moritz Rietschel , Fang Guo , Kyle Steinfeld

Large language models (LLMs) are shaping a new user interface (UI) paradigm in writing tools by enabling users to generate text through prompts. This paradigm shifts some creative control from the user to the system, thereby diminishing the…

Human-Computer Interaction · Computer Science 2024-03-05 Jiho Kim , Ray C. Flanagan , Noelle E. Haviland , ZeAi Sun , Souad N. Yakubu , Edom A. Maru , Kenneth C. Arnold

User simulation has long played a vital role in computer science due to its potential to support a wide range of applications. Language, as the primary medium of human communication, forms the foundation of social interaction and behavior.…

Information graphics are pivotal in effective information dissemination and storytelling. However, creating such graphics is extremely challenging for non-professionals, since the design process requires multifaceted skills and…

Human-Computer Interaction · Computer Science 2024-01-25 Qirui Huang , Min Lu , Joel Lanir , Dani Lischinski , Daniel Cohen-Or , Hui Huang

As more applications of large language models (LLMs) for 3D content for immersive environments emerge, it is crucial to study user behaviour to identify interaction patterns and potential barriers to guide the future design of immersive…

Human-Computer Interaction · Computer Science 2026-04-09 Junlong Chen , Jens Grubert , Per Ola Kristensson

In this paper, we rethink the way that communication among users over the Internet, one of the fundamental outcomes of the Internet evolution, takes place. Instead of users communicating directly over the Internet, we explore an…

Networking and Internet Architecture · Computer Science 2023-09-26 Sifat Ut Taki , Spyridon Mastorakis

UX practitioners face novel challenges when designing user interfaces for machine learning (ML)-enabled applications. Interactive ML paradigms, like AutoML and interactive machine teaching, lower the barrier for non-expert end users to…

Human-Computer Interaction · Computer Science 2023-02-24 K. J. Kevin Feng , David W. McDonald

Large Language Models (LLMs) have shown much promise in powering a variety of software engineering (SE) tools. Offering natural language as an intuitive interaction mechanism, LLMs have recently been employed as conversational ``programming…

Software Engineering · Computer Science 2026-04-15 Jonan Richards

Wearable design is an interdisciplinary field that balances technological innovation, human factors, and human-computer interactions. Despite contributions from various disciplines, many projects lack stable interdisciplinary teams, which…

Human-Computer Interaction · Computer Science 2024-10-10 Qiyang Miao , Jiang Xu , Zhihao Song , Chengrui Wang , Yu Cui

While LLMs enable a range of AI applications, interacting with multiple models and customizing workflows can be challenging, and existing LLM interfaces offer limited support for collaborative extension or real-world evaluation. In this…

Human-Computer Interaction · Computer Science 2025-10-06 Jaeryang Baek , Ayana Hussain , Danny Liu , Nicholas Vincent , Lawrence H. Kim

Despite being trained on vast amounts of data, most LLMs are unable to reliably generate well-designed UIs. Designer feedback is essential to improving performance on UI generation; however, we find that existing RLHF methods based on…

Human-Computer Interaction · Computer Science 2026-02-18 Jason Wu , Amanda Swearngin , Arun Krishna Vajjala , Alan Leung , Jeffrey Nichols , Titus Barik

Large language models (LLMs) can enhance writing by automating or supporting specific tasks in writers' workflows (e.g., paraphrasing, creating analogies). Leveraging this capability, a collection of interfaces have been developed that…

Human-Computer Interaction · Computer Science 2023-03-28 Tae Soo Kim , Arghya Sarkar , Yoonjoo Lee , Minsuk Chang , Juho Kim

Usability is a key factor in the effectiveness of recommender systems. However, the analysis of user interfaces is a time-consuming process that requires expertise. Recent advances in multimodal large language models (LLMs) offer promising…

Human-Computer Interaction · Computer Science 2025-11-19 Sebastian Lubos , Alexander Felfernig , Damian Garber , Viet-Man Le , Thi Ngoc Trang Tran

Large Language Models (LLMs), such as ChatGPT, exhibit advanced capabilities in generating text, images, and videos. However, their effective use remains constrained by challenges in prompt formulation, personalization, and opaque…

Human-Computer Interaction · Computer Science 2025-03-04 Si Thu , A. Baki Kocaballi

Large language models (LLMs) have rapidly evolved from general-purpose systems to multimodal models capable of processing text, images, and audio. As both general-purpose LLMs (GLLMs) and multimodal LLMs (MLLMs) gain widespread adoption,…

Software Engineering · Computer Science 2026-04-08 Yujian Liu , Xiao Yu , Jacky Keung , Xing Hu , Xin Xia , Xiaoxue Ma