English
Related papers

Related papers: Does GenAI Make Usability Testing Obsolete?

200 papers

Simulated user agents are increasingly used in usability testing to support fast, iterative UX workflows, as they generate rich data such as action logs and think-aloud reasoning, but the unstructured nature of this output often obscures…

Human-Computer Interaction · Computer Science 2026-01-23 Steffen Holter , Eunyee Koh , Mustafa Doga Dogan , Gromit Yeuk-Yin Chan

This systematic literature review examines the role of large language models (LLMs) in UI/UX design, synthesizing findings from 38 peer-reviewed studies published between 2022 and 2025. We identify key LLMs in use, including GPT-4, Gemini,…

Human-Computer Interaction · Computer Science 2025-07-21 Ammar Ahmed , Ali Shariq Imran

AI text-to-app tools promise high quality applications and websites in minutes, yet no public benchmark rigorously verifies those claims. We introduce UI-Bench, the first large-scale benchmark that evaluates visual excellence across…

Computation and Language · Computer Science 2025-09-05 Sam Jung , Agustin Garcinuno , Spencer Mateega

The rapid advancement of mobile applications has led to a significant demand for cross-platform compatibility, particularly between the Android and iOS platforms. Traditional approaches to mobile application translation often rely on manual…

Software Engineering · Computer Science 2025-07-23 Zhili Zeng , Kimya Khakzad Shahandashti , Alvine Boaye Belle , Song Wang , Zhen Ming , Jiang

Large Language Models (LLMs) are rapidly becoming integral to a wide range of tools, tasks, and problem-solving processes, especially in software development. Originally designed for natural language processing tasks such as text…

Human-Computer Interaction · Computer Science 2025-04-25 Prashant Chandrasekar , Mariel Couvillion , Ayshwarya Saktheeswaran , Jessica Zeitz

Interpretability tools that offer explanations in the form of a dialogue have demonstrated their efficacy in enhancing users' understanding (Slack et al., 2023; Shen et al., 2023), as one-off explanations may fall short in providing…

Computation and Language · Computer Science 2024-04-25 Qianli Wang , Tatiana Anikina , Nils Feldhus , Josef van Genabith , Leonhard Hennig , Sebastian Möller

Usability evaluation is critical to the impact and adoption of open source software (OSS), yet traditional methods relying on human evaluators suffer from high costs and limited scalability. To address these limitations, we introduce…

Software Engineering · Computer Science 2025-05-30 Lingkai Meng , Yu Shao , Long Yuan , Longbin Lai , Peng Cheng , Wenyuan Yu , Wenjie Zhang , Xuemin Lin , Jingren Zhou

Ensuring accessibility in mobile applications remains a significant challenge, particularly for visually impaired users who rely on screen readers. User interface icons are essential for navigation and interaction and often lack meaningful…

Human-Computer Interaction · Computer Science 2024-10-10 Sabrina Haque , Christoph Csallner

In the field of human-computer interaction (HCI), the usability assessment of m-learning (mobile-learning) applications is a real challenge. Such assessment typically involves extraction of the best features of an application like…

Human-Computer Interaction · Computer Science 2024-04-26 Muhammad Asghar , Imran Sarwar Bajwa , Shabana Ramzan , Hina Afreen , Saima Abdullah

With the remarkable advancements of large language models (LLMs), LLM-based agents have become a research hotspot in human-computer interaction. However, there is a scarcity of benchmarks available for LLM-based mobile agents. Benchmarking…

Artificial Intelligence · Computer Science 2024-07-02 Shihan Deng , Weikai Xu , Hongda Sun , Wei Liu , Tao Tan , Jianfeng Liu , Ang Li , Jian Luan , Bin Wang , Rui Yan , Shuo Shang

Modern software systems are subjected to various types of uncertainties arising from context, environment, etc. To this end, self-adaptation techniques have been sought out as potential solutions. Although recent advances in self-adaptation…

Software Engineering · Computer Science 2024-04-16 Raghav Donakanti , Prakhar Jain , Shubham Kulkarni , Karthik Vaidhyanathan

As the bridge between users and software, Graphical User Interface (GUI) is critical to the app accessibility. Scaling up the font or display size of GUI can help improve the visual impact, readability, and usability of an app, and is…

Software Engineering · Computer Science 2022-12-09 Yuhui Su , Chunyang Chen , Junjie Wang , Zhe Liu , Dandan Wang , Shoubin Li , Qing Wang

Large Language Models (LLMs) are increasingly being used for automated evaluations and explaining them. However, concerns about explanation quality, consistency, and hallucinations remain open research challenges, particularly in…

Human-Computer Interaction · Computer Science 2025-04-18 Vincent Freiberger , Arthur Fleig , Erik Buchmann

In recent years, predicting mobile app usage has become increasingly important for areas like app recommendation, user behaviour analysis, and mobile resource management. Existing models, however, struggle with the heterogeneous nature of…

Computation and Language · Computer Science 2024-11-04 Yonchanok Khaokaew , Hao Xue , Flora D. Salim

In an ideal design pipeline, user interface (UI) design is intertwined with user research to validate decisions, yet studies are often resource-constrained during early exploration. Recent advances in multimodal large language models…

Graphical User Interface (GUI) provides a visual bridge between a software application and end users, through which they can interact with each other. With the development of technology and aesthetics, the visual effects of the GUI are more…

Software Engineering · Computer Science 2020-09-08 Zhe Liu , Chunyang Chen , Junjie Wang , Yuekai Huang , Jun Hu , Qing Wang

Large multimodal models (LMMs) have enabled new AI-powered applications that help people with visual impairments (PVI) receive natural language descriptions of their surroundings through audible text. We investigated how this emerging…

Human-Computer Interaction · Computer Science 2025-02-25 Jingyi Xie , Rui Yu , He Zhang , Syed Masum Billah , Sooyeon Lee , John M. Carroll

Large Language Models (LLMs) have the unique capability to understand and generate human-like text from input queries. When fine-tuned, these models show enhanced performance on domain-specific queries. OpenAI highlights the process of…

Computation and Language · Computer Science 2024-07-02 Scott Barnett , Zac Brannelly , Stefanus Kurniawan , Sheng Wong

The widespread adoption of web applications has made their security a critical concern and has increased the need for systematic ways to assess whether they can be considered trustworthy. However, "trust" assessment remains an open problem…

Cryptography and Security · Computer Science 2026-03-26 Oleksandr Yarotskyi , José D'Abruzzo Pereira , João R. Campos