English
Related papers

Related papers: UXAgent: An LLM Agent-Based Usability Testing Fram…

200 papers

The believable simulation of multi-user behavior is crucial for understanding complex social systems. Recently, large language models (LLMs)-based AI agents have made significant progress, enabling them to achieve human-like intelligence…

Artificial Intelligence · Computer Science 2024-12-16 Yijun Liu , Wu Liu , Xiaoyan Gu , Yong Rui , Xiaodong He , Yongdong Zhang

With the advancement of Multimodal Large Language Models (MLLM), LLM-driven visual agents are increasingly impacting software interfaces, particularly those with graphical user interfaces. This work introduces a novel LLM-based multimodal…

Human-Computer Interaction · Computer Science 2025-09-18 Yanda Li , Chi Zhang , Wenjia Jiang , Wanqi Yang , Bin Fu , Pei Cheng , Xin Chen , Ling Chen , Yunchao Wei

User Experience (UX) Research covers various methods for gathering the users' subjective impressions of a product. For this, practitioners face different activities and tasks related to the research process. This includes processing a large…

Human-Computer Interaction · Computer Science 2025-06-05 Stefan Graser , Anastasia Snimshchikova , Martin Schrepp , Stephan Böhm

Requirements elicitation, a critical, yet time-consuming and challenging step in product development, often fails to capture the full spectrum of user needs. This may lead to products that fall short of expectations. This paper introduces a…

Human-Computer Interaction · Computer Science 2024-04-26 Mohammadmehdi Ataei , Hyunmin Cheong , Daniele Grandi , Ye Wang , Nigel Morris , Alexander Tessier

Trajectory modeling, which includes research on trajectory data pattern mining and future prediction, has widespread applications in areas such as life services, urban transportation, and public administration. Numerous methods have been…

Computation and Language · Computer Science 2025-10-29 Yuwei Du , Jie Feng , Jie Zhao , Yong Li

ChatGPT, powered by a large language model (LLM), has revolutionized everyday human-computer interaction (HCI) since its 2022 release. While now used by millions around the world, a coherent pathway for evaluating the user experience (UX)…

Human-Computer Interaction · Computer Science 2025-03-21 Katie Seaborn

User modeling (UM) aims to discover patterns or learn representations from user data about the characteristics of a specific user, such as profile, preference, and personality. The user models enable personalization and suspiciousness…

Computation and Language · Computer Science 2023-12-27 Zhaoxuan Tan , Meng Jiang

Large language models (LLMs) are increasingly used as simulated participants in social science experiments, but their behavior is often unstable and highly sensitive to design choices. Prior evaluations frequently conflate base-model…

Artificial Intelligence · Computer Science 2026-02-03 Xuan Liu , Haoyang Shang , Zizhang Liu , Xinyan Liu , Yunze Xiao , Yiwen Tu , Haojian Jin

The recent developments in Large Language Models (LLM), mark a significant moment in the research and development of social interactions with artificial agents. These agents are widely deployed in a variety of settings, with potential…

Human-Computer Interaction · Computer Science 2024-07-03 Guy Laban , Tomer Laban , Hatice Gunes

Ensuring usability is crucial for the success of mobile apps. Usability issues can compromise user experience and negatively impact the perceived app quality. This paper presents UX-LLM, a novel tool powered by a Large Vision-Language Model…

Software Engineering · Computer Science 2026-01-14 Ali Ebrahimi Pourasad , Walid Maalej

The proliferation of Large Language Model (LLM)-based Graphical User Interface (GUI) agents in web browsing scenarios present complex unintended consequences (UCs). This paper characterizes three UCs from three perspectives: phenomena,…

Human-Computer Interaction · Computer Science 2025-05-19 Shuning Zhang , Jingruo Chen , Zhiqi Gao , Jiajing Gao , Xin Yi , Hewu Li

Usability evaluation is an essential method to support the design of effective and intuitive user interfaces (UIs). However, it commonly relies on resource-intensive, expert-driven methods, which limit its accessibility, especially for…

Software Engineering · Computer Science 2026-04-13 Sebastian Lubos , Alexander Felfernig , Damian Garber , Gerhard Leitner , Julian Schwazer , Manuel Henrich

Automated web testing plays a critical role in ensuring high-quality user experiences and delivering business value. Traditional approaches primarily focus on code coverage and load testing, but often fall short of capturing complex user…

Software Engineering · Computer Science 2025-09-08 Naimeng Ye , Xiao Yu , Ruize Xu , Tianyi Peng , Zhou Yu

The pace of scientific research, vital for improving human life, is complex, slow, and needs specialized expertise. Meanwhile, novel, impactful research often stems from both a deep understanding of prior work, and a cross-pollination of…

Computation and Language · Computer Science 2025-02-11 Jinheon Baek , Sujay Kumar Jauhar , Silviu Cucerzan , Sung Ju Hwang

Recently, large language model (LLM)-based agents have achieved significant success in interactive environments, attracting significant academic and industrial attention. Despite these advancements, current research predominantly focuses on…

Computation and Language · Computer Science 2025-05-22 Peng Wang , Ruihan Tao , Qiguang Chen , Mengkang Hu , Libo Qin

Computational social experiments, which typically employ agent-based modeling to create testbeds for piloting social experiments, not only provide a computational solution to the major challenges faced by traditional experimental methods,…

Computers and Society · Computer Science 2025-08-13 Jinghua Piao , Yuwei Yan , Nian Li , Jun Zhang , Yong Li

Recent advances in foundation models, particularly Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs), have facilitated the development of intelligent agents capable of performing complex tasks. By leveraging the…

Recent advancements in Large Language Models (LLMs) have led to the development of intelligent LLM-based agents capable of interacting with graphical user interfaces (GUIs). These agents demonstrate strong reasoning and adaptability,…

Artificial Intelligence · Computer Science 2025-04-16 Wenjia Jiang , Yangyang Zhuang , Chenxi Song , Xu Yang , Joey Tianyi Zhou , Chi Zhang

Capturing human learning behavior based on deep learning methods has become a major research focus in both psychology and intelligent systems. Recent approaches rely on controlled experiments or rule-based models to explore cognitive…

Artificial Intelligence · Computer Science 2025-08-08 Yu Yuan , Lili Zhao , Wei Chen , Guangting Zheng , Kai Zhang , Mengdi Zhang , Qi Liu

Usability is a key factor in the effectiveness of recommender systems. However, the analysis of user interfaces is a time-consuming process that requires expertise. Recent advances in multimodal large language models (LLMs) offer promising…

Human-Computer Interaction · Computer Science 2025-11-19 Sebastian Lubos , Alexander Felfernig , Damian Garber , Viet-Man Le , Thi Ngoc Trang Tran