Usability Analysis of Configurator User Interfaces with Multimodal Large Language Models
Abstract
Configuration is a key technology for tailoring complex software systems, services, and products. A successful application of configurators not only depends on technical correctness, performance, and domain modeling but also on their usability. While general usability heuristics are widely used, configurator-specific criteria and tool support for systematic user interface (UI) analysis are limited. This paper explores the use of multimodal large language models (MLLMs) for scalable and semi-automated usability analysis of configurator UIs. We synthesize 18 configurator-specific usability criteria from the literature and apply these criteria in an MLLM-based analysis of 16 real-world configurators. Each criterion is assessed individually to generate severity ratings for usability issues and actionable improvement suggestions. A review of the results confirms that MLLMs can reliably identify configurator-specific usability issues and provide domain-aware improvement recommendations. Although human validation remains necessary, this approach has the potential to significantly reduce the required effort to analyze configurator usability.
Cite
@article{arxiv.2605.29456,
title = {Usability Analysis of Configurator User Interfaces with Multimodal Large Language Models},
author = {Sebastian Lubos and Alexander Felfernig and Damian Garber and Adnan Kraljić and Tarik Kraljić and Viet-Man Le and Thi Ngoc Trang Tran and Gerhard Leitner and Julian Schwazer and Doris Suppan and Reinhard Willfort and Ivan Dukic and Jeremias Fuchs and Manuel Henrich},
journal= {arXiv preprint arXiv:2605.29456},
year = {2026}
}