English
Related papers

Related papers: CGui Toolchain for Highly Customized GUI Developme…

200 papers

The advent of cyber-physical systems, such as robots and autonomous vehicles (AVs), brings new opportunities and challenges for the domain of interaction design. Though there is consensus about the value of human-centred development, there…

Human-Computer Interaction · Computer Science 2024-06-14 Marius Hoggenmuller , Martin Tomitsch , Callum Parker , Trung Thanh Nguyen , Dawei Zhou , Stewart Worrall , Eduardo Nebot

There has been a widespread emergence of computing devices in the past few years that go beyond the capabilities of traditional desktop computers. However, users want to use the same kinds of applications and access the same data and…

Human-Computer Interaction · Computer Science 2007-05-23 Mir Farooq Ali , Manuel A. Perez-Quinones , Eric Shell , Marc Abrams

This paper introduces an automated heuristic process able to achieve high accuracy when matching graphical user interface widgets across multiple versions of a target application. The proposed implementation is flexible as it allows full…

Software Engineering · Computer Science 2017-02-24 Arthur-Jozsef Molnar

Computer-Use Agents (CUA) are becoming increasingly capable of autonomously operating digital environments through Graphical User Interfaces (GUI). Yet, most GUI remain designed primarily for humans--prioritizing aesthetics and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Kevin Qinghong Lin , Siyuan Hu , Linjie Li , Zhengyuan Yang , Lijuan Wang , Philip Torr , Mike Zheng Shou

Present-day graphical user interfaces (GUIs) exhibit diverse arrangements of text, graphics, and interactive elements such as buttons and menus, but representations of GUIs have not kept up. They do not encapsulate both semantic and…

Human-Computer Interaction · Computer Science 2024-04-23 Yue Jiang , Changkong Zhou , Vikas Garg , Antti Oulasvirta

GUI (graphical user interface) prototyping is a widely-used technique in requirements engineering for gathering and refining requirements, reducing development risks and increasing stakeholder engagement. However, GUI prototyping can be a…

Software Engineering · Computer Science 2023-10-05 Jialiang Wei , Anne-Lise Courbis , Thomas Lambolais , Binbin Xu , Pierre Louis Bernard , Gérard Dray

Prototyping is one of the core activities of User-Centered Design (UCD) processes and an integral component of Human-Computer Interaction (HCI) research. For many years, prototyping was synonym of paper-based mockups and only more recently…

Human-Computer Interaction · Computer Science 2019-06-05 Thiago Rocha , Jean-Luc Hak , Marco Winckler , Olivier Nicolas

AI can now generate high-fidelity UI mock-up screens from a high-level textual description, promising to support UX practitioners' work. However, it remains unclear how UX practitioners would adopt such Generative UI (GenUI) models in a way…

Human-Computer Interaction · Computer Science 2025-05-21 Xiang 'Anthony' Chen , Tiffany Knearem , Yang Li

GPUs and other accelerators are popular devices for accelerating compute-intensive, parallelizable applications. However, programming these devices is a difficult task. Writing efficient device code is challenging, and is typically done in…

Programming Languages · Computer Science 2018-10-23 Tim Besard , Christophe Foket , Bjorn De Sutter

We present a workflow and associated toolkit to automate the creation of graphical user interfaces (GUI) for executables run from command line interfaces (CLI). The workflow consists of three phases, namely (Step 1) the plugin design, (Step…

Human-Computer Interaction · Computer Science 2026-02-19 Sikao Guo , Edoardo Sarti , Frédéric Cazals

Requirements Elicitation (RE) is a crucial activity especially in the early stages of software development. GUI prototyping has widely been adopted as one of the most effective RE techniques for user-facing software systems. However, GUI…

Software Engineering · Computer Science 2024-09-26 Kristian Kolthoff , Christian Bartelt , Simone Paolo Ponzetto , Kurt Schneider

Human-centered AI (HCAI) puts the user in the driver's seat of so-called human-centered AI-infused tools (HCAI tools): interactive software tools that amplify, augment, empower, and enhance human performance using AI models. We discuss how…

Human-Computer Interaction · Computer Science 2024-11-05 Md Naimul Hoque , Sungbok Shin , Niklas Elmqvist

This article presents a new proposal design of GUI and new technology in programming Namely "Super Technology" which can be applied for supporting the proposal design of GUI

Human-Computer Interaction · Computer Science 2016-12-20 Mahmoud Samir Fayed , Ehab Aziz Khalil

Since the first Graphical User Interface (GUI) prototype was invented in the 1970s, GUI systems have been deployed into various personal computer systems and server platforms. Recently, with the development of artificial intelligence (AI)…

Cryptography and Security · Computer Science 2020-01-28 Ning Yu , Zachary Tuttle , Carl Jake Thurnau , Emmanuel Mireku

As interfaces evolve from static user pathways to dynamic human-AI collaboration, no standard methods exist for selecting appropriate interface patterns based on user needs and task complexity. Existing frameworks only provide guiding…

Human-Computer Interaction · Computer Science 2026-02-27 Shruthi Andru , Shrut Kirti Saksena

Graphical User Interface (GUI) agents, which autonomously operate on digital interfaces through natural language instructions, hold transformative potential for accessibility, automation, and user experience. A critical aspect of their…

Human-Computer Interaction · Computer Science 2025-05-28 Yuheng Lu , Qian Yu , Hongru Wang , Zeming Liu , Wei Su , Yanping Liu , Yuhang Guo , Maocheng Liang , Yunhong Wang , Haifeng Wang

Artificial Intelligence (AI) is one of the major technological advancements of this century, bearing incredible potential for users through AI-powered applications and tools in numerous domains. Being often black-box (i.e., its…

Human-Computer Interaction · Computer Science 2026-03-18 Eleonora Cappuccio , Andrea Esposito , Francesco Greco , Giuseppe Desolda , Rosa Lanzilotti , Salvatore Rinzivillo

Software development of modern, data-driven applications still relies on tools that use interaction paradigms that have remained mostly unchanged for decades. While rich forms of interactions exist as an alternative to textual command…

Human-Computer Interaction · Computer Science 2023-11-10 Thomas Weber , Sven Mayer

An ideal software system in computer graphics should be a combination of innovative ideas, solid software engineering and rapid development. However, in reality these requirements are seldom met simultaneously. In this paper, we present…

Graphics · Computer Science 2018-04-26 Yuanming Hu

As AI-powered code generation tools such as GitHub Copilot become popular, it is crucial to understand software developers' trust in AI tools -- a key factor for tool adoption and responsible usage. However, we know little about how…

Human-Computer Interaction · Computer Science 2024-05-29 Ruotong Wang , Ruijia Cheng , Denae Ford , Thomas Zimmermann