English
Related papers

Related papers: Towards Effective Human-AI Collaboration in GUI-Ba…

200 papers

As AI is increasingly being adopted into application solutions, the challenge of supporting interaction with humans is becoming more apparent. Partly this is to support integrated working styles, in which humans and intelligent systems…

Artificial Intelligence · Computer Science 2017-10-02 Maria Fox , Derek Long , Daniele Magazzeni

This paper offers a concise, 60-year synthesis of human-AI collaboration, from Licklider's ``man-computer symbiosis" (AI as colleague) and Engelbart's ``augmenting human intellect" (AI as tool) to contemporary poles: Human-Centered AI's…

Human-Computer Interaction · Computer Science 2026-01-13 Richard Jiarui Tong

In healthcare, AI techniques are widely used for tasks like risk assessment and anomaly detection. Despite AI's potential as a valuable assistant, its role in complex medical data analysis often oversimplifies human-AI collaboration…

Human-Computer Interaction · Computer Science 2024-07-23 Yang Ouyang , Chenyang Zhang , He Wang , Tianle Ma , Chang Jiang , Yuheng Yan , Zuoqin Yan , Xiaojuan Ma , Chuhan Shi , Quan Li

This paper tackles the critical challenge of human-AI complementarity in decision-making. Departing from the traditional focus on algorithmic performance in favor of performance of the human-AI team, and moving past the framing of…

Artificial Intelligence · Computer Science 2025-11-04 Ruijiang Gao , Maytal Saar-Tsechansky , Maria De-Arteaga

AI approaches are progressing besting humans at game-related tasks (e.g. chess). The next stage is expected to be Human-AI collaboration; however, the research on this subject has been mixed and is in need of additional data points. We add…

Human-Computer Interaction · Computer Science 2024-03-05 Cheng Ren , Zachary Pardos , Zhi Li

Human-centered AI considers human experiences with AI performance. While abundant research has been helping AI achieve superhuman performance either by fully automatic or weak supervision learning, fewer endeavors are experimenting with how…

Artificial Intelligence · Computer Science 2022-08-08 Yilei Zeng , Jiali Duan , Yang Li , Emilio Ferrara , Lerrel Pinto , C. -C. Jay Kuo , Stefanos Nikolaidis

Graphical User Interface (GUI) Agents have emerged as a transformative paradigm in human-computer interaction, evolving from rule-based automation scripts to sophisticated AI-driven systems capable of understanding and executing complex…

Human-Computer Interaction · Computer Science 2025-06-05 Fei Tang , Haolei Xu , Hang Zhang , Siqi Chen , Xingyu Wu , Yongliang Shen , Wenqi Zhang , Guiyang Hou , Zeqi Tan , Yuchen Yan , Kaitao Song , Jian Shao , Weiming Lu , Jun Xiao , Yueting Zhuang

Starting from the design philosophy of "user-centered design", this paper analyzes the human factors characteristics of intelligent human-computer interaction (iHCI) and proposes a concept of "user-oriented iHCI". The paper further proposes…

Human-Computer Interaction · Computer Science 2022-10-10 Wei Xu

The Agents, Interaction and Complexity research group at the University of Southampton has a long track record of research in multiagent systems (MAS). We have made substantial scientific contributions across learning in MAS, game-theoretic…

The rapid advancement of chat-based language models has led to remarkable progress in complex task-solving. However, their success heavily relies on human input to guide the conversation, which can be challenging and time-consuming. This…

Artificial Intelligence · Computer Science 2023-11-03 Guohao Li , Hasan Abed Al Kader Hammoud , Hani Itani , Dmitrii Khizbullin , Bernard Ghanem

Multi-agent reinforcement learning has shown promise on a variety of cooperative tasks as a consequence of recent developments in differentiable inter-agent communication. However, most architectures are limited to pools of homogeneous…

Multiagent Systems · Computer Science 2019-09-13 Bowen Jing , William Yin

AI-based Intelligent Tutoring Systems (ITS) have significant potential to transform teaching and learning. As efforts continue to design, develop, and integrate ITS into educational contexts, mixed results about their effectiveness have…

Information Retrieval · Computer Science 2025-07-28 Meriem Zerkouk , Miloud Mihoubi , Belkacem Chikhaoui

The deployment of capable AI agents raises fresh questions about safety, human-machine relationships and social coordination. We argue for greater engagement by scientists, scholars, engineers and policymakers with the implications of a…

Computers and Society · Computer Science 2025-09-15 Iason Gabriel , Geoff Keeling , Arianna Manzini , James Evans

Reinforcement Learning AI commonly uses reward/penalty signals that are objective and explicit in an environment -- e.g. game score, completion time, etc. -- in order to learn the optimal strategy for task performance. However, Human-AI…

Human-Computer Interaction · Computer Science 2017-09-15 Victor Shih , David C Jangraw , Paul Sajda , Sameer Saproo

In recent years, peer learning has gained attention as a method that promotes spontaneous thinking among learners, and its effectiveness has been confirmed by numerous studies. This study aims to develop an AI Agent as a learning companion…

Artificial Intelligence · Computer Science 2025-07-18 Sosui Moribe , Taketoshi Ushiama

We introduce Interactionalism as a new set of guiding principles and heuristics for the design and architecture of learning now available due to Generative AI (GenAI) platforms. Specifically, we articulate interactional intelligence as a…

Human-Computer Interaction · Computer Science 2025-01-03 Mihnea C. Moldoveanu , George Siemens

We anticipate increased instances of humans and AI systems working together in what we refer to as a hybrid team. The increase in collaboration is expected as AI systems gain proficiency and their adoption becomes more widespread. However,…

Artificial Intelligence · Computer Science 2024-08-06 Andrew Fuchs , Andrea Passarella , Marco Conti

Generative artificial intelligence (GenAI) is increasingly used in education, posing significant challenges for teachers adapting to these changes. GenAI offers unprecedented opportunities for accessibility, scalability and productivity in…

Computers and Society · Computer Science 2025-11-26 Mutlu Cukurova , Wannapon Suraworachet , Qi Zhou , Sahan Bulathwela

Effective human-human and human-autonomy teamwork is critical but often challenging to perfect. The challenge is particularly relevant in time-critical domains, such as healthcare and disaster response, where the time pressures can make…

Artificial Intelligence · Computer Science 2023-03-06 Sangwon Seo , Bing Han , Vaibhav Unhelkar

Graphical user interface (GUI) agents have advanced rapidly but still struggle with complex tasks involving novel UI elements, long-horizon actions, and personalized trajectories. In this work, we introduce Instruction Agent, a GUI agent…

Artificial Intelligence · Computer Science 2025-09-10 Yinheng Li , Hailey Hultquist , Justin Wagle , Kazuhito Koishida