English
Related papers

Related papers: Towards Effective Human-AI Collaboration in GUI-Ba…

200 papers

This paper describes a new research paradigm for studying human-AI collaboration, named "human-AI mutual learning", defined as the process where humans and AI agents preserve, exchange, and improve knowledge during human-AI collaboration.…

Human-Computer Interaction · Computer Science 2024-05-09 Xiaomei Wang , Xiaoyu Chen

Among the many anticipated roles for robots in the future is that of being a human teammate. Aside from all the technological hurdles that have to be overcome with respect to hardware and control to make robots fit to work with humans, the…

Artificial Intelligence · Computer Science 2017-08-15 Tathagata Chakraborti , Subbarao Kambhampati , Matthias Scheutz , Yu Zhang

This action research study focuses on the integration of "AI assistants" in two Agile software development meetings: the Daily Scrum and a feature refinement, a planning meeting that is part of an in-house Scaled Agile framework. We discuss…

Software Engineering · Computer Science 2024-04-24 Beatriz Cabrero-Daniel , Tomas Herda , Victoria Pichler , Martin Eder

A longstanding goal of artificial intelligence is to create artificial agents capable of learning to perform tasks that require sequential decision making. Importantly, while it is the artificial agent that learns and acts, it is still up…

Artificial Intelligence · Computer Science 2021-07-14 Ruohan Zhang , Faraz Torabi , Garrett Warnell , Peter Stone

Technological progress has persistently shaped the dynamics of human-machine interactions in task execution. In response to the advancements in Generative AI, this paper outlines a detailed study plan that investigates various human-AI…

Human-Computer Interaction · Computer Science 2024-02-13 Zijian Ding

We study the problem of designing AI agents that can robustly cooperate with people in human-machine partnerships. Our work is inspired by real-life scenarios in which an AI agent, e.g., a virtual assistant, has to cooperate with new users…

Machine Learning · Computer Science 2020-06-17 Ahana Ghosh , Sebastian Tschiatschek , Hamed Mahdavi , Adish Singla

Recent work has explored how complementary strengths of humans and artificial intelligence (AI) systems might be productively combined. However, successful forms of human-AI partnership have rarely been demonstrated in real-world settings.…

Human-Computer Interaction · Computer Science 2021-07-13 Kenneth Holstein , Vincent Aleven

Goal-directed interactive agents, which autonomously complete tasks through interactions with their environment, can assist humans in various domains of their daily lives. Recent advances in large language models (LLMs) led to a surge of…

Computation and Language · Computer Science 2024-09-30 Mareike Hartmann , Alexander Koller

Most AI systems today are designed to manage tasks and execute predefined steps. This makes them effective for process coordination but limited in their ability to engage in joint problem-solving with humans or contribute new ideas. We…

Human-Computer Interaction · Computer Science 2026-02-03 Kexin Quan , Dina Albassam , Mengke Wu , Zijian Ding , Jessie Chin

Conversational human-AI interaction (CHAI) have recently driven mainstream adoption of AI. However, CHAI poses two key challenges for designers and researchers: users frequently have ambiguous goals and an incomplete understanding of AI…

Human-Computer Interaction · Computer Science 2025-01-31 Arthur Caetano , Kavya Verma , Atieh Taheri , Radha Kumaran , Zichen Chen , Jiaao Chen , Tobias Höllerer , Misha Sra

With recent advancements in multi-agent generative AI (Gen AI), technology organizations like Microsoft are adopting these complex tools, redefining AI agents as active collaborators in complex workflows rather than as passive tools. In…

Human-Computer Interaction · Computer Science 2025-10-09 Suchismita Naik , Austin L. Toombs , Amanda Snellinger , Scott Saponas , Amanda K. Hall

With recent advancements in AI and computation tools, intelligent paradigms emerged to empower different fields such as healthcare robots with new capabilities. Advanced AI robotic algorithms (e.g., reinforcement learning) can be trained…

Robotics · Computer Science 2024-07-25 Reza Abiri , Ali Rabiee , Sima Ghafoori , Anna Cetera

This article discusses some trends and concepts in developing new generation of future Artificial General Intelligence (AGI) systems which relate to complex facets and different types of human intelligence, especially social, emotional,…

Artificial Intelligence · Computer Science 2020-12-14 Andrzej Cichocki , Alexander P. Kuleshov

Recent improvements in large language models (LLMs) have led many researchers to focus on building fully autonomous AI agents. This position paper questions whether this approach is the right path forward, as these autonomous systems still…

Human and AI are increasingly interacting and collaborating to accomplish various complex tasks in the context of diverse application domains (e.g., healthcare, transportation, and creative design). Two dynamic, learning entities (AI and…

Human-Computer Interaction · Computer Science 2019-10-29 Yi-Ching Huang , Yu-Ting Cheng , Lin-Lin Chen , Jane Yung-jen Hsu

Human intelligence has the remarkable ability to quickly adapt to new tasks and environments. Starting from a very young age, humans acquire new skills and learn how to solve new tasks either by imitating the behavior of others or by…

Graphical User Interface (GUI) agents, powered by Large Foundation Models, have emerged as a transformative approach to automating human-computer interaction. These agents autonomously interact with digital systems or software applications…

Humans make decisions and act alongside other humans to pursue both short-term and long-term goals. As a result of ongoing progress in areas such as computing science and automation, humans now also interact with non-human agents of varying…

Artificial Intelligence · Computer Science 2019-05-08 Patrick M. Pilarski , Andrew Butcher , Michael Johanson , Matthew M. Botvinick , Andrew Bolt , Adam S. R. Parker

While human-AI collaboration systems have increasingly been built to increase efficiency or support creativity, little work has examined how the design of interactions shapes the social connection between human and artificial agent. We…

Human-Computer Interaction · Computer Science 2026-05-26 Michael Yin , Angela Chiang , Samuel Rhys Cox , Robert Xiao

Integration of artificial intelligent (AI) agents in higher education is transforming teaching, learning and administrative processes. Although existing AI agents effectively support individual tasks, their implementation remains fragmented…

Artificial Intelligence · Computer Science 2026-05-15 Vidya K Sudarshan , Anushka Sisodia , Reshma A Ramachandra , Sia Batra , Josephine Chong Leng Leng