English
Related papers

Related papers: Enabling Rapid Shared Human-AI Mental Model Alignm…

200 papers

The Human-Autonomy Teaming paradigm (HAT) has recently emerged to model and design hybrid teams, where a human operator must cooperate with an artificial agent, able to independently evolve in dynamic and uncertain situations. An important…

Human-Computer Interaction · Computer Science 2023-01-18 Philippe Rauffet

As Augmented Reality (AR) and Artificial Intelligence (AI) continue to converge, new opportunities emerge for AI agents to actively support human collaboration in immersive environments. While prior research has primarily focused on dyadic…

Human-Computer Interaction · Computer Science 2025-03-14 Mariana Fernandez-Espinosa , Diego Gomez-Zara

Large Language Models (LLMs) have the capacity of performing complex scheduling in a multi-agent system and can coordinate these agents into completing sophisticated tasks that require extensive collaboration. However, despite the…

Artificial Intelligence · Computer Science 2023-09-20 Ran Gong , Qiuyuan Huang , Xiaojian Ma , Hoi Vo , Zane Durante , Yusuke Noda , Zilong Zheng , Song-Chun Zhu , Demetri Terzopoulos , Li Fei-Fei , Jianfeng Gao

Developing interactive agents that can understand language, perceive their surroundings, and act within the physical world is a long-standing goal of AI research. The Minecraft Collaborative Building Task (MCBT) (Narayan-Chen, Jayannavar,…

The Animal-AI Environment is a unique game-based research platform designed to facilitate collaboration between the artificial intelligence and comparative cognition research communities. In this paper, we present the latest version of the…

Metcalfe et al (1) argue that the greatest potential for human-AI partnerships lies in their application to highly complex problem spaces. Herein, we discuss three different forms of hybrid team intelligence and posit that across all three…

Human-Computer Interaction · Computer Science 2025-03-03 Kaleb Mcdowell , Nick Waytowich , Javier Garcia , Stephen Gordon , Bryce Bartlett , Jeremy Gaston

Minecraft's complexity and diversity as an open world make it a perfect environment to test if agents can learn, adapt, and tackle a variety of unscripted tasks. However, the development and validation of novel agents in this setting…

Artificial Intelligence · Computer Science 2025-05-30 Shaofei Cai , Zhancun Mu , Kaichen He , Bowei Zhang , Xinyue Zheng , Anji Liu , Yitao Liang

Advances in deep generative modeling have made it increasingly plausible to train human-level embodied agents. Yet progress has been limited by the absence of large-scale, real-time, multi-modal, and socially interactive datasets that…

Machine Learning · Computer Science 2026-02-19 Yingchen He , Christian D. Weilbach , Martyna E. Wojciechowska , Yuxuan Zhang , Frank Wood

We study the problem of designing AI agents that can robustly cooperate with people in human-machine partnerships. Our work is inspired by real-life scenarios in which an AI agent, e.g., a virtual assistant, has to cooperate with new users…

Machine Learning · Computer Science 2020-06-17 Ahana Ghosh , Sebastian Tschiatschek , Hamed Mahdavi , Adish Singla

Artificial intelligence has become integral to organizational decision-making and while research has explored many facets of this human-AI collaboration, the focus has mainly been on designing the AI agent(s) and the way the collaboration…

Human-Computer Interaction · Computer Science 2025-10-10 Joshua Holstein , Gerhard Satzger

In cooperative training, humans within a team coordinate on complex tasks, building mental models of their teammates and learning to adapt to teammates' actions in real-time. To reduce the often prohibitive scheduling constraints associated…

Existing game AI research mainly focuses on enhancing agents' abilities to win games, but this does not inherently make humans have a better experience when collaborating with these agents. For example, agents may dominate the collaboration…

Human-Computer Interaction · Computer Science 2024-01-31 Yiming Gao , Feiyu Liu , Liang Wang , Zhenjie Lian , Dehua Zheng , Weixuan Wang , Wenjin Yang , Siqin Li , Xianliang Wang , Wenhui Chen , Jing Dai , Qiang Fu , Wei Yang , Lanxiao Huang , Wei Liu

Our aim is to build autonomous agents that can solve tasks in environments like Minecraft. To do so, we used an imitation learning-based approach. We formulate our control problem as a search problem over a dataset of experts'…

Machine Learning · Computer Science 2023-04-18 Federico Malato , Florian Leopold , Amogh Raut , Ville Hautamäki , Andrew Melnik

The use of generative AI in video game development is on the rise, and as the conversational and other capabilities of large language models continue to improve, we expect LLM-driven non-player characters (NPCs) to become widely deployed.…

Computation and Language · Computer Science 2024-07-08 Sudha Rao , Weijia Xu , Michael Xu , Jorge Leandro , Ken Lobb , Gabriel DesGarennes , Chris Brockett , Bill Dolan

As artificial intelligence research advances, the platforms used to evaluate AI agents need to adapt and grow to continue to challenge them. We present the Polycraft World AI Lab (PAL), a task simulator with an API based on the Minecraft…

As modern video games become increasingly complex, traditional manual testing methods are proving costly and inefficient, limiting the ability to ensure high-quality game experiences. While advancements in Artificial Intelligence (AI) offer…

Human-Computer Interaction · Computer Science 2026-04-07 Boran Zhang , Muhan Xu , Zhijun Pan

Improving our understanding of how humans perceive AI teammates is an important foundation for our general understanding of human-AI teams. Extending relevant work from cognitive science, we propose a framework based on item response theory…

Machine Learning · Computer Science 2023-05-17 Markelle Kelly , Aakriti Kumar , Padhraic Smyth , Mark Steyvers

In a search and rescue scenario, rescuers may have different knowledge of the environment and strategies for exploration. Understanding what is inside a rescuer's mind will enable an observer agent to proactively assist them with critical…

Machine Learning · Computer Science 2020-11-23 Vidhi Jain , Rohit Jena , Huao Li , Tejus Gupta , Dana Hughes , Michael Lewis , Katia Sycara

Recent developments in Artificial Intelligence (AI) and Machine Learning (ML) are creating new opportunities for Human-Autonomy Teaming (HAT) in tasks, missions, and continuous coordinated activities. A major challenge is enabling humans to…

Human-Computer Interaction · Computer Science 2025-04-07 Abdul Mannan Mohammed , Azhar Ali Mohammad , Jason A. Ortiz , Carsten Neumann , Grace Bochenek , Dirk Reiners , Carolina Cruz-Neira

Team-based collaboration is a cornerstone of modern creative work. Recent advances in generative AI open possibilities for humans to collaborate with multiple AI agents in distinct roles to address complex creative workflows. Yet, how to…

Human-Computer Interaction · Computer Science 2026-01-21 Hyunseung Lim , Dasom Choi , Sooyohn Nam , Bogoan Kim , Hwajung Hong