English

On the Effect of Information Asymmetry in Human-AI Teams

Human-Computer Interaction 2022-05-04 v1 Artificial Intelligence

Abstract

Over the last years, the rising capabilities of artificial intelligence (AI) have improved human decision-making in many application areas. Teaming between AI and humans may even lead to complementary team performance (CTP), i.e., a level of performance beyond the ones that can be reached by AI or humans individually. Many researchers have proposed using explainable AI (XAI) to enable humans to rely on AI advice appropriately and thereby reach CTP. However, CTP is rarely demonstrated in previous work as often the focus is on the design of explainability, while a fundamental prerequisite -- the presence of complementarity potential between humans and AI -- is often neglected. Therefore, we focus on the existence of this potential for effective human-AI decision-making. Specifically, we identify information asymmetry as an essential source of complementarity potential, as in many real-world situations, humans have access to different contextual information. By conducting an online experiment, we demonstrate that humans can use such contextual information to adjust the AI's decision, finally resulting in CTP.

Keywords

Cite

@article{arxiv.2205.01467,
  title  = {On the Effect of Information Asymmetry in Human-AI Teams},
  author = {Patrick Hemmer and Max Schemmer and Niklas Kühl and Michael Vössing and Gerhard Satzger},
  journal= {arXiv preprint arXiv:2205.01467},
  year   = {2022}
}

Comments

CHI Conference on Human Factors in Computing Systems (CHI '22), Workshop on Human-Centered Explainable AI (HCXAI)