English

On the Influence of Explainable AI on Automation Bias

Human-Computer Interaction 2022-04-20 v1 Artificial Intelligence

Abstract

Artificial intelligence (AI) is gaining momentum, and its importance for the future of work in many areas, such as medicine and banking, is continuously rising. However, insights on the effective collaboration of humans and AI are still rare. Typically, AI supports humans in decision-making by addressing human limitations. However, it may also evoke human bias, especially in the form of automation bias as an over-reliance on AI advice. We aim to shed light on the potential to influence automation bias by explainable AI (XAI). In this pre-test, we derive a research model and describe our study design. Subsequentially, we conduct an online experiment with regard to hotel review classifications and discuss first results. We expect our research to contribute to the design and development of safe hybrid intelligence systems.

Keywords

Cite

@article{arxiv.2204.08859,
  title  = {On the Influence of Explainable AI on Automation Bias},
  author = {Max Schemmer and Niklas Kühl and Carina Benz and Gerhard Satzger},
  journal= {arXiv preprint arXiv:2204.08859},
  year   = {2022}
}

Comments

Thirtieth European Conference on Information Systems (ECIS 2022)