Dice in the Black Box: User Experiences with an Inscrutable Algorithm
Human-Computer Interaction
2018-12-11 v1
Abstract
We demonstrate that users may be prone to place an inordinate amount of trust in black box algorithms that are framed as intelligent. We deploy an algorithm that purportedly assesses the positivity and negativity of a users' writing emotional writing. In actuality, the algorithm responds in a random fashion. We qualitatively examine the paths to trust that users followed while testing the system. In light of the ease with which users may trust systems exhibiting "intelligent behavior" we recommend corrective approaches.
Cite
@article{arxiv.1812.03219,
title = {Dice in the Black Box: User Experiences with an Inscrutable Algorithm},
author = {Aaron Springer and Victoria Hollis and Steve Whittaker},
journal= {arXiv preprint arXiv:1812.03219},
year = {2018}
}