Machine learning models often make predictions that bias against certain subgroups of input data. When undetected, machine learning biases can constitute significant financial and ethical implications. Semi-automated tools that involve humans in the loop could facilitate bias detection. Yet, little is known about the considerations involved in their design. In this paper, we report on an interview study with 11 machine learning practitioners for investigating the needs surrounding semi-automated bias detection tools. Based on the findings, we highlight four considerations in designing to guide system designers who aim to create future tools for bias detection.
@article{arxiv.2003.07680,
title = {Designing Tools for Semi-Automated Detection of Machine Learning Biases: An Interview Study},
author = {Po-Ming Law and Sana Malik and Fan Du and Moumita Sinha},
journal= {arXiv preprint arXiv:2003.07680},
year = {2020}
}
Comments
Proceedings of the CHI 2020 Workshop on Detection and Design for Cognitive Biases in People and Computing Systems