Testing Framework for Black-box AI Models
Machine Learning
2021-02-12 v1 Artificial Intelligence
Abstract
With widespread adoption of AI models for important decision making, ensuring reliability of such models remains an important challenge. In this paper, we present an end-to-end generic framework for testing AI Models which performs automated test generation for different modalities such as text, tabular, and time-series data and across various properties such as accuracy, fairness, and robustness. Our tool has been used for testing industrial AI models and was very effective to uncover issues present in those models. Demo video link: https://youtu.be/984UCU17YZI
Cite
@article{arxiv.2102.06166,
title = {Testing Framework for Black-box AI Models},
author = {Aniya Aggarwal and Samiulla Shaikh and Sandeep Hans and Swastik Haldar and Rema Ananthanarayanan and Diptikalyan Saha},
journal= {arXiv preprint arXiv:2102.06166},
year = {2021}
}
Comments
4 pages Demonstrations track paper accepted at ICSE 2021