Sharkzor: Interactive Deep Learning for Image Triage, Sort and Summary
Abstract
Sharkzor is a web application for machine-learning assisted image sort and summary. Deep learning algorithms are leveraged to infer, augment, and automate the user's mental model. Initially, images uploaded by the user are spread out on a canvas. The user then interacts with the images to impute their mental model into the application's algorithmic underpinnings. Methods of interaction within Sharkzor's user interface and user experience support three primary user tasks; triage, organize and automate. The user triages the large pile of overlapping images by moving images of interest into proximity. The user then organizes said images into meaningful groups. After interacting with the images and groups, deep learning helps to automate the user's interactions. The loop of interaction, automation, and response by the user allows the system to quickly make sense of large amounts of data.
Cite
@article{arxiv.1802.05316,
title = {Sharkzor: Interactive Deep Learning for Image Triage, Sort and Summary},
author = {Meg Pirrung and Nathan Hilliard and Artëm Yankov and Nancy O'Brien and Paul Weidert and Courtney D Corley and Nathan O Hodas},
journal= {arXiv preprint arXiv:1802.05316},
year = {2018}
}
Comments
ICML 2017 human-in-the-loop workshop