We propose a hybrid architecture for systematically computing robust visual explanation(s) encompassing hypothesis formation, belief revision, and default reasoning with video data. The architecture consists of two tightly integrated synergistic components: (1) (functional) answer set programming based abductive reasoning with space-time tracklets as native entities; and (2) a visual processing pipeline for detection based object tracking and motion analysis. We present the formal framework, its general implementation as a (declarative) method in answer set programming, and an example application and evaluation based on two diverse video datasets: the MOTChallenge benchmark developed by the vision community, and a recently developed Movie Dataset.
@article{arxiv.1712.00840,
title = {Visual Explanation by High-Level Abduction: On Answer-Set Programming Driven Reasoning about Moving Objects},
author = {Jakob Suchan and Mehul Bhatt and Przemysław Wałęga and Carl Schultz},
journal= {arXiv preprint arXiv:1712.00840},
year = {2017}
}
Comments
Preprint of final publication published as part of AAAI 2018: J. Suchan., M. Bhatt, Wa{\l}\k{e}ga, P., Schultz, C. (2018). Visual Explanation by High-Level Abduction: On Answer-Set Programming Driven Reasoning about Moving Objects. In AAAI 2018: Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, February 2-7, 2018, New Orleans, USA