Visual Understanding and Narration: A Deeper Understanding and Explanation of Visual Scenes
Computation and Language
2019-09-25 v2 Computer Vision and Pattern Recognition
Abstract
We describe the task of Visual Understanding and Narration, in which a robot (or agent) generates text for the images that it collects when navigating its environment, by answering open-ended questions, such as 'what happens, or might have happened, here?'
Keywords
Cite
@article{arxiv.1906.00038,
title = {Visual Understanding and Narration: A Deeper Understanding and Explanation of Visual Scenes},
author = {Stephanie M. Lukin and Claire Bonial and Clare R. Voss},
journal= {arXiv preprint arXiv:1906.00038},
year = {2019}
}
Comments
2-page extended abstract, presented at the Workshop on Shortcomings in Vision and Language (SiVL), 2019, at the North American Association for Computational Linguistics (NAACL)