This notebook paper presents our system in the ActivityNet Dense Captioning in Video task (task 3). Temporal proposal generation and caption generation are both important to the dense captioning task. Therefore, we propose a proposal ranking model to employ a set of effective feature representations for proposal generation, and ensemble a series of caption models enhanced with context information to generate captions robustly on predicted proposals. Our approach achieves the state-of-the-art performance on the dense video captioning task with 8.529 METEOR score on the challenge testing set.
@article{arxiv.1806.08854,
title = {RUC+CMU: System Report for Dense Captioning Events in Videos},
author = {Shizhe Chen and Yuqing Song and Yida Zhao and Jiarong Qiu and Qin Jin and Alexander Hauptmann},
journal= {arXiv preprint arXiv:1806.08854},
year = {2018}
}
Comments
Winner in ActivityNet 2018 Dense Video Captioning challenge