Current state-of-the-art human activity recognition is focused on the classification of temporally trimmed videos in which only one action occurs per frame. We propose a simple, yet effective, method for the temporal detection of activities in temporally untrimmed videos with the help of untrimmed classification. Firstly, our model predicts the top k labels for each untrimmed video by analysing global video-level features. Secondly, frame-level binary classification is combined with dynamic programming to generate the temporally trimmed activity proposals. Finally, each proposal is assigned a label based on the global label, and scored with the score of the temporal activity proposal and the global score. Ultimately, we show that untrimmed video classification models can be used as stepping stone for temporal detection.
@article{arxiv.1607.01979,
title = {Untrimmed Video Classification for Activity Detection: submission to ActivityNet Challenge},
author = {Gurkirt Singh and Fabio Cuzzolin},
journal= {arXiv preprint arXiv:1607.01979},
year = {2016}
}
Comments
3 pages, Presented at ActivityNet Large Scale Activity Recognition Challenge workshop at CVPR 2016, Second position in ActivityNet Detection challenge 2016