English

Recognizing Activities of Daily Living from Egocentric Images

Computer Vision and Pattern Recognition 2017-04-14 v1

Abstract

Recognizing Activities of Daily Living (ADLs) has a large number of health applications, such as characterize lifestyle for habit improvement, nursing and rehabilitation services. Wearable cameras can daily gather large amounts of image data that provide rich visual information about ADLs than using other wearable sensors. In this paper, we explore the classification of ADLs from images captured by low temporal resolution wearable camera (2fpm) by using a Convolutional Neural Networks (CNN) approach. We show that the classification accuracy of a CNN largely improves when its output is combined, through a random decision forest, with contextual information from a fully connected layer. The proposed method was tested on a subset of the NTCIR-12 egocentric dataset, consisting of 18,674 images and achieved an overall accuracy of 86% activity recognition on 21 classes.

Keywords

Cite

@article{arxiv.1704.04097,
  title  = {Recognizing Activities of Daily Living from Egocentric Images},
  author = {Alejandro Cartas and Juan Marín and Petia Radeva and Mariella Dimiccoli},
  journal= {arXiv preprint arXiv:1704.04097},
  year   = {2017}
}

Comments

To appear in the Proceedings of IbPRIA 2017