English

Image Classification by Reinforcement Learning with Two-State Q-Learning

Computer Vision and Pattern Recognition 2020-11-03 v3 Machine Learning Image and Video Processing

Abstract

In this paper, a simple and efficient Hybrid Classifier is presented which is based on deep learning and reinforcement learning. Here, Q-Learning has been used with two states and 'two or three' actions. Other techniques found in the literature use feature map extracted from Convolutional Neural Networks and use these in the Q-states along with past history. This leads to technical difficulties in these approaches because the number of states is high due to large dimensions of the feature map. Because the proposed technique uses only two Q-states it is straightforward and consequently has much lesser number of optimization parameters, and thus also has a simple reward function. Also, the proposed technique uses novel actions for processing images as compared to other techniques found in literature. The performance of the proposed technique is compared with other recent algorithms like ResNet50, InceptionV3, etc. on popular databases including ImageNet, Cats and Dogs Dataset, and Caltech-101 Dataset. The proposed approach outperforms others techniques on all the datasets used.

Keywords

Cite

@article{arxiv.2007.01298,
  title  = {Image Classification by Reinforcement Learning with Two-State Q-Learning},
  author = {Abdul Mueed Hafiz},
  journal= {arXiv preprint arXiv:2007.01298},
  year   = {2020}
}

Comments

HICO-2021 Camera Ready Paper

R2 v1 2026-06-23T16:48:38.713Z