English

Stochastic Optimization of Plain Convolutional Neural Networks with Simple methods

Computer Vision and Pattern Recognition 2020-01-27 v1 Machine Learning

Abstract

Convolutional neural networks have been achieving the best possible accuracies in many visual pattern classification problems. However, due to the model capacity required to capture such representations, they are often oversensitive to overfitting and therefore require proper regularization to generalize well. In this paper, we present a combination of regularization techniques which work together to get better performance, we built plain CNNs, and then we used data augmentation, dropout and customized early stopping function, we tested and evaluated these techniques by applying models on five famous datasets, MNIST, CIFAR10, CIFAR100, SVHN, STL10, and we achieved three state-of-the-art-of (MNIST, SVHN, STL10) and very high-Accuracy on the other two datasets.

Keywords

Cite

@article{arxiv.2001.08856,
  title  = {Stochastic Optimization of Plain Convolutional Neural Networks with Simple methods},
  author = {Yahia Assiri},
  journal= {arXiv preprint arXiv:2001.08856},
  year   = {2020}
}

Comments

arXiv admin note: substantial text overlap with arXiv:1708.04552 by other authors

R2 v1 2026-06-23T13:19:31.779Z