English

Classification Driven Dynamic Image Enhancement

Computer Vision and Pattern Recognition 2018-03-30 v3 Artificial Intelligence

Abstract

Convolutional neural networks rely on image texture and structure to serve as discriminative features to classify the image content. Image enhancement techniques can be used as preprocessing steps to help improve the overall image quality and in turn improve the overall effectiveness of a CNN. Existing image enhancement methods, however, are designed to improve the perceptual quality of an image for a human observer. In this paper, we are interested in learning CNNs that can emulate image enhancement and restoration, but with the overall goal to improve image classification and not necessarily human perception. To this end, we present a unified CNN architecture that uses a range of enhancement filters that can enhance image-specific details via end-to-end dynamic filter learning. We demonstrate the effectiveness of this strategy on four challenging benchmark datasets for fine-grained, object, scene, and texture classification: CUB-200-2011, PASCAL-VOC2007, MIT-Indoor, and DTD. Experiments using our proposed enhancement show promising results on all the datasets. In addition, our approach is capable of improving the performance of all generic CNN architectures.

Keywords

Cite

@article{arxiv.1710.07558,
  title  = {Classification Driven Dynamic Image Enhancement},
  author = {Vivek Sharma and Ali Diba and Davy Neven and Michael S. Brown and Luc Van Gool and Rainer Stiefelhagen},
  journal= {arXiv preprint arXiv:1710.07558},
  year   = {2018}
}