Shallow and Deep Convolutional Networks for Saliency Prediction
Abstract
The prediction of salient areas in images has been traditionally addressed with hand-crafted features based on neuroscience principles. This paper, however, addresses the problem with a completely data-driven approach by training a convolutional neural network (convnet). The learning process is formulated as a minimization of a loss function that measures the Euclidean distance of the predicted saliency map with the provided ground truth. The recent publication of large datasets of saliency prediction has provided enough data to train end-to-end architectures that are both fast and accurate. Two designs are proposed: a shallow convnet trained from scratch, and a another deeper solution whose first three layers are adapted from another network trained for classification. To the authors knowledge, these are the first end-to-end CNNs trained and tested for the purpose of saliency prediction.
Cite
@article{arxiv.1603.00845,
title = {Shallow and Deep Convolutional Networks for Saliency Prediction},
author = {Junting Pan and Kevin McGuinness and Elisa Sayrol and Noel O'Connor and Xavier Giro-i-Nieto},
journal= {arXiv preprint arXiv:1603.00845},
year = {2016}
}
Comments
Preprint of the paper accepted at 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Source code and models available at https://github.com/imatge-upc/saliency-2016-cvpr. Junting Pan and Kevin McGuinness contributed equally to this work