Auto-encoders are often used as building blocks of deep network classifier to learn feature extractors, but task-irrelevant information in the input data may lead to bad extractors and result in poor generalization performance of the network. In this paper,via dropping the task-irrelevant input variables the performance of auto-encoders can be obviously improved .Specifically, an importance-based variable selection method is proposed to aim at finding the task-irrelevant input variables and dropping them.It firstly estimates importance of each variable,and then drops the variables with importance value lower than a threshold. In order to obtain better performance, the method can be employed for each layer of stacked auto-encoders. Experimental results show that when combined with our method the stacked denoising auto-encoders achieves significantly improved performance on three challenging datasets.
@article{arxiv.1605.09458,
title = {Training Auto-encoders Effectively via Eliminating Task-irrelevant Input Variables},
author = {Hui Shen and Dehua Li and Hong Wu and Zhaoxiang Zang},
journal= {arXiv preprint arXiv:1605.09458},
year = {2016}
}