Generalization Bounds for Deep Transfer Learning Using Majority Predictor Accuracy
Machine Learning
2022-09-14 v1 Artificial Intelligence
Abstract
We analyze new generalization bounds for deep learning models trained by transfer learning from a source to a target task. Our bounds utilize a quantity called the majority predictor accuracy, which can be computed efficiently from data. We show that our theory is useful in practice since it implies that the majority predictor accuracy can be used as a transferability measure, a fact that is also validated by our experiments.
Cite
@article{arxiv.2209.05709,
title = {Generalization Bounds for Deep Transfer Learning Using Majority Predictor Accuracy},
author = {Cuong N. Nguyen and Lam Si Tung Ho and Vu Dinh and Tal Hassner and Cuong V. Nguyen},
journal= {arXiv preprint arXiv:2209.05709},
year = {2022}
}
Comments
5 pages, Paper published at the International Symposium on Information Theory and Its Applications (ISITA 2022)