Overfitting In Contrastive Learning?
Machine Learning
2024-08-23 v2
Abstract
Overfitting describes a machine learning phenomenon where the model fits too closely to the training data, resulting in poor generalization. While this occurrence is thoroughly documented for many forms of supervised learning, it is not well examined in the context of unsupervised learning. In this work we examine the nature of overfitting in unsupervised contrastive learning. We show that overfitting can indeed occur and the mechanism behind overfitting.
Cite
@article{arxiv.2407.15863,
title = {Overfitting In Contrastive Learning?},
author = {Zachary Rabin and Jim Davis and Benjamin Lewis and Matthew Scherreik},
journal= {arXiv preprint arXiv:2407.15863},
year = {2024}
}