English

Movie Box Office Prediction With Self-Supervised and Visually Grounded Pretraining

Multimedia 2023-04-21 v1 Machine Learning

Abstract

Investments in movie production are associated with a high level of risk as movie revenues have long-tailed and bimodal distributions. Accurate prediction of box-office revenue may mitigate the uncertainty and encourage investment. However, learning effective representations for actors, directors, and user-generated content-related keywords remains a challenging open problem. In this work, we investigate the effects of self-supervised pretraining and propose visual grounding of content keywords in objects from movie posters as a pertaining objective. Experiments on a large dataset of 35,794 movies demonstrate significant benefits of self-supervised training and visual grounding. In particular, visual grounding pretraining substantially improves learning on movies with content keywords and achieves 14.5% relative performance gains compared to a finetuned BERT model with identical architecture.

Keywords

Cite

@article{arxiv.2304.10311,
  title  = {Movie Box Office Prediction With Self-Supervised and Visually Grounded Pretraining},
  author = {Qin Chao and Eunsoo Kim and Boyang Li},
  journal= {arXiv preprint arXiv:2304.10311},
  year   = {2023}
}

Comments

accepted by IEEE International Conference on Multimedia and Expo (2023)