English

Image-Text Relation Prediction for Multilingual Tweets

Computation and Language 2025-05-09 v1 Artificial Intelligence Computer Vision and Pattern Recognition

Abstract

Various social networks have been allowing media uploads for over a decade now. Still, it has not always been clear what is their relation with the posted text or even if there is any at all. In this work, we explore how multilingual vision-language models tackle the task of image-text relation prediction in different languages, and construct a dedicated balanced benchmark data set from Twitter posts in Latvian along with their manual translations into English. We compare our results to previous work and show that the more recently released vision-language model checkpoints are becoming increasingly capable at this task, but there is still much room for further improvement.

Keywords

Cite

@article{arxiv.2505.05040,
  title  = {Image-Text Relation Prediction for Multilingual Tweets},
  author = {Matīss Rikters and Edison Marrese-Taylor},
  journal= {arXiv preprint arXiv:2505.05040},
  year   = {2025}
}
R2 v1 2026-06-28T23:25:27.810Z