English

ImageSet2Text: Describing Sets of Images through Text

Computer Vision and Pattern Recognition 2025-11-14 v2

Abstract

In the era of large-scale visual data, understanding collections of images is a challenging yet important task. To this end, we introduce ImageSet2Text, a novel method to automatically generate natural language descriptions of image sets. Based on large language models, visual-question answering chains, an external lexical graph, and CLIP-based verification, ImageSet2Text iteratively extracts key concepts from image subsets and organizes them into a structured concept graph. We conduct extensive experiments evaluating the quality of the generated descriptions in terms of accuracy, completeness, and user satisfaction. We also examine the method's behavior through ablation studies, scalability assessments, and failure analyses. Results demonstrate that ImageSet2Text combines data-driven AI and symbolic representations to reliably summarize large image collections for a wide range of applications.

Keywords

Cite

@article{arxiv.2503.19361,
  title  = {ImageSet2Text: Describing Sets of Images through Text},
  author = {Piera Riccio and Francesco Galati and Kajetan Schweighofer and Noa Garcia and Nuria Oliver},
  journal= {arXiv preprint arXiv:2503.19361},
  year   = {2025}
}