English

Do We Need Large VLMs for Spotting Soccer Actions?

Computer Vision and Pattern Recognition 2025-09-30 v2 Artificial Intelligence Machine Learning

Abstract

Traditional video-based tasks like soccer action spotting rely heavily on visual inputs, often requiring complex and computationally expensive models to process dense video data. We propose a shift from this video-centric approach to a text-based task, making it lightweight and scalable by utilizing Large Language Models (LLMs) instead of Vision-Language Models (VLMs). We posit that expert commentary, which provides rich descriptions and contextual cues contains sufficient information to reliably spot key actions in a match. To demonstrate this, we employ a system of three LLMs acting as judges specializing in outcome, excitement, and tactics for spotting actions in soccer matches. Our experiments show that this language-centric approach performs effectively in detecting critical match events coming close to state-of-the-art video-based spotters while using zero video processing compute and similar amount of time to process the entire match.

Keywords

Cite

@article{arxiv.2506.17144,
  title  = {Do We Need Large VLMs for Spotting Soccer Actions?},
  author = {Ritabrata Chakraborty and Rajatsubhra Chakraborty and Avijit Dasgupta and Sandeep Chaurasia},
  journal= {arXiv preprint arXiv:2506.17144},
  year   = {2025}
}

Comments

6 pages, 2 tables