English

Exploration of VLMs for Driver Monitoring Systems Applications

Computer Vision and Pattern Recognition 2025-03-18 v1 Machine Learning

Abstract

In recent years, we have witnessed significant progress in emerging deep learning models, particularly Large Language Models (LLMs) and Vision-Language Models (VLMs). These models have demonstrated promising results, indicating a new era of Artificial Intelligence (AI) that surpasses previous methodologies. Their extensive knowledge and zero-shot capabilities suggest a paradigm shift in developing deep learning solutions, moving from data capturing and algorithm training to just writing appropriate prompts. While the application of these technologies has been explored across various industries, including automotive, there is a notable gap in the scientific literature regarding their use in Driver Monitoring Systems (DMS). This paper presents our initial approach to implementing VLMs in this domain, utilising the Driver Monitoring Dataset to evaluate their performance and discussing their advantages and challenges when implemented in real-world scenarios.

Keywords

Cite

@article{arxiv.2503.12281,
  title  = {Exploration of VLMs for Driver Monitoring Systems Applications},
  author = {Paola Natalia Cañas and Marcos Nieto and Oihana Otaegui and Igor Rodríguez},
  journal= {arXiv preprint arXiv:2503.12281},
  year   = {2025}
}

Comments

Accepted in 16th ITS European Congress, Seville, Spain, 19-21 May 2025