English

Automated Tennis Player and Ball Tracking with Court Keypoints Detection (Hawk Eye System)

Computer Vision and Pattern Recognition 2025-11-07 v1 Artificial Intelligence

Abstract

This study presents a complete pipeline for automated tennis match analysis. Our framework integrates multiple deep learning models to detect and track players and the tennis ball in real time, while also identifying court keypoints for spatial reference. Using YOLOv8 for player detection, a custom-trained YOLOv5 model for ball tracking, and a ResNet50-based architecture for court keypoint detection, our system provides detailed analytics including player movement patterns, ball speed, shot accuracy, and player reaction times. The experimental results demonstrate robust performance in varying court conditions and match scenarios. The model outputs an annotated video along with detailed performance metrics, enabling coaches, broadcasters, and players to gain actionable insights into the dynamics of the game.

Keywords

Cite

@article{arxiv.2511.04126,
  title  = {Automated Tennis Player and Ball Tracking with Court Keypoints Detection (Hawk Eye System)},
  author = {Venkata Manikanta Desu and Syed Fawaz Ali},
  journal= {arXiv preprint arXiv:2511.04126},
  year   = {2025}
}

Comments

14 pages, 11 figures, planning to submit for a coneference