English

Archaeological Sites Detection with a Human-AI Collaboration Workflow

Computer Vision and Pattern Recognition 2023-02-13 v1 Machine Learning

Abstract

This paper illustrates the results obtained by using pre-trained semantic segmentation deep learning models for the detection of archaeological sites within the Mesopotamian floodplains environment. The models were fine-tuned using openly available satellite imagery and vector shapes coming from a large corpus of annotations (i.e., surveyed sites). A randomized test showed that the best model reaches a detection accuracy in the neighborhood of 80%. Integrating domain expertise was crucial to define how to build the dataset and how to evaluate the predictions, since defining if a proposed mask counts as a prediction is very subjective. Furthermore, even an inaccurate prediction can be useful when put into context and interpreted by a trained archaeologist. Coming from these considerations we close the paper with a vision for a Human-AI collaboration workflow. Starting with an annotated dataset that is refined by the human expert we obtain a model whose predictions can either be combined to create a heatmap, to be overlaid on satellite and/or aerial imagery, or alternatively can be vectorized to make further analysis in a GIS software easier and automatic. In turn, the archaeologists can analyze the predictions, organize their onsite surveys, and refine the dataset with new, corrected, annotation

Keywords

Cite

@article{arxiv.2302.05286,
  title  = {Archaeological Sites Detection with a Human-AI Collaboration Workflow},
  author = {Luca Casini and Valentina Orrù and Andrea Montanucci and Nicolò Marchetti and Marco Roccetti},
  journal= {arXiv preprint arXiv:2302.05286},
  year   = {2023}
}

Comments

15 pages, 5 figures, 2 tables

R2 v1 2026-06-28T08:37:06.610Z