English

IC-EO: Interpretable Code-based assistant for Earth Observation

Computer Vision and Pattern Recognition 2026-02-03 v1 Artificial Intelligence

Abstract

Despite recent advances in computer vision, Earth Observation (EO) analysis remains difficult to perform for the laymen, requiring expert knowledge and technical capabilities. Furthermore, many systems return black-box predictions that are difficult to audit or reproduce. Leveraging recent advances in tool LLMs, this study proposes a conversational, code-generating agent that transforms natural-language queries into executable, auditable Python workflows. The agent operates over a unified easily extendable API for classification, segmentation, detection (oriented bounding boxes), spectral indices, and geospatial operators. With our proposed framework, it is possible to control the results at three levels: (i) tool-level performance on public EO benchmarks; (ii) at the agent-level to understand the capacity to generate valid, hallucination-free code; and (iii) at the task-level on specific use cases. In this work, we select two use-cases of interest: land-composition mapping and post-wildfire damage assessment. The proposed agent outperforms general-purpose LLM/VLM baselines (GPT-4o, LLaVA), achieving 64.2% vs. 51.7% accuracy on land-composition and 50% vs. 0% on post-wildfire analysis, while producing results that are transparent and easy to interpret. By outputting verifiable code, the approach turns EO analysis into a transparent, reproducible process.

Keywords

Cite

@article{arxiv.2602.00117,
  title  = {IC-EO: Interpretable Code-based assistant for Earth Observation},
  author = {Lamia Lahouel and Laurynas Lopata and Simon Gruening and Gabriele Meoni and Gaetan Petit and Sylvain Lobry},
  journal= {arXiv preprint arXiv:2602.00117},
  year   = {2026}
}

Comments

15 pages, 1 figure

R2 v1 2026-07-01T09:28:27.835Z