English

ASPIRO: Any-shot Structured Parsing-error-Induced ReprOmpting for Consistent Data-to-Text Generation

Computation and Language 2023-10-30 v1 Artificial Intelligence Machine Learning

Abstract

We present ASPIRO, an approach for structured data verbalisation into short template sentences in zero to few-shot settings. Unlike previous methods, our approach prompts large language models (LLMs) to directly produce entity-agnostic templates, rather than relying on LLMs to faithfully copy the given example entities, or validating/crafting the templates manually. We incorporate LLM re-prompting, triggered by algorithmic parsing checks, as well as the PARENT metric induced consistency validation to identify and rectify template generation problems in real-time. ASPIRO, compared to direct LLM output, averages 66\% parsing error rate reduction in generated verbalisations of RDF triples on the DART dataset. Our best 5-shot text-davinci-003 setup, scoring BLEU of 50.62, METEOR of 45.16, BLEURT of 0.82, NUBIA of 0.87, and PARENT of 0.8962 on the Rel2Text dataset, competes effectively with recent fine-tuned pre-trained language models.

Keywords

Cite

@article{arxiv.2310.17877,
  title  = {ASPIRO: Any-shot Structured Parsing-error-Induced ReprOmpting for Consistent Data-to-Text Generation},
  author = {Martin Vejvar and Yasutaka Fujimoto},
  journal= {arXiv preprint arXiv:2310.17877},
  year   = {2023}
}

Comments

Accepted to Findings of EMNLP2023, code available at https://github.com/vejvarm/ASPIRO

R2 v1 2026-06-28T13:03:26.373Z