English

Codifying Natural Langauge Tasks

Computation and Language 2025-09-23 v1 Artificial Intelligence

Abstract

We explore the applicability of text-to-code to solve real-world problems that are typically solved in natural language, such as legal judgment and medical QA. Unlike previous works, our approach leverages the explicit reasoning provided by program generation. We present ICRAG, a framework that transforms natural language into executable programs through iterative refinement using external knowledge from domain resources and GitHub. Across 13 benchmarks, ICRAG achieves up to 161.1\% relative improvement. We provide a detailed analysis of the generated code and the impact of external knowledge, and we discuss the limitations of applying text-to-code approaches to real-world natural language tasks.

Keywords

Cite

@article{arxiv.2509.17455,
  title  = {Codifying Natural Langauge Tasks},
  author = {Haoyang Chen and Kumiko Tanaka-Ishii},
  journal= {arXiv preprint arXiv:2509.17455},
  year   = {2025}
}

Comments

Submitted to Journal of Automated Software Engineering

R2 v1 2026-07-01T05:48:59.945Z