English

Evolution without an Oracle: Driving Effective Evolution with LLM Judges

Software Engineering 2025-11-26 v1 Artificial Intelligence

Abstract

The integration of Large Language Models (LLMs) with Evolutionary Computation (EC) has unlocked new frontiers in scientific discovery but remains shackled by a fundamental constraint: the reliance on an Oracle--an objective, machine-computable fitness function. This paper breaks this barrier by asking: Can evolution thrive in a purely subjective landscape governed solely by LLM judges? We introduce MADE (Multi-Agent Decomposed Evolution), a framework that tames the inherent noise of subjective evaluation through "Problem Specification." By decomposing vague instructions into specific, verifiable sub-requirements, MADE transforms high-variance LLM feedback into stable, precise selection pressure. The results are transformative: across complex benchmarks like DevAI and InfoBench, MADE outperforms strong baselines by over 50% in software requirement satisfaction (39.9% to 61.9%) and achieves a 95% perfect pass rate on complex instruction following. This work validates a fundamental paradigm shift: moving from optimizing "computable metrics" to "describable qualities," thereby unlocking evolutionary optimization for the vast open-ended domains where no ground truth exists.

Keywords

Cite

@article{arxiv.2511.19489,
  title  = {Evolution without an Oracle: Driving Effective Evolution with LLM Judges},
  author = {Zhe Zhao and Yuheng Yang and Haibin Wen and Xiaojie Qiu and Zaixi Zhang and Qingfu Zhang},
  journal= {arXiv preprint arXiv:2511.19489},
  year   = {2025}
}

Comments

14 pages, 5 figures

R2 v1 2026-07-01T07:52:49.384Z