English

CDEoH: Category-Driven Automatic Algorithm Design With Large Language Models

Neural and Evolutionary Computing 2026-03-23 v1 Artificial Intelligence

Abstract

With the rapid advancement of large language models (LLMs), LLM-based heuristic search methods have demonstrated strong capabilities in automated algorithm generation. However, their evolutionary processes often suffer from instability and premature convergence. Existing approaches mainly address this issue through prompt engineering or by jointly evolving thought and code, while largely overlooking the critical role of algorithmic category diversity in maintaining evolutionary stability. To this end, we propose Category Driven Automatic Algorithm Design with Large Language Models (CDEoH), which explicitly models algorithm categories and jointly balances performance and category diversity in population management, enabling parallel exploration across multiple algorithmic paradigms. Extensive experiments on representative combinatorial optimization problems across multiple scales demonstrate that CDEoH effectively mitigates convergence toward a single evolutionary direction, significantly enhancing evolutionary stability and achieving consistently superior average performance across tasks and scales.

Keywords

Cite

@article{arxiv.2603.19284,
  title  = {CDEoH: Category-Driven Automatic Algorithm Design With Large Language Models},
  author = {Yu-Nian Wang and Shen-Huan Lyu and Ning Chen and Jia-Le Xu and Baoliu Ye and Qingfu Zhang},
  journal= {arXiv preprint arXiv:2603.19284},
  year   = {2026}
}