English
Related papers

Related papers: Evolution of Heuristics: Towards Efficient Automat…

200 papers

Optimization can be found in many real-life applications. Designing an effective algorithm for a specific optimization problem typically requires a tedious amount of effort from human experts with domain knowledge and algorithm design…

Neural and Evolutionary Computing · Computer Science 2023-11-28 Fei Liu , Xialiang Tong , Mingxuan Yuan , Qingfu Zhang

Many real-world optimization problems consist of multiple tightly coupled subproblems whose solutions must be coordinated to achieve high overall performance. However, existing large language model driven automated heuristic design…

Neural and Evolutionary Computing · Computer Science 2026-05-08 Thomas Bömer , Bastian Amberg , Max Disselnmeyer , Anne Meyer

The integration of Large Language Models (LLMs) into evolutionary frameworks has established a new paradigm for automated heuristic discovery. Despite their promise, these methods typically search in the discrete space of program syntax,…

Artificial Intelligence · Computer Science 2026-05-19 Cheikh Ahmed , Mahdi Mostajabdaveh , Zirui Zhou

Coupling Large Language Models (LLMs) with Evolutionary Algorithms has recently shown significant promise as a technique to design new heuristics that outperform existing methods, particularly in the field of combinatorial optimisation. An…

Neural and Evolutionary Computing · Computer Science 2025-01-22 Kevin Sim , Quentin Renau , Emma Hart

This paper introduces MeLA, a Metacognitive LLM-Driven Architecture that presents a new paradigm for Automatic Heuristic Design (AHD). Traditional evolutionary methods operate directly on heuristic code; in contrast, MeLA evolves the…

Artificial Intelligence · Computer Science 2025-09-08 Zishang Qiu , Xinan Chen , Long Chen , Ruibin Bai

Handcrafting heuristics for solving complex optimization tasks (e.g., route planning and task allocation) is a common practice but requires extensive domain knowledge. Recently, Large Language Model (LLM)-based automatic heuristic design…

Artificial Intelligence · Computer Science 2025-02-03 Zhi Zheng , Zhuoliang Xie , Zhenkun Wang , Bryan Hooi

Large Language Models (LLMs) have enabled automated heuristic design (AHD) for combinatorial optimization problems (COPs), but existing frameworks' reliance on fixed evolutionary rules and static prompt templates often leads to myopic…

Artificial Intelligence · Computer Science 2026-05-26 Oguzhan Gungordu , Siheng Xiong , Faramarz Fekri

Designing heuristics for combinatorial optimization problems (COPs) is a fundamental yet challenging task that traditionally requires extensive domain expertise. Recently, Large Language Model (LLM)-based Automated Heuristic Design (AHD)…

Artificial Intelligence · Computer Science 2026-04-28 Bin Chen , Shouliang Zhu , Beidan Liu , Yong Zhao , Tianle Pu , Huichun Li , Zhengqiu Zhu

Large Language Models (LLMs) have advanced the field of Combinatorial Optimization through automated heuristic generation. Instead of relying on manual design, this LLM-Driven Heuristic Design (LHD) process leverages LLMs to iteratively…

Machine Learning · Computer Science 2026-04-17 Rongzheng Wang , Yihong Huang , Muquan Li , Jiakai Li , Di Liang , Bob Simons , Pei Ke , Shuang Liang , Ke Qin

LLM-based automatic heuristic design has shown promise for generating executable heuristics for combinatorial optimization, but existing methods mainly rely on delayed endpoint performance. We propose a \emph{teacher-aware evolutionary…

Artificial Intelligence · Computer Science 2026-05-12 Minyu Chen , Song Qin , Ling-I Wu , Jianxin Xue , Guoqiang Li

Heuristics are a central component of deterministic planning, particularly in domain-independent settings where general applicability is prioritized over task-specific tuning. This work revisits that paradigm in light of recent advances in…

Artificial Intelligence · Computer Science 2026-01-07 Alexander Tuisov , Yonatan Vernik , Alexander Shleyfman

Network operation relies on heuristics to solve many tasks rapidly and efficiently across the protocol stack. These heuristics are the result of thorough human-driven design rooted in expert knowledge of the target system and problem.…

Networking and Internet Architecture · Computer Science 2026-05-28 Reza Namvar , José Gallego , Jose A. Ayala-Romero , Livia Elena Chatzieleftheriou , Andres Garcia-Saavedra , Albert Banchs , Marco Fiore

Recent advances in Large Language Models have led to remarkable achievements across a variety of Natural Language Processing tasks, making prompt engineering increasingly central to guiding model outputs. While manual methods can be…

Computation and Language · Computer Science 2025-07-15 Wendi Cui , Zhuohang Li , Hao Sun , Damien Lopez , Kamalika Das , Bradley A. Malin , Sricharan Kumar , Jiaxin Zhang

Multi-objective optimization is fundamental in complex decision-making tasks. Traditional algorithms, while effective, often demand extensive problem-specific modeling and struggle to adapt to nonlinear structures. Recent advances in Large…

Artificial Intelligence · Computer Science 2025-06-10 Diego Forniés-Tabuenca , Alejandro Uribe , Urtzi Otamendi , Arkaitz Artetxe , Juan Carlos Rivera , Oier Lopez de Lacalle

Automatic Heuristic Design (AHD) is an effective framework for solving complex optimization problems. The development of large language models (LLMs) enables the automated generation of heuristics. Existing LLM-based evolutionary methods…

Artificial Intelligence · Computer Science 2025-12-12 Hui Wang , Yang Liu , Xiaoyu Zhang , Chaoxu Mu

With the rapid advancement of large language models (LLMs), LLM-based heuristic search methods have demonstrated strong capabilities in automated algorithm generation. However, their evolutionary processes often suffer from instability and…

Neural and Evolutionary Computing · Computer Science 2026-03-23 Yu-Nian Wang , Shen-Huan Lyu , Ning Chen , Jia-Le Xu , Baoliu Ye , Qingfu Zhang

We posit that we can generate more robust and performant heuristics if we augment approaches using LLMs for heuristic design with tools that explain why heuristics underperform and suggestions about how to fix them. We find even simple…

Artificial Intelligence · Computer Science 2025-10-13 Pantea Karimi , Dany Rouhana , Pooria Namyar , Siva Kesava Reddy Kakarla , Venkat Arun , Behnaz Arzani

Solving NP-hard combinatorial optimization problems (COPs) (e.g., traveling salesman problems (TSPs) and capacitated vehicle routing problems (CVRPs)) in practice traditionally involves handcrafting heuristics or specifying a search space…

Machine Learning · Computer Science 2025-05-27 Nguyen Thach , Aida Riahifar , Nathan Huynh , Hau Chan

While systems designed for solving planning tasks vastly outperform Large Language Models (LLMs) in this domain, they usually discard the rich semantic information embedded within task descriptions. In contrast, LLMs possess parametrised…

Computation and Language · Computer Science 2025-02-03 Andrey Borro , Patricia J Riddle , Michael W Barley , Michael J Witbrock

The current investigations on hyper-heuristics design have sprung up in two different flavours: heuristics that choose heuristics and heuristics that generate heuristics. In the latter, the goal is to develop a problem-domain independent…

Artificial Intelligence · Computer Science 2010-06-10 German Terrazas , Dario Landa-Silva , Natalio Krasnogor