English
Related papers

Related papers: Generalizable Heuristic Generation Through LLMs wi…

200 papers

Large Language Models (LLMs) have enabled automated heuristic design (AHD) for combinatorial optimization problems (COPs), but existing frameworks' reliance on fixed evolutionary rules and static prompt templates often leads to myopic…

Artificial Intelligence · Computer Science 2026-05-26 Oguzhan Gungordu , Siheng Xiong , Faramarz Fekri

Large Language Model-based Hyper Heuristic (LHH) has recently emerged as an efficient way for automatic heuristic design. However, most existing LHHs just perform well in optimizing a single function within a pre-defined solver. Their…

Artificial Intelligence · Computer Science 2026-04-15 Chuyang Xiang , Yichen Wei , Jiale Ma , Handing Wang , Junchi Yan

Since the rise of Large Language Models (LLMs) a couple of years ago, researchers in metaheuristics (MHs) have wondered how to use their power in a beneficial way within their algorithms. This paper introduces a novel approach that…

Artificial Intelligence · Computer Science 2025-02-13 Camilo Chacón Sartori , Christian Blum , Filippo Bistaffa , Guillem Rodríguez Corominas

This paper introduces MeLA, a Metacognitive LLM-Driven Architecture that presents a new paradigm for Automatic Heuristic Design (AHD). Traditional evolutionary methods operate directly on heuristic code; in contrast, MeLA evolves the…

Artificial Intelligence · Computer Science 2025-09-08 Zishang Qiu , Xinan Chen , Long Chen , Ruibin Bai

We consider enhancing large language models (LLMs) for complex planning tasks. While existing methods allow LLMs to explore intermediate steps to make plans, they either depend on unreliable self-verification or external verifiers to…

Artificial Intelligence · Computer Science 2025-02-27 Hongyi Ling , Shubham Parashar , Sambhav Khurana , Blake Olson , Anwesha Basu , Gaurangi Sinha , Zhengzhong Tu , James Caverlee , Shuiwang Ji

LLM-based automatic heuristic design has shown promise for generating executable heuristics for combinatorial optimization, but existing methods mainly rely on delayed endpoint performance. We propose a \emph{teacher-aware evolutionary…

Artificial Intelligence · Computer Science 2026-05-12 Minyu Chen , Song Qin , Ling-I Wu , Jianxin Xue , Guoqiang Li

Automatic Heuristic Design (AHD) is an effective framework for solving complex optimization problems. The development of large language models (LLMs) enables the automated generation of heuristics. Existing LLM-based evolutionary methods…

Artificial Intelligence · Computer Science 2025-12-12 Hui Wang , Yang Liu , Xiaoyu Zhang , Chaoxu Mu

Multi-objective optimization problems (MOPs) are ubiquitous in real-world applications, presenting a complex challenge of balancing multiple conflicting objectives. Traditional evolutionary algorithms (EAs), though effective, often rely on…

Neural and Evolutionary Computing · Computer Science 2024-07-29 Yuxiao Huang , Shenghao Wu , Wenjie Zhang , Jibin Wu , Liang Feng , Kay Chen Tan

Large Language Models (LLMs) have shown great potential in automatically generating and optimizing (meta)heuristics, making them valuable tools in heuristic optimization tasks. However, LLMs are generally inefficient when it comes to…

Neural and Evolutionary Computing · Computer Science 2025-05-23 Niki van Stein , Diederick Vermetten , Thomas Bäck

Designing heuristics for combinatorial optimization problems (COPs) is a fundamental yet challenging task that traditionally requires extensive domain expertise. Recently, Large Language Model (LLM)-based Automated Heuristic Design (AHD)…

Artificial Intelligence · Computer Science 2026-04-28 Bin Chen , Shouliang Zhu , Beidan Liu , Yong Zhao , Tianle Pu , Huichun Li , Zhengqiu Zhu

Designing effective heuristics for NP-hard combinatorial optimization problems remains challenging and often requires substantial domain expertise. Recent LLM-guided evolutionary methods have shown promise for automated heuristic…

Artificial Intelligence · Computer Science 2026-05-27 Cuong Van Duc , Minh Nguyen Dinh Tuan , Tam Vu Duc , Tung Vu Duy , Son Nguyen Van , Hanh Nguyen Thi , Binh Huynh Thi Thanh

Solving an optimization task in any domain is a very challenging problem, especially when dealing with nonlinear problems and non-convex functions. Many meta-heuristic algorithms are very efficient when solving nonlinear functions. A…

Neural and Evolutionary Computing · Computer Science 2020-07-28 Mona Nasr , Omar Farouk , Ahmed Mohamedeen , Ali Elrafie , Marwan Bedeir , Ali Khaled

The art of heuristic design has traditionally been a human pursuit. While Large Language Models (LLMs) can generate code for search heuristics, their application has largely been confined to adjusting simple functions within human-crafted…

Artificial Intelligence · Computer Science 2025-09-03 Guorui Quan , Mingfei Sun , Manuel López-Ibáñez

In recent years, large language models (LLMs) have shown remarkable capabilities in various artificial intelligence problems. However, they fail to plan reliably, even when prompted with a detailed definition of the planning task. Attempts…

Artificial Intelligence · Computer Science 2025-10-27 Augusto B. Corrêa , André G. Pereira , Jendrik Seipp

The integration of Large Language Models (LLMs) into evolutionary frameworks has established a new paradigm for automated heuristic discovery. Despite their promise, these methods typically search in the discrete space of program syntax,…

Artificial Intelligence · Computer Science 2026-05-19 Cheikh Ahmed , Mahdi Mostajabdaveh , Zirui Zhou

Heuristic functions are essential to the performance of tree search algorithms such as A*, where their accuracy and efficiency directly impact search outcomes. Traditionally, such heuristics are handcrafted, requiring significant expertise.…

Artificial Intelligence · Computer Science 2026-01-28 Thomas Bömer , Nico Koltermann , Max Disselnmeyer , Bastian Amberg , Anne Meyer

Large language models (LLMs) have greatly accelerated the automation of algorithm generation and optimization. However, current methods such as EoH and FunSearch mainly rely on predefined templates and expert-specified functions that focus…

Software Engineering · Computer Science 2025-03-17 Zhe Zhao , Haibin Wen , Pengkun Wang , Ye Wei , Zaixi Zhang , Xi Lin , Fei Liu , Bo An , Hui Xiong , Yang Wang , Qingfu Zhang

Large Language Models (LLMs) struggle to solve complex combinatorial problems through direct reasoning, so recent neuro-symbolic systems increasingly use them to synthesize executable solvers. A central design question is how the LLM should…

Artificial Intelligence · Computer Science 2026-05-13 Haoyu Wang , Yuliang Song , Tao Li , Zhiwei Deng , Yaqing Wang , Deepak Ramachandran , Eldan Cohen , Dan Roth

The current investigations on hyper-heuristics design have sprung up in two different flavours: heuristics that choose heuristics and heuristics that generate heuristics. In the latter, the goal is to develop a problem-domain independent…

Artificial Intelligence · Computer Science 2010-06-10 German Terrazas , Dario Landa-Silva , Natalio Krasnogor

Many real-world optimization problems consist of multiple tightly coupled subproblems whose solutions must be coordinated to achieve high overall performance. However, existing large language model driven automated heuristic design…

Neural and Evolutionary Computing · Computer Science 2026-05-08 Thomas Bömer , Bastian Amberg , Max Disselnmeyer , Anne Meyer