English
Related papers

Related papers: Complex LLM Planning via Automated Heuristics Disc…

200 papers

Heuristics have achieved great success in solving combinatorial optimization problems~(COPs). However, heuristics designed by humans require too much domain knowledge and testing time. Since Large Language Models~(LLMs) possess strong…

Artificial Intelligence · Computer Science 2025-06-23 Hui Wang , Xufeng Zhang , Chaoxu Mu

Heuristic algorithms play a vital role in solving combinatorial optimization (CO) problems, yet traditional designs depend heavily on manual expertise and struggle to generalize across diverse instances. We introduce \textbf{HeurAgenix}, a…

Artificial Intelligence · Computer Science 2025-06-25 Xianliang Yang , Ling Zhang , Haolong Qian , Lei Song , Jiang Bian

This paper introduces MeLA, a Metacognitive LLM-Driven Architecture that presents a new paradigm for Automatic Heuristic Design (AHD). Traditional evolutionary methods operate directly on heuristic code; in contrast, MeLA evolves the…

Artificial Intelligence · Computer Science 2025-09-08 Zishang Qiu , Xinan Chen , Long Chen , Ruibin Bai

The planning ability of Large Language Models (LLMs) has garnered increasing attention in recent years due to their remarkable capacity for multi-step reasoning and their ability to generalize across a wide range of domains. While some…

Artificial Intelligence · Computer Science 2025-02-19 Mohamed Aghzal , Erion Plaku , Gregory J. Stein , Ziyu Yao

Satisfiability problem (SAT) is a cornerstone of computational complexity with broad industrial applications, and it remains challenging to optimize modern SAT solvers in real-world settings due to their intricate architectures. While…

Artificial Intelligence · Computer Science 2025-07-31 Yiwen Sun , Furong Ye , Zhihan Chen , Ke Wei , Shaowei Cai

While Large Language Models (LLMs) have recently shown promise in Automated Heuristic Design (AHD), existing approaches typically formulate AHD around constructive priority rules or parameterized local search guidance, thereby restricting…

Artificial Intelligence · Computer Science 2026-02-10 Baoyun Zhao , He Wang , Liang Zeng

The art of heuristic design has traditionally been a human pursuit. While Large Language Models (LLMs) can generate code for search heuristics, their application has largely been confined to adjusting simple functions within human-crafted…

Artificial Intelligence · Computer Science 2025-09-03 Guorui Quan , Mingfei Sun , Manuel López-Ibáñez

Large Language Models (LLMs) have advanced the field of Combinatorial Optimization through automated heuristic generation. Instead of relying on manual design, this LLM-Driven Heuristic Design (LHD) process leverages LLMs to iteratively…

Machine Learning · Computer Science 2026-04-17 Rongzheng Wang , Yihong Huang , Muquan Li , Jiakai Li , Di Liang , Bob Simons , Pei Ke , Shuang Liang , Ke Qin

Heuristic design with large language models (LLMs) has emerged as a promising approach for tackling combinatorial optimization problems (COPs). However, existing approaches often rely on manually predefined evolutionary computation (EC)…

Machine Learning · Computer Science 2026-03-25 Yiding Shi , Jianan Zhou , Wen Song , Jieyi Bi , Yaoxin Wu , Zhiguang Cao , Jie Zhang

Automated planning is concerned with developing efficient algorithms to generate plans or sequences of actions to achieve a specific goal in a given environment. Emerging Large Language Models (LLMs) can answer questions, write high-quality…

Designing heuristics for combinatorial optimization problems (COPs) is a fundamental yet challenging task that traditionally requires extensive domain expertise. Recently, Large Language Model (LLM)-based Automated Heuristic Design (AHD)…

Artificial Intelligence · Computer Science 2026-04-28 Bin Chen , Shouliang Zhu , Beidan Liu , Yong Zhao , Tianle Pu , Huichun Li , Zhengqiu Zhu

Combinatorial optimization problems often rely on heuristic algorithms to generate efficient solutions. However, the manual design of heuristics is resource-intensive and constrained by the designer's expertise. Recent advances in…

Artificial Intelligence · Computer Science 2025-03-06 Thomas Bömer , Nico Koltermann , Max Disselnmeyer , Laura Dörr , Anne Meyer

Achieving robust networks is a challenging problem due to its NP-hard nature and complex solution space. Current methods, from handcrafted feature extraction to deep learning, have made progress but remain rigid, requiring manual design and…

Artificial Intelligence · Computer Science 2024-10-24 He Yu , Jing Liu

Solving NP-hard combinatorial optimization problems (COPs) (e.g., traveling salesman problems (TSPs) and capacitated vehicle routing problems (CVRPs)) in practice traditionally involves handcrafting heuristics or specifying a search space…

Machine Learning · Computer Science 2025-05-27 Nguyen Thach , Aida Riahifar , Nathan Huynh , Hau Chan

Intrigued by the claims of emergent reasoning capabilities in LLMs trained on general web corpora, in this paper, we set out to investigate their planning capabilities. We aim to evaluate (1) how good LLMs are by themselves in generating…

Artificial Intelligence · Computer Science 2023-02-15 Karthik Valmeekam , Sarath Sreedharan , Matthew Marquez , Alberto Olmo , Subbarao Kambhampati

Recent advances in Large Language Models (LLMs) are fostering their integration into several reasoning-related fields, including Automated Planning (AP). However, their integration into Hierarchical Planning (HP), a subfield of AP that…

Artificial Intelligence · Computer Science 2025-11-25 Israel Puerta-Merino , Carlos Núñez-Molina , Pablo Mesejo , Juan Fernández-Olivares

Automatic performance tuning (auto-tuning) is essential for optimizing high-performance applications, where vast and irregular search spaces make manual exploration infeasible. While auto-tuners traditionally rely on classical approaches…

Machine Learning · Computer Science 2026-04-01 Floris-Jan Willemsen , Niki van Stein , Ben van Werkhoven

Resource-management tasks in modern operating and distributed systems continue to rely primarily on hand-designed heuristics for tasks such as scheduling, caching, or active queue management. Designing performant heuristics is an expensive,…

Operating Systems · Computer Science 2026-01-01 Rohit Dwivedula , Divyanshu Saxena , Sujay Yadalam , Daehyeok Kim , Aditya Akella

LLM-based automatic heuristic design has shown promise for generating executable heuristics for combinatorial optimization, but existing methods mainly rely on delayed endpoint performance. We propose a \emph{teacher-aware evolutionary…

Artificial Intelligence · Computer Science 2026-05-12 Minyu Chen , Song Qin , Ling-I Wu , Jianxin Xue , Guoqiang Li

Mechanism design has long been a cornerstone of economic theory, with traditional approaches relying on mathematical derivations. Recently, automated approaches, including differentiable economics with neural networks, have emerged for…

Machine Learning · Computer Science 2025-02-19 Jiayuan Liu , Mingyu Guo , Vincent Conitzer