English
Related papers

Related papers: Heuristic Search as Language-Guided Program Optimi…

200 papers

Large language models (LLMs) have recently advanced automatic heuristic design (AHD) for combinatorial optimization (CO), where candidate heuristics are iteratively proposed, evaluated, and refined. Most existing approaches search over…

Artificial Intelligence · Computer Science 2026-05-08 Nguyen Viet Tuan Kiet , Bui Dinh Pham , Dao Van Tung , Tran Cong Dao , Huynh Thi Thanh Binh

We consider enhancing large language models (LLMs) for complex planning tasks. While existing methods allow LLMs to explore intermediate steps to make plans, they either depend on unreliable self-verification or external verifiers to…

Artificial Intelligence · Computer Science 2025-02-27 Hongyi Ling , Shubham Parashar , Sambhav Khurana , Blake Olson , Anwesha Basu , Gaurangi Sinha , Zhengzhong Tu , James Caverlee , Shuiwang Ji

Automated heuristic design (AHD) has gained considerable attention for its potential to automate the development of effective heuristics. The recent advent of large language models (LLMs) has paved a new avenue for AHD, with initial efforts…

Neural and Evolutionary Computing · Computer Science 2024-07-16 Rui Zhang , Fei Liu , Xi Lin , Zhenkun Wang , Zhichao Lu , Qingfu Zhang

Recent advances in Large Language Models have led to remarkable achievements across a variety of Natural Language Processing tasks, making prompt engineering increasingly central to guiding model outputs. While manual methods can be…

Computation and Language · Computer Science 2025-07-15 Wendi Cui , Zhuohang Li , Hao Sun , Damien Lopez , Kamalika Das , Bradley A. Malin , Sricharan Kumar , Jiaxin Zhang

Tackling complex optimization problems often relies on expert-designed heuristics, typically crafted through extensive trial and error. Recent advances demonstrate that large language models (LLMs), when integrated into well-designed…

Neural and Evolutionary Computing · Computer Science 2025-05-20 Ziyao Huang , Weiwei Wu , Kui Wu , Jianping Wang , Wei-Bin Lee

Designing heuristics for combinatorial optimization problems (COPs) is a fundamental yet challenging task that traditionally requires extensive domain expertise. Recently, Large Language Model (LLM)-based Automated Heuristic Design (AHD)…

Artificial Intelligence · Computer Science 2026-04-28 Bin Chen , Shouliang Zhu , Beidan Liu , Yong Zhao , Tianle Pu , Huichun Li , Zhengqiu Zhu

Automated Heuristic Design (AHD) using Large Language Models (LLMs) has achieved notable success in recent years. Despite the effectiveness of existing approaches, they only design a single heuristic to serve all problem instances, often…

Artificial Intelligence · Computer Science 2025-08-21 Fei Liu , Yilu Liu , Qingfu Zhang , Xialiang Tong , Mingxuan Yuan

Large Language Model (LLM) based automated heuristic design (AHD) has shown great potential in discovering efficient heuristics. Most existing LLM-AHD frameworks use semantic evolutionary operators that rely entirely on the LLM's…

Neural and Evolutionary Computing · Computer Science 2026-04-21 Sun Shengming , Shi Jialong

The integration of Large Language Models (LLMs) into evolutionary frameworks has established a new paradigm for automated heuristic discovery. Despite their promise, these methods typically search in the discrete space of program syntax,…

Artificial Intelligence · Computer Science 2026-05-19 Cheikh Ahmed , Mahdi Mostajabdaveh , Zirui Zhou

The art of heuristic design has traditionally been a human pursuit. While Large Language Models (LLMs) can generate code for search heuristics, their application has largely been confined to adjusting simple functions within human-crafted…

Artificial Intelligence · Computer Science 2025-09-03 Guorui Quan , Mingfei Sun , Manuel López-Ibáñez

Heuristic search is the dominant paradigm in symbolic AI planning, and the strongest heuristics are the result of decades of work by planning researchers. Recent work has shown that large language models (LLMs) can design heuristics for…

Artificial Intelligence · Computer Science 2026-05-29 Elliot Gestrin , Jendrik Seipp

Automatic Heuristic Design (AHD) is an effective framework for solving complex optimization problems. The development of large language models (LLMs) enables the automated generation of heuristics. Existing LLM-based evolutionary methods…

Artificial Intelligence · Computer Science 2025-12-12 Hui Wang , Yang Liu , Xiaoyu Zhang , Chaoxu Mu

While Large Language Models (LLMs) have recently shown promise in Automated Heuristic Design (AHD), existing approaches typically formulate AHD around constructive priority rules or parameterized local search guidance, thereby restricting…

Artificial Intelligence · Computer Science 2026-02-10 Baoyun Zhao , He Wang , Liang Zeng

This paper introduces MeLA, a Metacognitive LLM-Driven Architecture that presents a new paradigm for Automatic Heuristic Design (AHD). Traditional evolutionary methods operate directly on heuristic code; in contrast, MeLA evolves the…

Artificial Intelligence · Computer Science 2025-09-08 Zishang Qiu , Xinan Chen , Long Chen , Ruibin Bai

In complex engineering systems, the dependencies among components or development activities are often modeled and analyzed using Design Structure Matrix (DSM). Reorganizing elements within a DSM to minimize feedback loops and enhance…

Computational Engineering, Finance, and Science · Computer Science 2026-04-07 Shuo Jiang , Min Xie , Jianxi Luo

Designing optimization approaches, whether heuristic or meta-heuristic, usually demands extensive manual intervention and has difficulty generalizing across diverse problem domains. The combination of Large Language Models (LLMs) and…

Neural and Evolutionary Computing · Computer Science 2024-10-29 He Yu , Jing Liu

Heuristic design with large language models (LLMs) has emerged as a promising approach for tackling combinatorial optimization problems (COPs). However, existing approaches often rely on manually predefined evolutionary computation (EC)…

Machine Learning · Computer Science 2026-03-25 Yiding Shi , Jianan Zhou , Wen Song , Jieyi Bi , Yaoxin Wu , Zhiguang Cao , Jie Zhang

Large Language Models (LLMs) have enabled automated heuristic design (AHD) for combinatorial optimization problems (COPs), but existing frameworks' reliance on fixed evolutionary rules and static prompt templates often leads to myopic…

Artificial Intelligence · Computer Science 2026-05-26 Oguzhan Gungordu , Siheng Xiong , Faramarz Fekri

Large Language Models (LLMs) have advanced the field of Combinatorial Optimization through automated heuristic generation. Instead of relying on manual design, this LLM-Driven Heuristic Design (LHD) process leverages LLMs to iteratively…

Machine Learning · Computer Science 2026-04-17 Rongzheng Wang , Yihong Huang , Muquan Li , Jiakai Li , Di Liang , Bob Simons , Pei Ke , Shuang Liang , Ke Qin

Mechanism design has long been a cornerstone of economic theory, with traditional approaches relying on mathematical derivations. Recently, automated approaches, including differentiable economics with neural networks, have emerged for…

Machine Learning · Computer Science 2025-02-19 Jiayuan Liu , Mingyu Guo , Vincent Conitzer
‹ Prev 1 2 3 10 Next ›