English
Related papers

Related papers: Latent Heuristic Search: Continuous Optimization f…

200 papers

Large Language Model (LLM) based automated heuristic design (AHD) has shown great potential in discovering efficient heuristics. Most existing LLM-AHD frameworks use semantic evolutionary operators that rely entirely on the LLM's…

Neural and Evolutionary Computing · Computer Science 2026-04-21 Sun Shengming , Shi Jialong

Optimization algorithms are widely employed to tackle complex problems, but designing them manually is often labor-intensive and requires significant expertise. Global placement is a fundamental step in electronic design automation (EDA).…

Neural and Evolutionary Computing · Computer Science 2025-04-28 Xufeng Yao , Jiaxi Jiang , Yuxuan Zhao , Peiyu Liao , Yibo Lin , Bei Yu

Designing high-performing heuristics for vehicle routing problems (VRPs) is a complex task that requires both intuition and deep domain knowledge. Large language model (LLM)-based code generation has recently shown promise across many…

Designing high-performing metaheuristics for NP-hard combinatorial optimization problems, such as the Vehicle Routing Problem (VRP), remains a significant challenge, often requiring extensive domain expertise and manual tuning. Recent…

Neural and Evolutionary Computing · Computer Science 2026-04-10 Manuj Malik , Jianan Zhou , Shashank Reddy Chirra , Zhiguang Cao

We introduce Limited Rollout Beam Search (LRBS), a beam search strategy for deep reinforcement learning (DRL) based combinatorial optimization improvement heuristics. Utilizing pre-trained models on the Euclidean Traveling Salesperson…

Machine Learning · Computer Science 2024-12-16 Federico Julian Camerota Verdù , Lorenzo Castelli , Luca Bortolussi

Heuristics are a central component of deterministic planning, particularly in domain-independent settings where general applicability is prioritized over task-specific tuning. This work revisits that paradigm in light of recent advances in…

Artificial Intelligence · Computer Science 2026-01-07 Alexander Tuisov , Yonatan Vernik , Alexander Shleyfman

We investigate the behaviour space of meta-heuristic optimisation algorithms automatically generated by Large Language Model driven algorithm discovery methods. Using the Large Language Evolutionary Algorithm (LLaMEA) framework with a GPT…

Neural and Evolutionary Computing · Computer Science 2025-07-08 Niki van Stein , Haoran Yin , Anna V. Kononova , Thomas Bäck , Gabriela Ochoa

Recent advances have shown that optimizing prompts for Large Language Models (LLMs) can significantly improve task performance, yet many optimization techniques rely on heuristics or manual exploration. We present LatentPrompt, a…

Computation and Language · Computer Science 2025-08-05 Mateusz Bystroński , Grzegorz Piotrowski , Nitesh V. Chawla , Tomasz Kajdanowicz

Large Language Model-based Hyper Heuristic (LHH) has recently emerged as an efficient way for automatic heuristic design. However, most existing LHHs just perform well in optimizing a single function within a pre-defined solver. Their…

Artificial Intelligence · Computer Science 2026-04-15 Chuyang Xiang , Yichen Wei , Jiale Ma , Handing Wang , Junchi Yan

The integration of Large Language Models (LLMs) into optimization has created a powerful synergy, opening exciting research opportunities. This paper investigates how LLMs can enhance existing optimization algorithms. Using their…

Artificial Intelligence · Computer Science 2025-02-13 Camilo Chacón Sartori , Christian Blum

Designing heuristics for combinatorial optimization problems (COPs) is a fundamental yet challenging task that traditionally requires extensive domain expertise. Recently, Large Language Model (LLM)-based Automated Heuristic Design (AHD)…

Artificial Intelligence · Computer Science 2026-04-28 Bin Chen , Shouliang Zhu , Beidan Liu , Yong Zhao , Tianle Pu , Huichun Li , Zhengqiu Zhu

Large Language Model (LLM)-guided evolutionary search is increasingly used for automated algorithm discovery, yet most current methods track search progress primarily through executable programs and scalar fitness. Even when…

Computation and Language · Computer Science 2026-05-11 Sichun Luo , Yi Huang , Haochen Luo , Fengyuan Liu , Guanzhi Deng , Lei Li , Qinghua Yao , Zefa Hu , Junlan Feng , Qi Liu

Automatic performance tuning (auto-tuning) is essential for optimizing high-performance applications, where vast and irregular search spaces make manual exploration infeasible. While auto-tuners traditionally rely on classical approaches…

Machine Learning · Computer Science 2026-04-01 Floris-Jan Willemsen , Niki van Stein , Ben van Werkhoven

Traffic Signal Control (TSC) involves a challenging trade-off: classic heuristics are efficient but oversimplified, while Deep Reinforcement Learning (DRL) achieves high performance yet suffers from poor generalization and opaque policies.…

Artificial Intelligence · Computer Science 2025-12-01 Ruibing Wang , Shuhan Guo , Zeen Li , Zhen Wang , Quanming Yao

Heuristic design with large language models (LLMs) has emerged as a promising approach for tackling combinatorial optimization problems (COPs). However, existing approaches often rely on manually predefined evolutionary computation (EC)…

Machine Learning · Computer Science 2026-03-25 Yiding Shi , Jianan Zhou , Wen Song , Jieyi Bi , Yaoxin Wu , Zhiguang Cao , Jie Zhang

Automatic Heuristic Design (AHD) is an active research area due to its utility in solving complex search and NP-hard combinatorial optimization problems in the real world. The recent advancements in Large Language Models (LLMs) introduce…

Neural and Evolutionary Computing · Computer Science 2024-12-20 Pham Vu Tuan Dat , Long Doan , Huynh Thi Thanh Binh

Heuristic algorithms play a vital role in solving combinatorial optimization (CO) problems, yet traditional designs depend heavily on manual expertise and struggle to generalize across diverse instances. We introduce \textbf{HeurAgenix}, a…

Artificial Intelligence · Computer Science 2025-06-25 Xianliang Yang , Ling Zhang , Haolong Qian , Lei Song , Jiang Bian

Achieving robust networks is a challenging problem due to its NP-hard nature and complex solution space. Current methods, from handcrafted feature extraction to deep learning, have made progress but remain rigid, requiring manual design and…

Artificial Intelligence · Computer Science 2024-10-24 He Yu , Jing Liu

Since the adoption of large language models (LLMs) for text evaluation has become increasingly prevalent in the field of natural language processing (NLP), a series of existing works attempt to optimize the prompts for LLM evaluators to…

Computation and Language · Computer Science 2025-06-03 Bosi Wen , Pei Ke , Yufei Sun , Cunxiang Wang , Xiaotao Gu , Jinfeng Zhou , Jie Tang , Hongning Wang , Minlie Huang

Large Language Models have recently emerged as a promising paradigm for automated heuristic design for NP-hard combinatorial optimization problems. Despite this progress, existing LLM-based methods typically rely on monolithic workflows…

Artificial Intelligence · Computer Science 2026-05-11 Yuping Yan , Jirui Han , Fei Ming , Yuanshuai Li , Yaochu Jin