English
Related papers

Related papers: G-LNS: Generative Large Neighborhood Search for LL…

200 papers

Designing heuristics for combinatorial optimization problems (COPs) is a fundamental yet challenging task that traditionally requires extensive domain expertise. Recently, Large Language Model (LLM)-based Automated Heuristic Design (AHD)…

Artificial Intelligence · Computer Science 2026-04-28 Bin Chen , Shouliang Zhu , Beidan Liu , Yong Zhao , Tianle Pu , Huichun Li , Zhengqiu Zhu

Integer Linear Programs (ILPs) are powerful tools for modeling and solving a large number of combinatorial optimization problems. Recently, it has been shown that Large Neighborhood Search (LNS), as a heuristic algorithm, can find high…

Artificial Intelligence · Computer Science 2024-01-17 Taoan Huang , Aaron Ferber , Yuandong Tian , Bistra Dilkina , Benoit Steiner

Path planning is a fundamental scientific problem in robotics and autonomous navigation, requiring the derivation of efficient routes from starting to destination points while avoiding obstacles. Traditional algorithms like A* and its…

Robotics · Computer Science 2025-04-10 Silin Meng , Yiwei Wang , Cheng-Fu Yang , Nanyun Peng , Kai-Wei Chang

Large Language Model (LLM) based automated heuristic design (AHD) has shown great potential in discovering efficient heuristics. Most existing LLM-AHD frameworks use semantic evolutionary operators that rely entirely on the LLM's…

Neural and Evolutionary Computing · Computer Science 2026-04-21 Sun Shengming , Shi Jialong

The art of heuristic design has traditionally been a human pursuit. While Large Language Models (LLMs) can generate code for search heuristics, their application has largely been confined to adjusting simple functions within human-crafted…

Artificial Intelligence · Computer Science 2025-09-03 Guorui Quan , Mingfei Sun , Manuel López-Ibáñez

The omnipresence of NP-hard combinatorial optimization problems (COPs) compels domain experts to engage in trial-and-error heuristic design. The long-standing endeavor of design automation has gained new momentum with the rise of large…

Neural and Evolutionary Computing · Computer Science 2024-10-15 Haoran Ye , Jiarui Wang , Zhiguang Cao , Federico Berto , Chuanbo Hua , Haeyeon Kim , Jinkyoo Park , Guojie Song

Large Language Models (LLMs) have advanced the field of Combinatorial Optimization through automated heuristic generation. Instead of relying on manual design, this LLM-Driven Heuristic Design (LHD) process leverages LLMs to iteratively…

Machine Learning · Computer Science 2026-04-17 Rongzheng Wang , Yihong Huang , Muquan Li , Jiakai Li , Di Liang , Bob Simons , Pei Ke , Shuang Liang , Ke Qin

Heuristics are commonly used to tackle various search and optimization problems. Design heuristics usually require tedious manual crafting with domain knowledge. Recent works have incorporated Large Language Models (LLMs) into automatic…

Artificial Intelligence · Computer Science 2025-02-05 Shunyu Yao , Fei Liu , Xi Lin , Zhichao Lu , Zhenkun Wang , Qingfu Zhang

We propose a Large Neighborhood Search (LNS) approach utilizing a learned construction heuristic based on neural networks as repair operator to solve the vehicle routing problem with time windows (VRPTW). Our method uses graph neural…

Machine Learning · Computer Science 2022-05-11 Jonas K. Falkner , Daniela Thyssens , Lars Schmidt-Thieme

Hardware-Aware Neural Architecture Search (HW-NAS) requires joint optimization of accuracy and latency under device constraints. Traditional supernet-based methods require multiple GPU days per dataset. Large Language Model (LLM)-driven…

Machine Learning · Computer Science 2025-12-08 Hengyi Zhu , Grace Li Zhang , Shaoyi Huang

Automatic heuristic design (AHD) has emerged as a promising paradigm for solving NP-hard combinatorial optimization problems (COPs). Recent works show that large language models (LLMs), when integrated into well-designed frameworks (i.e.,…

Artificial Intelligence · Computer Science 2026-05-12 Haoze Lv , Ning Lu , Ziang Zhou , Shengcai Liu

Mechanism design has long been a cornerstone of economic theory, with traditional approaches relying on mathematical derivations. Recently, automated approaches, including differentiable economics with neural networks, have emerged for…

Machine Learning · Computer Science 2025-02-19 Jiayuan Liu , Mingyu Guo , Vincent Conitzer

Achieving robust networks is a challenging problem due to its NP-hard nature and complex solution space. Current methods, from handcrafted feature extraction to deep learning, have made progress but remain rigid, requiring manual design and…

Artificial Intelligence · Computer Science 2024-10-24 He Yu , Jing Liu

Graph Neural Architecture Search (GNAS) has shown promising results in finding the best graph neural network architecture on a given graph dataset. However, existing GNAS methods still require intensive human labor and rich domain knowledge…

Machine Learning · Computer Science 2025-10-28 Haishuai Wang , Yang Gao , Xin Zheng , Peng Zhang , Jiajun Bu , Philip S. Yu

Enabling robots to efficiently search for and identify objects in complex, unstructured environments is critical for diverse applications ranging from household assistance to industrial automation. However, traditional scene representations…

Robotics · Computer Science 2025-08-29 Liding Zhang , Zeqi Li , Kuanqi Cai , Qian Huang , Zhenshan Bing , Alois Knoll

Combining Large Language Models (LLMs) with heuristic search algorithms like A* holds the promise of enhanced LLM reasoning and scalable inference. To accelerate training and reduce computational demands, we investigate the coreset…

Artificial Intelligence · Computer Science 2024-10-25 Devaansh Gupta , Boyang Li

Constraint Programming (CP) and Local Search (LS) are different paradigms for dealing with combinatorial search and optimization problems. Their complementary features motivated researchers to create hybrid CP/LS solutions, maintaining both…

Neural and Evolutionary Computing · Computer Science 2019-09-19 Mateusz Ślażyński

Recent studies exploited Large Language Models (LLMs) to autonomously generate heuristics for solving Combinatorial Optimization Problems (COPs), by prompting LLMs to first provide search directions and then derive heuristics accordingly.…

Neural and Evolutionary Computing · Computer Science 2025-06-12 Xuan Wu , Di Wang , Chunguo Wu , Lijie Wen , Chunyan Miao , Yubin Xiao , You Zhou

Recent advances in Large Language Models have led to remarkable achievements across a variety of Natural Language Processing tasks, making prompt engineering increasingly central to guiding model outputs. While manual methods can be…

Computation and Language · Computer Science 2025-07-15 Wendi Cui , Zhuohang Li , Hao Sun , Damien Lopez , Kamalika Das , Bradley A. Malin , Sricharan Kumar , Jiaxin Zhang

Automatic Heuristic Design (AHD) has gained traction as a promising solution for solving combinatorial optimization problems (COPs). Large Language Models (LLMs) have emerged and become a promising approach to achieving AHD, but current…

Artificial Intelligence · Computer Science 2025-12-05 Jiawei Xu , Feng-Feng Wei , Wei-Neng Chen