English
Related papers

Related papers: LLM-Driven Instance-Specific Heuristic Generation …

200 papers

Heuristic search is a powerful approach that has successfully been applied to a broad class of planning problems, including classical planning, multi-objective planning, and probabilistic planning modelled as a stochastic shortest path…

Artificial Intelligence · Computer Science 2024-10-29 Dillon Chen , Felipe Trevizan , Sylvie Thiébaux

Since the adoption of large language models (LLMs) for text evaluation has become increasingly prevalent in the field of natural language processing (NLP), a series of existing works attempt to optimize the prompts for LLM evaluators to…

Computation and Language · Computer Science 2025-06-03 Bosi Wen , Pei Ke , Yufei Sun , Cunxiang Wang , Xiaotao Gu , Jinfeng Zhou , Jie Tang , Hongning Wang , Minlie Huang

Many resource management problems require sequential decision-making under uncertainty, where the only uncertainty affecting the decision outcomes are exogenous variables outside the control of the decision-maker. We model these problems as…

Large Language Model-based Hyper Heuristic (LHH) has recently emerged as an efficient way for automatic heuristic design. However, most existing LHHs just perform well in optimizing a single function within a pre-defined solver. Their…

Artificial Intelligence · Computer Science 2026-04-15 Chuyang Xiang , Yichen Wei , Jiale Ma , Handing Wang , Junchi Yan

Large Language Models (LLMs) have advanced Automated Heuristic Design (AHD) in combinatorial optimization (CO) in the past few years. However, existing discovery pipelines often require extensive manual trial-and-error or reliance on domain…

Neural and Evolutionary Computing · Computer Science 2026-02-19 Mingxin Yu , Ruixiao Yang , Chuchu Fan

Recent studies have suggested that Large Language Models (LLMs) could provide interesting ideas contributing to mathematical discovery. This claim was motivated by reports that LLM-based genetic algorithms produced heuristics offering new…

Artificial Intelligence · Computer Science 2025-11-03 Julien Herrmann , Guillaume Pallez

Accelerating inference in Large Language Models (LLMs) is critical for real-time interactions, as they have been widely incorporated into real-world services. Speculative decoding, a fully algorithmic solution, has gained attention for…

Computation and Language · Computer Science 2025-02-11 Sukmin Cho , Sangjin Choi , Taeho Hwang , Jeongyeon Seo , Soyeong Jeong , Huije Lee , Hoyun Song , Jong C. Park , Youngjin Kwon

Training of Machine Learning (ML) models in real contexts often deals with big data sets and high-class imbalance samples where the class of interest is unrepresented (minority class). Practical solutions using classical ML models address…

Machine Learning · Computer Science 2022-10-11 Germán E. Melo-Acosta , Freddy Duitama-Muñoz , Julián D. Arias-Londoño

Multi-objective optimization is fundamental in complex decision-making tasks. Traditional algorithms, while effective, often demand extensive problem-specific modeling and struggle to adapt to nonlinear structures. Recent advances in Large…

Artificial Intelligence · Computer Science 2025-06-10 Diego Forniés-Tabuenca , Alejandro Uribe , Urtzi Otamendi , Arkaitz Artetxe , Juan Carlos Rivera , Oier Lopez de Lacalle

Large Language Models (LLMs) have shown great potential in automatically generating and optimizing (meta)heuristics, making them valuable tools in heuristic optimization tasks. However, LLMs are generally inefficient when it comes to…

Neural and Evolutionary Computing · Computer Science 2025-05-23 Niki van Stein , Diederick Vermetten , Thomas Bäck

Over the last few decades, researchers have made considerable efforts to make decision support more accessible for small and medium enterprises by reducing the cost of designing, developing and maintaining automated decision support…

Software Engineering · Computer Science 2025-04-07 Daniel Karapetyan

The superior performance of ensemble methods with infinite models are well known. Most of these methods are based on optimization problems in infinite-dimensional spaces with some regularization, for instance, boosting methods and convex…

Machine Learning · Statistics 2017-12-18 Atsushi Nitanda , Taiji Suzuki

Sequential decision problems in applications such as manipulation in warehouses, multi-step meal preparation, and routing in autonomous vehicle networks often involve reasoning about uncertainty, planning over discrete modes as well as…

Artificial Intelligence · Computer Science 2019-06-24 Shushman Choudhury , Mykel J. Kochenderfer

We introduce a novel variant of cutting production planning problems named Integrated Cutting and Packing Heterogeneous Precast Beams Multiperiod Production Planning (ICP-HPBMPP). We propose an integer linear programming model for the…

Optimization and Control · Mathematics 2020-08-27 Kennedy Araujo , Tiberius Bonates , Bruno Prata

Achieving robust networks is a challenging problem due to its NP-hard nature and complex solution space. Current methods, from handcrafted feature extraction to deep learning, have made progress but remain rigid, requiring manual design and…

Artificial Intelligence · Computer Science 2024-10-24 He Yu , Jing Liu

In many operational applications, it is necessary to routinely find, within a very limited time window, provably good solutions to challenging mixed-integer linear programming (MILP) problems. An example is the Security-Constrained Unit…

Optimization and Control · Mathematics 2022-08-23 Xiaoyi Gu , Santanu S. Dey , Álinson S. Xavier , Feng Qiu

Large Language Models (LLMs) have become essential in advancing natural language processing (NLP) tasks, but their sequential token generation limits inference speed. Multi-Draft Speculative Decoding (MDSD) offers a promising solution by…

Computation and Language · Computer Science 2024-11-11 Ryan Sun , Tianyi Zhou , Xun Chen , Lichao Sun

This study investigates the potential of hybrid metaheuristic algorithms to enhance the training of Probabilistic Neural Networks (PNNs) by leveraging the complementary strengths of multiple optimisation strategies. Traditional learning…

Neural and Evolutionary Computing · Computer Science 2025-04-16 Piotr A. Kowalski , Szymon Kucharczyk , Jacek Mańdziuk

Despite their widespread adoption in various domains, especially due to their powerful reasoning capabilities, Large Language Models (LLMs) are not the off-the-shelf choice to drive multi-objective optimization yet. Conventional strategies…

Machine Learning · Computer Science 2026-01-21 Andrej Schwanke , Lyubomir Ivanov , David Salinas , Frank Hutter , Arber Zela

Ensembles of generative large language models (LLMs) are a promising way to compensate for individual model limitations, integrating the strengths of different LLMs. Existing LLM ensemble methods, however, face limitations such as…

Computation and Language · Computer Science 2026-03-09 Bo Lv , Nayu Liu , Chen Tang , Xin Liu , Yue Yu , Ping Luo