English
Related papers

Related papers: LLM-Driven Instance-Specific Heuristic Generation …

200 papers

Heuristic algorithms such as simulated annealing, Concorde, and METIS are effective and widely used approaches to find solutions to combinatorial optimization problems. However, they are limited by the high sample complexity required to…

Machine Learning · Computer Science 2019-06-18 Qingpeng Cai , Will Hang , Azalia Mirhoseini , George Tucker , Jingtao Wang , Wei Wei

Solving NP-hard combinatorial optimization problems (COPs) (e.g., traveling salesman problems (TSPs) and capacitated vehicle routing problems (CVRPs)) in practice traditionally involves handcrafting heuristics or specifying a search space…

Machine Learning · Computer Science 2025-05-27 Nguyen Thach , Aida Riahifar , Nathan Huynh , Hau Chan

Cross-domain selection hyper-heuristics aim to distill decades of research on problem-specific heuristic search algorithms into adaptable general-purpose search strategies. In this respect, existing selection hyper-heuristics primarily…

Artificial Intelligence · Computer Science 2025-09-04 Václav Sobotka , Lucas Kletzander , Nysret Musliu , Hana Rudová

This paper presents an evaluation framework for assessing Large Language Models' (LLMs) capabilities in combinatorial optimization, specifically addressing the 2D bin-packing problem. We introduce a systematic methodology that combines LLMs…

Artificial Intelligence · Computer Science 2025-10-03 Syed Mahbubul Huq , Daniel Brito , Daniel Sikar , Chris Child , Tillman Weyde , Rajesh Mojumder

Learning how to automatically solve optimization problems has the potential to provide the next big leap in optimization technology. The performance of automatically learned heuristics on routing problems has been steadily improving in…

Artificial Intelligence · Computer Science 2020-12-01 André Hottung , Kevin Tierney

Prompt learning has become a prevalent strategy for adapting vision-language foundation models (VLMs) such as CLIP to downstream tasks. With the emergence of large language models (LLMs), recent studies have explored the potential of using…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Yubin Wang , Xinyang Jiang , De Cheng , Wenli Sun , Dongsheng Li , Cairong Zhao

Optimization is fundamental across numerous disciplines, typically following an iterative process of refining an initial solution to enhance performance. This principle is equally critical in prompt engineering, where designing effective…

Artificial Intelligence · Computer Science 2026-01-07 Dongyu Chen , Jian Ma , Xianpeng Zhang , Lei Zhang , Haonan Lu , Chen Chen , Chuangchuang Wang , Kai Tang

Recent advances in code generation have illuminated the potential of employing large language models (LLMs) for general-purpose programming languages such as Python and C++, opening new opportunities for automating software development and…

Machine Learning · Computer Science 2025-03-06 Jiahao Gai , Hao Mark Chen , Zhican Wang , Hongyu Zhou , Wanru Zhao , Nicholas Lane , Hongxiang Fan

Since the rise of Large Language Models (LLMs) a couple of years ago, researchers in metaheuristics (MHs) have wondered how to use their power in a beneficial way within their algorithms. This paper introduces a novel approach that…

Artificial Intelligence · Computer Science 2025-02-13 Camilo Chacón Sartori , Christian Blum , Filippo Bistaffa , Guillem Rodríguez Corominas

Recent advances in Large Language Models have led to remarkable achievements across a variety of Natural Language Processing tasks, making prompt engineering increasingly central to guiding model outputs. While manual methods can be…

Computation and Language · Computer Science 2025-07-15 Wendi Cui , Zhuohang Li , Hao Sun , Damien Lopez , Kamalika Das , Bradley A. Malin , Sricharan Kumar , Jiaxin Zhang

Congestion control is a fundamental component of Internet infrastructure, and researchers have dedicated considerable effort to developing improved congestion control algorithms. However, despite extensive study, existing algorithms…

Networking and Internet Architecture · Computer Science 2025-08-25 Zhiyuan He , Aashish Gottipati , Lili Qiu , Yuqing Yang , Francis Y. Yan

The current investigations on hyper-heuristics design have sprung up in two different flavours: heuristics that choose heuristics and heuristics that generate heuristics. In the latter, the goal is to develop a problem-domain independent…

Artificial Intelligence · Computer Science 2010-06-10 German Terrazas , Dario Landa-Silva , Natalio Krasnogor

While Large Language Models (LLMs) have recently shown promise in Automated Heuristic Design (AHD), existing approaches typically formulate AHD around constructive priority rules or parameterized local search guidance, thereby restricting…

Artificial Intelligence · Computer Science 2026-02-10 Baoyun Zhao , He Wang , Liang Zeng

Heuristic search is the dominant paradigm in symbolic AI planning, and the strongest heuristics are the result of decades of work by planning researchers. Recent work has shown that large language models (LLMs) can design heuristics for…

Artificial Intelligence · Computer Science 2026-05-29 Elliot Gestrin , Jendrik Seipp

Real-world path planning tasks typically involve multiple constraints beyond simple route optimization, such as the number of routes, maximum route length, depot locations, and task-specific requirements. Traditional approaches rely on…

Computation and Language · Computer Science 2026-03-23 Dylan Shim , Minghan Wei

Deploying large language model (LLM) inference at scale requires jointly selecting base models, provisioning heterogeneous GPUs, configuring parallelism, and distributing workloads under tight latency, accuracy, and budget constraints.…

Machine Learning · Computer Science 2026-04-10 Jiaming Cheng , Duong Tung Nguyen

This study introduces a novel hierarchical divisive clustering approach with stochastic splitting functions (SSFs) to enhance classification performance in multi-class datasets through hierarchical classification (HC). The method has the…

Machine Learning · Computer Science 2023-09-22 Celal Alagoz

The scaling of Large Language Models (LLMs) currently faces significant challenges. Model assembly is widely considered a promising solution to break through these performance bottlenecks. However, current ensembling methods are primarily…

Machine Learning · Computer Science 2025-07-08 Yanxin Liu , Yunqi Zhang

Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs,…

Numerical Analysis · Mathematics 2024-12-19 Matthias J. Ehrhardt , Zeljko Kereta , Jingwei Liang , Junqi Tang

Policy design for various systems controllers has conventionally been a manual process, with domain experts carefully tailoring heuristics for the specific instance in which the policy will be deployed. In this paper, we re-imagine policy…

Operating Systems · Computer Science 2025-10-13 Rohit Dwivedula , Divyanshu Saxena , Aditya Akella , Swarat Chaudhuri , Daehyeok Kim