English
Related papers

Related papers: Complex LLM Planning via Automated Heuristics Disc…

200 papers

Automated planning remains one of the most general paradigms in Artificial Intelligence, providing means of solving problems coming from a wide variety of domains. One of the key factors restricting the applicability of planning is its…

Artificial Intelligence · Computer Science 2017-07-24 Pawel Gomoluch , Dalal Alrajeh , Alessandra Russo , Antonio Bucchiarone

We posit that we can generate more robust and performant heuristics if we augment approaches using LLMs for heuristic design with tools that explain why heuristics underperform and suggestions about how to fix them. We find even simple…

Artificial Intelligence · Computer Science 2025-10-13 Pantea Karimi , Dany Rouhana , Pooria Namyar , Siva Kesava Reddy Kakarla , Venkat Arun , Behnaz Arzani

Planning represents a fundamental capability of intelligent agents, requiring comprehensive environmental understanding, rigorous logical reasoning, and effective sequential decision-making. While Large Language Models (LLMs) have…

Artificial Intelligence · Computer Science 2025-05-27 Pengfei Cao , Tianyi Men , Wencan Liu , Jingwen Zhang , Xuzhao Li , Xixun Lin , Dianbo Sui , Yanan Cao , Kang Liu , Jun Zhao

While logical reasoning evaluation of Large Language Models (LLMs) has attracted significant attention, existing benchmarks predominantly rely on multiple-choice formats that are vulnerable to random guessing, leading to overestimated…

Computation and Language · Computer Science 2025-02-25 Qin Zhu , Fei Huang , Runyu Peng , Keming Lu , Bowen Yu , Qinyuan Cheng , Xipeng Qiu , Xuanjing Huang , Junyang Lin

Equation discovery is aimed at directly extracting physical laws from data and has emerged as a pivotal research domain. Previous methods based on symbolic mathematics have achieved substantial advancements, but often require the design of…

Machine Learning · Computer Science 2024-07-23 Mengge Du , Yuntian Chen , Zhongzheng Wang , Longfeng Nie , Dongxiao Zhang

This paper presents AutoHint, a novel framework for automatic prompt engineering and optimization for Large Language Models (LLM). While LLMs have demonstrated remarkable ability in achieving high-quality annotation in various tasks, the…

Computation and Language · Computer Science 2023-08-10 Hong Sun , Xue Li , Yinchuan Xu , Youkow Homma , Qi Cao , Min Wu , Jian Jiao , Denis Charles

Large Language Models (LLMs) have demonstrated impressive planning abilities due to their vast "world knowledge". Yet, obtaining plans that are both feasible (grounded in affordances) and cost-effective (in plan length), remains a…

Artificial Intelligence · Computer Science 2024-01-03 Rishi Hazra , Pedro Zuidberg Dos Martires , Luc De Raedt

Inductive reasoning is a core problem-solving capacity: humans can identify underlying principles from a few examples, which robustly generalize to novel scenarios. Recent work evaluates large language models (LLMs) on inductive reasoning…

Machine Learning · Computer Science 2024-06-03 Ruocheng Wang , Eric Zelikman , Gabriel Poesia , Yewen Pu , Nick Haber , Noah D. Goodman

Large Language Models (LLMs) have the potential to automate reward engineering by leveraging their broad domain knowledge across various tasks. However, they often need many iterations of trial-and-error to generate effective reward…

Machine Learning · Computer Science 2024-10-28 Vishnu Sarukkai , Brennan Shacklett , Zander Majercik , Kush Bhatia , Christopher Ré , Kayvon Fatahalian

Network operation relies on heuristics to solve many tasks rapidly and efficiently across the protocol stack. These heuristics are the result of thorough human-driven design rooted in expert knowledge of the target system and problem.…

Networking and Internet Architecture · Computer Science 2026-05-28 Reza Namvar , José Gallego , Jose A. Ayala-Romero , Livia Elena Chatzieleftheriou , Andres Garcia-Saavedra , Albert Banchs , Marco Fiore

Planning is a fundamental task in artificial intelligence that involves finding a sequence of actions that achieve a specified goal in a given environment. Large language models (LLMs) are increasingly used for applications that require…

Computation and Language · Computer Science 2024-05-24 Eran Hirsch , Guy Uziel , Ateret Anaby-Tavor

While Large Language Models (LLM) enable non-experts to specify open-world multi-robot tasks, the generated plans often lack kinematic feasibility and are not efficient, especially in long-horizon scenarios. Formal methods like Linear…

Robotics · Computer Science 2026-02-11 Shuyuan Hu , Tao Lin , Kai Ye , Yang Yang , Tianwei Zhang

Recent large language models (LLMs) are promising for making decisions in grounded environments. However, LLMs frequently fail in complex decision-making tasks due to the misalignment between the pre-trained knowledge in LLMs and the actual…

Computation and Language · Computer Science 2023-10-27 Siqi Ouyang , Lei Li

Policy design for various systems controllers has conventionally been a manual process, with domain experts carefully tailoring heuristics for the specific instance in which the policy will be deployed. In this paper, we re-imagine policy…

Operating Systems · Computer Science 2025-10-13 Rohit Dwivedula , Divyanshu Saxena , Aditya Akella , Swarat Chaudhuri , Daehyeok Kim

The Capacitated Vehicle Routing Problem (CVRP), a fundamental combinatorial optimization challenge, focuses on optimizing fleet operations under vehicle capacity constraints. While extensively studied in operational research, the NP-hard…

Artificial Intelligence · Computer Science 2026-02-27 Zhuoliang Xie , Fei Liu , Zhenkun Wang , Qingfu Zhang

Metaheuristic search methods have proven to be essential tools for tackling complex optimization challenges, but their full potential is often constrained by conventional algorithmic frameworks. In this paper, we introduce a novel approach…

Artificial Intelligence · Computer Science 2024-10-23 Abdel-Rahman Hedar , Alaa E. Abdel-Hakim , Wael Deabes , Youseef Alotaibi , Kheir Eddine Bouazza

Combining Large Language Models (LLMs) with heuristic search algorithms like A* holds the promise of enhanced LLM reasoning and scalable inference. To accelerate training and reduce computational demands, we investigate the coreset…

Artificial Intelligence · Computer Science 2024-10-25 Devaansh Gupta , Boyang Li

Combinatorial optimization problems are traditionally tackled with handcrafted heuristic algorithms, which demand extensive domain expertise and significant implementation effort. Recent progress has highlighted the potential of automatic…

Artificial Intelligence · Computer Science 2025-10-01 Yihong Liu , Junyi Li , Wayne Xin Zhao , Hongyu Lu , Ji-Rong Wen

Heuristics are commonly used to tackle various search and optimization problems. Design heuristics usually require tedious manual crafting with domain knowledge. Recent works have incorporated Large Language Models (LLMs) into automatic…

Artificial Intelligence · Computer Science 2025-02-05 Shunyu Yao , Fei Liu , Xi Lin , Zhichao Lu , Zhenkun Wang , Qingfu Zhang

Reliable task planning is pivotal for achieving long-horizon autonomy in real-world robotic systems. Large language models (LLMs) offer a promising interface for translating complex and ambiguous natural language instructions into…

Robotics · Computer Science 2025-09-16 Junfeng Tang , Yuping Yan , Zihan Ye , Zhenshou , Song , Zeqi Zheng , Yaochu Jin