English
Related papers

Related papers: Simulation-guided Beam Search for Neural Combinato…

200 papers

Sequential robot manipulation tasks require finding collision-free trajectories that satisfy geometric constraints across multiple object interactions in potentially high-dimensional configuration spaces. Solving these problems in real-time…

Robotics · Computer Science 2025-10-14 Lucas Chen , Shrutheesh Raman Iyer , Zachary Kingston

Effective general-purpose search strategies are an important component in Constraint Programming. We introduce a new idea, namely, using correlations between variables to guide search. Variable correlations are measured and maintained by…

Artificial Intelligence · Computer Science 2018-05-25 Ruiwei Wang , Wei Xia , Roland H. C. Yap

In this work we explore the combination of metaheuristics and learned neural network solvers for combinatorial optimization. We do this in the context of the transit network design problem, a uniquely challenging combinatorial optimization…

Neural and Evolutionary Computing · Computer Science 2023-06-02 Andrew Holliday , Gregory Dudek

Breaking down a problem into intermediate steps has demonstrated impressive performance in Large Language Model (LLM) reasoning. However, the growth of the reasoning chain introduces uncertainty and error accumulation, making it challenging…

Computation and Language · Computer Science 2023-10-27 Yuxi Xie , Kenji Kawaguchi , Yiran Zhao , Xu Zhao , Min-Yen Kan , Junxian He , Qizhe Xie

Existing high-dimensional Bayesian optimization (BO) methods aim to overcome the curse of dimensionality by carefully encoding structural assumptions, from locality to sparsity to smoothness, into the optimization procedure. Surprisingly,…

Machine Learning · Computer Science 2026-04-10 Colin Doumont , Donney Fan , Natalie Maus , Jacob R. Gardner , Henry Moss , Geoff Pleiss

When solving real-world problems, practitioners often hesitate to implement solutions obtained from mathematical models, especially for important decisions. This hesitation stems from practitioners' lack of trust in optimization models and…

Optimization and Control · Mathematics 2025-07-01 Susumu Hashimoto , Takeaki Uno

This research paper presents a novel approach to enhance optimization performance through the hybridization of Gaussian Crunching Search (GCS) and Powell's Method for derivative-free optimization. While GCS has shown promise in overcoming…

Optimization and Control · Mathematics 2023-08-10 Benny Wong

Local search is an effective method for solving large-scale combinatorial optimization problems, and it has made remarkable progress in recent years through several subtle mechanisms. In this paper, we found two ways to improve the local…

Artificial Intelligence · Computer Science 2023-06-30 Luyu Jiang , Dantong Ouyang , Qi Zhang , Liming Zhang

Bayesian optimization (BO) algorithms form a class of surrogate-based heuristics, aimed at efficiently computing high-quality solutions for numerical black-box optimization problems. The BO pipeline is highly modular, with different design…

Machine Learning · Computer Science 2022-11-18 Carolin Benjamins , Anja Jankovic , Elena Raponi , Koen van der Blom , Marius Lindauer , Carola Doerr

As we approach the physical limits predicted by Moore's law, a variety of specialized hardware is emerging to tackle specialized tasks in different domains. Within combinatorial optimization, adiabatic quantum computers, CMOS annealers, and…

Data Structures and Algorithms · Computer Science 2020-12-01 Xiaoyuan Liu , Hayato Ushijima-Mwesigwa , Avradip Mandal , Sarvagya Upadhyay , Ilya Safro , Arnab Roy

Nowadays, we are immersed in tens of newly-proposed evolutionary and swam-intelligence metaheuristics, which makes it very difficult to choose a proper one to be applied on a specific optimization problem at hand. On the other hand, most of…

Neural and Evolutionary Computing · Computer Science 2020-01-27 Hamid Reza Boveiri , Raouf Khayami

Search has been proposed as an effective method for self-improving language models and agentic systems, both for post-training sample generation and for inference. However, widely used methods such as best-of-N sampling and tree search face…

Computation and Language · Computer Science 2026-05-28 Guowei Xu , Zhenting Qi , Huangyuan Su , Weirui Ye , Himabindu Lakkaraju , Sham M. Kakade , Yilun Du

This work considers infinite-horizon optimal control of positive linear systems applied to the case of network routing problems. We demonstrate the equivalence between Stochastic Shortest Path (SSP) problems and optimal control of a certain…

Optimization and Control · Mathematics 2026-02-17 David Ohlin , Anders Rantzer , Emma Tegling

Branch-and-bound is a systematic enumerative method for combinatorial optimization, where the performance highly relies on the variable selection strategy. State-of-the-art handcrafted heuristic strategies suffer from relatively slow…

Machine Learning · Computer Science 2022-06-15 Tianyu Zhang , Amin Banitalebi-Dehkordi , Yong Zhang

Bayesian Optimisation (BO) refers to a class of methods for global optimisation of a function $f$ which is only accessible via point evaluations. It is typically used in settings where $f$ is expensive to evaluate. A common use case for BO…

Machine Learning · Computer Science 2019-03-19 Kirthevasan Kandasamy , Willie Neiswanger , Jeff Schneider , Barnabas Poczos , Eric Xing

The rapid advancement of GPU technology has unlocked powerful parallel processing capabilities, creating new opportunities to enhance classic search algorithms. This hardware has been exploited in best-first search algorithms with neural…

Artificial Intelligence · Computer Science 2025-11-18 Ehsan Futuhi , Nathan R. Sturtevant

This article explores the integration of deep learning models into combinatorial optimization pipelines, specifically targeting NP-hard problems. Traditional exact algorithms for such problems often rely on heuristic criteria to guide the…

Machine Learning · Computer Science 2026-04-28 Lorenzo Sciandra , Roberto Esposito , Andrea Cesare Grosso , Laura Sacerdote , Cristina Zucca

Symbolic regression aims to discover human-interpretable equations that explain observational data. However, existing approaches rely heavily on discrete structure search (e.g., genetic programming), which often leads to high computational…

Machine Learning · Computer Science 2026-03-25 Fateme Memar , Tao Zhe , Dongjie Wang

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment.…

Machine Learning · Computer Science 2023-09-15 Mohamed Aziz Bhouri , Michael Joly , Robert Yu , Soumalya Sarkar , Paris Perdikaris

In safety-critical systems (e.g., autonomous vehicles and robots), Deep Neural Networks (DNNs) are becoming a key component for computer vision tasks, particularly semantic segmentation. Further, since the DNN behavior cannot be assessed…

Software Engineering · Computer Science 2025-03-21 Mohammed Oualid Attaoui , Fabrizio Pastore , Lionel Briand