English
Related papers

Related papers: DeciLS-PBO: an Effective Local Search Method for P…

200 papers

Bayesian optimization is a class of data efficient model based algorithms typically focused on global optimization. We consider the more general case where a user is faced with multiple problems that each need to be optimized conditional on…

Machine Learning · Statistics 2020-11-04 Michael Pearce , Janis Klaise , Matthew Groves

In discrete-variable black-box optimization, the number of candidate solutions grows combinatorially, while each evaluation is often expensive. Therefore, it is important to identify promising solutions efficiently within a limited number…

Quantum Physics · Physics 2026-05-12 Reo Shikanai , Masayuki Ohzeki

Black-box optimization is a powerful approach for discovering global optima in noisy and expensive black-box functions, a problem widely encountered in real-world scenarios. Recently, there has been a growing interest in leveraging domain…

Machine Learning · Computer Science 2024-02-06 Dat Phan-Trong , Hung The Tran , Alistair Shilton , Sunil Gupta

The high cost and data scarcity in scientific exploration have motivated the use of large language models (LLMs) as knowledge-driven components in Bayesian optimization (BO). However, existing approaches typically embed LLMs directly into…

Bayesian optimization (BO) is a successful methodology to optimize black-box functions that are expensive to evaluate. While traditional methods optimize each black-box function in isolation, there has been recent interest in speeding up BO…

Machine Learning · Statistics 2019-09-30 Valerio Perrone , Huibin Shen , Matthias Seeger , Cedric Archambeau , Rodolphe Jenatton

This paper introduces a local search method for improving an existing program with respect to a measurable objective. Program Optimization with Locally Improving Search (POLIS) exploits the structure of a program, defined by its lines.…

Software Engineering · Computer Science 2023-07-13 Fatemeh Abdollahi , Saqib Ameen , Matthew E. Taylor , Levi H. S. Lelis

The Boolean satisfiability problem (SAT) is a famous NP-complete problem in computer science. An effective way for solving a satisfiable SAT problem is the stochastic local search (SLS). However, in this method, the initialization is…

Artificial Intelligence · Computer Science 2020-12-10 Wenjie Zhang , Zeyu Sun , Qihao Zhu , Ge Li , Shaowei Cai , Yingfei Xiong , Lu Zhang

This work focuses on improving state-of-the-art in stochastic local search (SLS) for solving Boolean satisfiability (SAT) instances arising from real-world industrial SAT application domains. The recently introduced SLS method CRSat has…

Artificial Intelligence · Computer Science 2011-09-12 Anton Belov , Matti Järvisalo

Bayesian Optimization (BO) is an effective method for finding the global optimum of expensive black-box functions. However, it is well known that applying BO to high-dimensional optimization problems is challenging. To address this issue, a…

Machine Learning · Statistics 2024-02-06 Lam Ngo , Huong Ha , Jeffrey Chan , Vu Nguyen , Hongyu Zhang

This paper presents a novel Differential Evolution algorithm for protein folding optimization that is applied to a three-dimensional AB off-lattice model. The proposed algorithm includes two new mechanisms. A local search is used to improve…

Artificial Intelligence · Computer Science 2018-05-08 Borko Bošković , Janez Brest

Decentralized swarm robotic solutions to searching for targets that emit a spatially varying signal promise task parallelism, time efficiency, and fault tolerance. It is, however, challenging for swarm algorithms to offer scalability and…

Multiagent Systems · Computer Science 2019-07-11 Payam Ghassemi , Souma Chowdhury

We present a novel method called TESALOCS (TEnsor SAmpling and LOCal Search) for multidimensional optimization, combining the strengths of gradient-free discrete methods and gradient-based approaches. The discrete optimization in our method…

Optimization and Control · Mathematics 2025-05-20 Konstantin Sozykin , Andrei Chertkov , Anh-Huy Phan , Ivan Oseledets , Gleb Ryzhakov

The adoption of high-fidelity models for many-query optimization problems is majorly limited by the significant computational cost required for their evaluation at every query. Multifidelity Bayesian methods (MFBO) allow to include costly…

Machine Learning · Computer Science 2024-07-08 Francesco Di Fiore , Laura Mainini

In this paper we discuss Grover Adaptive Search (GAS) for Constrained Polynomial Binary Optimization (CPBO) problems, and in particular, Quadratic Unconstrained Binary Optimization (QUBO) problems, as a special case. GAS can provide a…

Quantum Physics · Physics 2021-06-08 Austin Gilliam , Stefan Woerner , Constantin Gonciulea

Pareto Local Search (PLS) is a basic building block in many metaheuristics for Multiobjective Combinatorial Optimization Problem (MCOP). In this paper, an enhanced PLS variant called Parallel Pareto Local Search based on Decomposition…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-12 Jialong Shi , Qingfu Zhang , Jianyong Sun

Identifying optimal designs for generalized linear models with a binary response can be a challenging task, especially when there are both continuous and discrete independent factors in the model. Theoretical results rarely exist for such…

Applications · Statistics 2016-02-09 Joshua Lukemire , Abhyuday Mandal , Weng Kee Wong

Bayesian optimization (BO) for high-dimensional constrained problems remains a significant challenge due to the curse of dimensionality. We propose Local Constrained Bayesian Optimization (LCBO), a novel framework tailored for such…

Machine Learning · Statistics 2026-03-10 Jing Jingzhe , Fan Zheyi , Szu Hui Ng , Qingpei Hu

We look into the task of \emph{generalizing} word embeddings: given a set of pre-trained word vectors over a finite vocabulary, the goal is to predict embedding vectors for out-of-vocabulary words, \emph{without} extra contextual…

Computation and Language · Computer Science 2020-10-22 Zhao Jinman , Shawn Zhong , Xiaomin Zhang , Yingyu Liang

Gaussian process (GP) model based optimization is widely applied in simulation and machine learning. In general, it first estimates a GP model based on a few observations from the true response and then employs this model to guide the…

Machine Learning · Statistics 2021-07-08 Qun Meng , Songhao Wang , Szu Hui Ng

Large Neighborhood Search (LNS) is a common heuristic in combinatorial optimization that iteratively searches over a large neighborhood of the current solution for a better one. Recently, neural network-based LNS solvers have achieved great…

Machine Learning · Computer Science 2025-08-25 Shengyu Feng , Zhiqing Sun , Yiming Yang