English
Related papers

Related papers: Lookahead Acquisition Functions for Finite-Horizon…

200 papers

Bayesian Optimization (BO) is a principled framework for optimizing expensive black-box functions, with Expected Improvement (EI) among its most widely used acquisition functions. Despite its empirical success, EI is agnostic to first-order…

Machine Learning · Computer Science 2026-05-19 Joshua Hang Sai Ip , Georgios Makrygiorgos , Ali Mesbah

Two-stage stochastic programming often discretizes uncertainty into scenarios, but scenario enumeration makes expected recourse evaluation scale at least linearly in the scenario count. We propose qGAN-QAOA, a unified quantum-circuit…

Quantum Physics · Physics 2025-12-30 Taihei Kuroiwa , Daiki Yamazaki , Keita Takahashi , Kodai Shiba , Chih-Chieh Chen , Tomah Sogabe

We consider the Bayesian optimal filtering problem: i.e. estimating some conditional statistics of a latent time-series signal from an observation sequence. Classical approaches often rely on the use of assumed or estimated transition and…

Machine Learning · Statistics 2023-03-16 Adrian N. Bishop , Edwin V. Bonilla

The aim of black-box optimization is to optimize an objective function within the constraints of a given evaluation budget. In this problem, it is generally assumed that the computational cost for evaluating a point is large; thus, it is…

Machine Learning · Statistics 2019-12-03 Masahiro Nomura , Kenshi Abe

In this work, we study optimization specified only through a comparison oracle: given two points, it reports which one is preferred. We call it function-free optimization because we do not assume access to, nor the existence of, a canonical…

Optimization and Control · Mathematics 2026-05-20 Katya Scheinberg , Zikai Xiong

Quantum adiabatic optimization (QAO) is performed using a time-dependent Hamiltonian $H(s)$ with spectral gap $\gamma(s)$. Assuming the existence of an oracle $\Gamma$ such that $\gamma_\min = \Theta\left(\min_s\Gamma(s)\right)$, we provide…

Quantum Physics · Physics 2019-04-19 Michael Jarret , Brad Lackey , Aike Liu , Kianna Wan

Some of the most powerful reinforcement learning frameworks use planning for action selection. Interestingly, their planning horizon is either fixed or determined arbitrarily by the state visitation history. Here, we expand beyond the naive…

Machine Learning · Computer Science 2023-01-19 Aviv Rosenberg , Assaf Hallak , Shie Mannor , Gal Chechik , Gal Dalal

Bayesian optimization has been proposed as a practical and efficient tool through which to tune parameters in many difficult settings. Recently, such techniques have been combined with real-time fMRI to propose a novel framework which turns…

Neurons and Cognition · Quantitative Biology 2016-06-10 Romy Lorenz , Ricardo P Monti , Ines R Violante , Aldo A Faisal , Christoforos Anagnostopoulos , Robert Leech , Giovanni Montana

This paper studies a stochastic algorithm for linearly constrained nonconvex optimization, where the objective function is smooth but only unbiased stochastic gradients with bounded variance are available. We propose a momentum-based…

Optimization and Control · Mathematics 2026-04-16 Chenyang Qiu , Mihitha Maithripala , Zongli Lin

We consider a class of finite time horizon nonlinear stochastic optimal control problem, where the control acts additively on the dynamics and the control cost is quadratic. This framework is flexible and has found applications in many…

Optimization and Control · Mathematics 2023-04-26 Ajay Jasra , Jeremy Heng , Yaxian Xu , Adrian N. Bishop

This paper proposes a novel global optimization algorithm, Particle Filter-Based Optimization (PFO), designed for a class of stochastic optimization problems in which the objective function lacks an analytical form and is subject to noisy…

Optimization and Control · Mathematics 2025-06-23 Mostafa Eslami , Maryam Babazadeh

Bayesian optimization has emerged as a strong candidate tool for global optimization of functions with expensive evaluation costs. However, due to the dynamic nature of research in Bayesian approaches, and the evolution of computing…

Applications · Statistics 2018-08-24 Ran Rubin

Black-box problems are common in real life like structural design, drug experiments, and machine learning. When optimizing black-box systems, decision-makers always consider multiple performances and give the final decision by comprehensive…

Machine Learning · Computer Science 2021-01-22 Wenjie Chen , Shengcai Liu , Ke Tang

We provide several quantum algorithms for continuous optimization that do not require gradient estimation. Instead, we encode the optimization problem into the dynamics of a physical system and coherently simulate the time evolution. We…

Quantum Physics · Physics 2026-03-18 Ahmet Burak Catli , Sophia Simon , Nathan Wiebe

Preferential Bayesian optimization (PBO) is a framework for optimizing a decision maker's latent utility function using preference feedback. This work introduces the expected utility of the best option (qEUBO) as a novel acquisition…

Machine Learning · Computer Science 2023-03-29 Raul Astudillo , Zhiyuan Jerry Lin , Eytan Bakshy , Peter I. Frazier

Many cosmological models have only a finite number of parameters of interest, but a very expensive data-generating process and an intractable likelihood function. We address the problem of performing likelihood-free Bayesian inference from…

Cosmology and Nongalactic Astrophysics · Physics 2018-09-14 Florent Leclercq

Bayesian optimization has emerged as a prominent methodology for optimizing expensive black-box functions by leveraging Gaussian process surrogates, which focus on capturing the global characteristics of the objective function. However, in…

Machine Learning · Computer Science 2026-03-03 Qiyu Wei , Haowei Wang , Richard Allmendinger , Mauricio A. Álvarez

Bayesian optimisation is a popular approach for optimising expensive black-box functions. The next location to be evaluated is selected via maximising an acquisition function that balances exploitation and exploration. Gaussian processes,…

Machine Learning · Computer Science 2020-05-11 George De Ath , Jonathan E. Fieldsend , Richard M. Everson

Model-based sequential approaches to discrete "black-box" optimization, including Bayesian optimization techniques, often access the same points multiple times for a given objective function in interest, resulting in many steps to find the…

Machine Learning · Computer Science 2023-12-29 Keisuke Morita , Yoshihiko Nishikawa , Masayuki Ohzeki

We provide a unifying approximate dynamic programming framework that applies to a broad variety of problems involving sequential estimation. We consider first the construction of surrogate cost functions for the purposes of optimization,…

Artificial Intelligence · Computer Science 2023-01-02 Dimitri Bertsekas