English
Related papers

Related papers: Predictive Entropy Search for Efficient Global Opt…

200 papers

Snapshot back-ended reduced basis methods for dynamical systems commonly rely on the singular value decomposition of a matrix whose columns are high-fidelity solution vectors. An alternative basis generation framework is developed here. The…

Numerical Analysis · Mathematics 2020-05-05 Fotios Kasolis , Markus Clemens

We developed a new method PROTES for black-box optimization, which is based on the probabilistic sampling from a probability density function given in the low-parametric tensor train format. We tested it on complex multidimensional arrays…

Numerical Analysis · Mathematics 2023-05-23 Anastasia Batsheva , Andrei Chertkov , Gleb Ryzhakov , Ivan Oseledets

Contextual policy search allows adapting robotic movement primitives to different situations. For instance, a locomotion primitive might be adapted to different terrain inclinations or desired walking speeds. Such an adaptation is often…

Machine Learning · Statistics 2015-11-17 Jan Hendrik Metzen

This paper addresses the estimation of parameters of a Bayesian network from incomplete data. The task is usually tackled by running the Expectation-Maximization (EM) algorithm several times in order to obtain a high log-likelihood…

Machine Learning · Computer Science 2015-03-19 Giorgio Corani , Cassio P. De Campos

We present MESMOC+, an improved version of Max-value Entropy search for Multi-Objective Bayesian optimization with Constraints (MESMOC). MESMOC+ can be used to solve constrained multi-objective problems when the objectives and the…

We develop the framework of Indirect Query Bayesian Optimization (IQBO), a new class of Bayesian optimization problems where the integrated feedback is given via a conditional expectation of the unknown function $f$ to be optimized. The…

Machine Learning · Computer Science 2025-08-14 Mengyan Zhang , Shahine Bouabid , Cheng Soon Ong , Seth Flaxman , Dino Sejdinovic

Bayesian Optimization has become the reference method for the global optimization of black box, expensive and possibly noisy functions. Bayesian Op-timization learns a probabilistic model about the objective function, usually a Gaussian…

Machine Learning · Statistics 2020-03-10 Antonio Candelieri , Ilaria Giordani , Riccardo Perego , Francesco Archetti

Probabilistic reasoning systems combine different probabilistic rules and probabilistic facts to arrive at the desired probability values of consequences. In this paper we describe the MESA-algorithm (Maximum Entropy by Simulated Annealing)…

Artificial Intelligence · Computer Science 2013-03-25 Gerhard Paaß

Estimation of permutation entropy (PE) using Bayesian statistical methods is presented for systems where the ordinal pattern sampling follows an independent, multinomial distribution. It is demonstrated that the PE posterior distribution is…

Data Analysis, Statistics and Probability · Physics 2022-02-09 Douglas J. Little , Joshua P. Toomey , Deb M. Kane

In this work we introduce PHOENICS, a probabilistic global optimization algorithm combining ideas from Bayesian optimization with concepts from Bayesian kernel density estimation. We propose an inexpensive acquisition function balancing the…

Machine Learning · Statistics 2018-01-08 Florian Häse , Loïc M. Roch , Christoph Kreisbeck , Alán Aspuru-Guzik

Scientific experiments are usually expensive due to complex experimental preparation and processing. Experimental design is therefore involved with the task of finding the optimal experimental input that results in the desirable output by…

Machine Learning · Statistics 2020-02-27 Cheng Li , Sunil Gupta , Santu Rana , Vu Nguyen , Antonio Robles-Kelly , Svetha Venkatesh

Bayesian Optimization is a popular approach for optimizing expensive black-box functions. Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential…

Machine Learning · Statistics 2025-02-05 Haoxian Chen , Henry Lam

Bayesian optimization (BO) is a successful methodology to optimize black-box functions that are expensive to evaluate. While traditional methods optimize each black-box function in isolation, there has been recent interest in speeding up BO…

Machine Learning · Statistics 2019-09-30 Valerio Perrone , Huibin Shen , Matthias Seeger , Cedric Archambeau , Rodolphe Jenatton

We consider the problem of global optimization of a function f from very noisy evaluations. We adopt a Bayesian sequential approach: evaluation points are chosen so as to reduce the uncertainty about the position of the global optimum of f,…

To handle with inverse problems, two probabilistic approaches have been proposed: the maximum entropy on the mean (MEM) and the Bayesian estimation (BAYES). The main object of this presentation is to compare these two approaches which are…

Data Analysis, Statistics and Probability · Physics 2007-05-23 A. Mohammad-Djafari

In practice, the parameters of control policies are often tuned manually. This is time-consuming and frustrating. Reinforcement learning is a promising alternative that aims to automate this process, yet often requires too many experiments…

We propose a practical Bayesian optimization method over sets, to minimize a black-box function that takes a set as a single input. Because set inputs are permutation-invariant, traditional Gaussian process-based Bayesian optimization…

Machine Learning · Statistics 2021-01-26 Jungtaek Kim , Michael McCourt , Tackgeun You , Saehoon Kim , Seungjin Choi

This paper solves a new class of optimization problems under uncertainty, called Probable Event Constrained Optimization (PECO), which optimizes an objective function of decision variables and subjects to a set of Probable Event Constraints…

Optimization and Control · Mathematics 2025-03-07 Qifeng Li

Efficient feature selection from high-dimensional datasets is a very important challenge in many data-driven fields of science and engineering. We introduce a statistical mechanics inspired strategy that addresses the problem of sparse…

Machine Learning · Statistics 2021-04-07 Alfredo Braunstein , Thomas Gueudré , Andrea Pagnani , Mirko Pieropan

We propose an algorithm for Bayesian functional optimisation - that is, finding the function to optimise a process - guided by experimenter beliefs and intuitions regarding the expected characteristics (length-scale, smoothness, cyclicity…

Machine Learning · Computer Science 2020-09-09 Alistair Shilton , Sunil Gupta , Santu Rana , Svetha Venkatesh
‹ Prev 1 3 4 5 6 7 10 Next ›