English
Related papers

Related papers: Towards Practical Preferential Bayesian Optimizati…

200 papers

Gaussian processes (GPs) are distributions over functions, which provide a Bayesian nonparametric approach to regression and classification. In spite of their success, GPs have limited use in some applications, for example, in some cases a…

Machine Learning · Computer Science 2020-05-28 Alessio Benavoli , Dario Azzimonti , Dario Piga

The use of Gaussian processes (GPs) is supported by efficient sampling algorithms, a rich methodological literature, and strong theoretical grounding. However, due to their prohibitive computation and storage demands, the use of exact GPs…

Statistics Theory · Mathematics 2022-07-27 Kelly R. Moran , Matthew W. Wheeler

In the context of Bayesian inversion for scientific and engineering modeling, Markov chain Monte Carlo sampling strategies are the benchmark due to their flexibility and robustness in dealing with arbitrary posterior probability density…

Computation · Statistics 2021-12-07 Han Lu , Mohammad Khalil , Thomas Catanach , Jiefu Chen , Xuqing Wu , Xin Fu , Cosmin Safta , Yueqin Huang

Approximate Bayesian computation (ABC) can be used for model fitting when the likelihood function is intractable but simulating from the model is feasible. However, even a single evaluation of a complex model may take several hours,…

Machine Learning · Statistics 2018-02-19 Marko Järvenpää , Michael Gutmann , Aki Vehtari , Pekka Marttinen

We study the calibration of Gaussian process (GP) predictive distributions in the interpolation setting from a design-marginal perspective. Conditioning on the data and averaging over a design measure \mu, we formalize \mu-coverage for…

Machine Learning · Statistics 2025-12-08 Aurélien Pion , Emmanuel Vazquez

Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations. It relies on querying a distribution over functions defined by a relatively cheap surrogate model. An accurate model for…

An efficient method for finding a better maximizer of computationally extensive probability distributions is proposed on the basis of a Bayesian optimization technique. A key idea of the proposed method is to use extreme values of…

Data Analysis, Statistics and Probability · Physics 2018-03-14 Ryo Tamura , Koji Hukushima

The PC algorithm is a popular method for learning the structure of Gaussian Bayesian networks. It carries out statistical tests to determine absent edges in the network. It is hence governed by two parameters: (i) The type of test, and (ii)…

Bayesian Optimization (BO) is a widely used approach for blackbox optimization that leverages a Gaussian process (GP) model and an acquisition function to guide future sampling. While effective in low-dimensional settings, BO faces…

Machine Learning · Computer Science 2025-11-26 Pavankumar Koratikere , Leifur Leifsson

Bayesian optimization (BO) is a widely used framework for optimizing expensive black-box functions, commonly based on Gaussian process (GP) surrogate models. Its effectiveness relies on uncertainty quantification that is both sharp…

Machine Learning · Computer Science 2026-05-12 Marshal Arijona Sinaga , Julien Martinelli , Teemu Turpeinen , Samuel Kaski

The popularity of Bayesian Optimization (BO) to automate or support the commissioning of engineering systems is rising. Conventional BO, however, relies on the availability of a scalar objective function. The latter is often difficult to…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Sander De Witte , Jeroen Taets , Andras Retzler , Guillaume Crevecoeur , Tom Lefebvre

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

Machine Learning · Computer Science 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

Gaussian process (GP) regression has been widely used in supervised machine learning due to its flexibility and inherent ability to describe uncertainty in function estimation. In the context of control, it is seeing increasing use for…

Systems and Control · Computer Science 2020-01-01 Lukas Hewing , Juraj Kabzan , Melanie N. Zeilinger

Information theoretic active learning has been widely studied for probabilistic models. For simple regression an optimal myopic policy is easily tractable. However, for other tasks and with more complex models, such as classification with…

Machine Learning · Statistics 2011-12-30 Neil Houlsby , Ferenc Huszár , Zoubin Ghahramani , Máté Lengyel

Bayesian Optimal Experimental Design (BOED) is a powerful tool to reduce the cost of running a sequence of experiments. When based on the Expected Information Gain (EIG), design optimization corresponds to the maximization of some…

Machine Learning · Statistics 2025-03-14 Jacopo Iollo , Christophe Heinkelé , Pierre Alliez , Florence Forbes

Varying coefficient models (VCMs) are widely used for estimating nonlinear regression functions for functional data. Their Bayesian variants using Gaussian process priors on the functional coefficients, however, have received limited…

Methodology · Statistics 2022-03-01 Rajarshi Guhaniyogi , Cheng Li , Terrance D. Savitsky , Sanvesh Srivastava

This paper addresses the problem of constrained multi-objective optimization over black-box objective functions with practitioner-specified preferences over the objectives when a large fraction of the input space is infeasible (i.e.,…

Machine Learning · Computer Science 2023-03-24 Alaleh Ahmadianshalchi , Syrine Belakaria , Janardhan Rao Doppa

Gaussian Process based Bayesian Optimization is a widely applied algorithm to learn and optimize under uncertainty, well-known for its sample efficiency. However, recently -- and more frequently -- research studies have empirically…

Machine Learning · Statistics 2025-05-20 Antonio Candelieri , Andrea Ponti , Francesco Archetti

Approximate Bayesian computation methods are useful for generative models with intractable likelihoods. These methods are however sensitive to the dimension of the parameter space, requiring exponentially increasing resources as this…

Computation · Statistics 2026-02-09 Grégoire Clarté , Christian P. Robert , Robin Ryder , Julien Stoehr

In the field of machine learning (ML) for materials optimization, active learning algorithms, such as Bayesian Optimization (BO), have been leveraged for guiding autonomous and high-throughput experimentation systems. However, very few…

‹ Prev 1 4 5 6 7 8 10 Next ›