中文
相关论文

相关论文: Robust Bayesian Optimization with Student-t Likeli…

200 篇论文

Bayesian optimization (BO) is a widely used iterative black-box optimization method that utilizes Gaussian process (GP) surrogate models. In practice, BO is typically terminated after a fixed evaluation budget is exhausted, which can incur…

机器学习 · 计算机科学 2026-05-22 Haowei Wang , Jingyi Wang , Qiyu Wei

Posterior sampling for high-dimensional Bayesian inverse problems is a common challenge in real-world applications. Randomized Maximum Likelihood (RML) is an optimization based methodology that gives samples from an approximation to the…

统计计算 · 统计学 2024-09-05 Valentin Breaz , Richard Wilkinson

Bayesian optimization (BO) is a powerful approach for seeking the global optimum of expensive black-box functions and has proven successful for fine tuning hyper-parameters of machine learning models. However, BO is practically limited to…

机器学习 · 统计学 2020-09-28 Riccardo Moriconi , Marc P. Deisenroth , K. S. Sesh Kumar

Bayesian Optimisation (BO) refers to a suite of techniques for global optimisation of expensive black box functions, which use introspective Bayesian models of the function to efficiently search for the optimum. While BO has been applied…

Principal component regression uses principal components as regressors. It is particularly useful in prediction settings with high-dimensional covariates. The existing literature treating of Bayesian approaches is relatively sparse. We…

统计方法学 · 统计学 2020-01-28 Philippe Gagnon , Mylène Bédard , Alain Desgagné

As an automatic method of determining model complexity using the training data alone, Bayesian linear regression provides us a principled way to select hyperparameters. But one often needs approximation inference if distribution assumption…

机器学习 · 计算机科学 2016-04-18 Chaobing Song , Shu-Tao Xia

Bayesian optimization (BO) has proven to be an effective paradigm for the global optimization of expensive-to-sample systems. One of the main advantages of BO is its use of Gaussian processes (GPs) to characterize model uncertainty which…

机器学习 · 统计学 2023-11-30 Leonardo D. González , Victor M. Zavala

Solving inverse problems using Bayesian methods can become prohibitively expensive when likelihood evaluations involve complex and large scale numerical models. A common approach to circumvent this issue is to approximate the forward model…

计算工程、金融与科学 · 计算机科学 2023-12-14 Maximilian Dinkel , Carolin M. Geitner , Gil Robalo Rei , Jonas Nitzler , Wolfgang A. Wall

Bayesian optimization has recently emerged as a popular method for the sample-efficient optimization of expensive black-box functions. However, the application to high-dimensional problems with several thousand observations remains…

机器学习 · 计算机科学 2020-02-26 David Eriksson , Michael Pearce , Jacob R Gardner , Ryan Turner , Matthias Poloczek

Bayesian optimisation is a popular, surrogate model-based approach for optimising expensive black-box functions. Given a surrogate model, the next location to expensively evaluate is chosen via maximisation of a cheap-to-query acquisition…

机器学习 · 计算机科学 2020-03-31 George De Ath , Richard M. Everson , Jonathan E. Fieldsend , Alma A. M. Rahat

Bayesian optimization (BO) is one of the most powerful strategies to solve computationally expensive-to-evaluate blackbox optimization problems. However, BO methods are conventionally used for optimization problems of small dimension…

最优化与控制 · 数学 2025-02-10 Rémy Priem , Youssef Diouane , Nathalie Bartoli , Sylvain Dubreuil , Paul Saves

Bayesian inference and Gaussian processes are widely used in applications ranging from robotics and control to biological systems. Many of these applications are safety-critical and require a characterization of the uncertainty associated…

机器学习 · 计算机科学 2018-10-26 Luca Cardelli , Marta Kwiatkowska , Luca Laurenti , Andrea Patane

Linear regression estimators are known to be sensitive to outliers, and one alternative to obtain a robust and efficient estimator of the regression parameter is to model the error with Student's $t$ distribution. In this article, we…

统计方法学 · 统计学 2026-03-19 Amanda Ng , Shangkai Zhu , Archer Gong Zhang , Nancy Reid

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

机器学习 · 统计学 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

The presence of outliers is prevalent in machine learning applications and may produce misleading results. In this paper a new method for dealing with outliers and anomal samples is proposed. To overcome the outlier issue, the proposed…

机器学习 · 计算机科学 2016-07-05 Parsa Bagherzadeh , Hadi Sadoghi Yazdi

Bayesian Optimization (BO) methods are useful for optimizing functions that are expen- sive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the…

机器学习 · 统计学 2020-02-04 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

A key drawback of the current generation of artificial decision-makers is that they do not adapt well to changes in unexpected situations. This paper addresses the situation in which an AI for aerial dog fighting, with tunable parameters…

机器学习 · 统计学 2016-12-14 Brett Israelsen , Nisar Ahmed

Recent work on Bayesian optimization has shown its effectiveness in global optimization of difficult black-box objective functions. Many real-world optimization problems of interest also have constraints which are unknown a priori. In this…

机器学习 · 统计学 2014-03-25 Michael A. Gelbart , Jasper Snoek , Ryan P. Adams

An exciting branch of machine learning research focuses on methods for learning, optimizing, and integrating unknown functions that are difficult or costly to evaluate. A popular Bayesian approach to this problem uses a Gaussian process…

机器学习 · 统计学 2018-04-02 Anqi Wu , Mikio C. Aoi , Jonathan W. Pillow

We study the problem of preferential Bayesian optimization (BO), where we aim to optimize a black-box function with only preference feedback over a pair of candidate solutions. Inspired by the likelihood ratio idea, we construct a…

机器学习 · 计算机科学 2024-05-30 Wenjie Xu , Wenbin Wang , Yuning Jiang , Bratislav Svetozarevic , Colin N. Jones