中文
相关论文

相关论文: BoTorch: A Framework for Efficient Monte-Carlo Bay…

200 篇论文

To conduct Bayesian inference with large data sets, it is often convenient or necessary to distribute the data across multiple machines. We consider a likelihood function expressed as a product of terms, each associated with a subset of the…

统计计算 · 统计学 2020-04-09 Lewis J. Rendell , Adam M. Johansen , Anthony Lee , Nick Whiteley

Approximate Bayesian computation (ABC) is computationally intensive for complex model simulators. To exploit expensive simulations, data-resampling via bootstrapping can be employed to obtain many artificial datasets at little cost.…

统计计算 · 统计学 2021-07-05 Umberto Picchini , Richard G. Everitt

Bayesian optimization (BO) is a sample efficient approach to automatically tune the hyperparameters of machine learning models. In practice, one frequently has to solve similar hyperparameter tuning problems sequentially. For example, one…

机器学习 · 计算机科学 2021-02-26 Samuel Horváth , Aaron Klein , Peter Richtárik , Cédric Archambeau

The optimization of yields in multi-reactor systems, which are advanced tools in heterogeneous catalysis research, presents a significant challenge due to hierarchical technical constraints. To this respect, this work introduces a novel…

机器学习 · 计算机科学 2024-08-06 Markus Grimm , Sébastien Paul , Pierre Chainais

Scientific experiments are usually expensive due to complex experimental preparation and processing. Experimental design is therefore involved with the task of finding the optimal experimental input that results in the desirable output by…

机器学习 · 统计学 2020-02-27 Cheng Li , Sunil Gupta , Santu Rana , Vu Nguyen , Antonio Robles-Kelly , Svetha Venkatesh

Bayesian analysis is widely used in science and engineering for real-time forecasting, decision making, and to help unravel the processes that explain the observed data. These data are some deterministic and/or stochastic transformations of…

最优化与控制 · 数学 2020-02-24 Jiangjiang Zhang , Jasper A. Vrugt , Xiaoqing Shi , Guang Lin , Lingzao Zeng , Laosheng Wu

Sequential optimization methods are often confronted with the curse of dimensionality in high-dimensional spaces. Current approaches under the Gaussian process framework are still burdened by the computational complexity of tracking…

机器学习 · 计算机科学 2024-01-08 Zeji Yi , Yunyue Wei , Chu Xin Cheng , Kaibo He , Yanan Sui

Markov Chain Monte Carlo (MCMC) sampling methods are widely used but often encounter either slow convergence or biased sampling when applied to multimodal high dimensional distributions. In this paper, we present a general framework of…

统计计算 · 统计学 2017-09-12 Ricky Fok , Aijun An , Xiaogang Wang

Bayesian optimization is a sample-efficient method for black-box global optimization. How- ever, the performance of a Bayesian optimization method very much depends on its exploration strategy, i.e. the choice of acquisition function, and…

The optimization of expensive-to-evaluate black-box functions is prevalent in various scientific disciplines. Bayesian optimization is an automatic, general and sample-efficient method to solve these problems with minimal knowledge of the…

机器学习 · 计算机科学 2024-02-20 Carl Hvarfner , Frank Hutter , Luigi Nardi

Recent work on Bayesian optimization has shown its effectiveness in global optimization of difficult black-box objective functions. Many real-world optimization problems of interest also have constraints which are unknown a priori. In this…

机器学习 · 统计学 2014-03-25 Michael A. Gelbart , Jasper Snoek , Ryan P. Adams

Sample efficient learning of manipulation skills poses a major challenge in robotics. While recent approaches demonstrate impressive advances in the type of task that can be addressed and the sensing modalities that can be incorporated,…

机器人学 · 计算机科学 2024-10-08 Adrian Röfer , Iman Nematollahi , Tim Welschehold , Wolfram Burgard , Abhinav Valada

Bayesian optimization is a sample-efficient approach to solving global optimization problems. Along with a surrogate model, this approach relies on theoretically motivated value heuristics (acquisition functions) to guide the search…

机器学习 · 统计学 2017-12-04 James T. Wilson , Riccardo Moriconi , Frank Hutter , Marc Peter Deisenroth

Decision tree learning is a popular approach for classification and regression in machine learning and statistics, and Bayesian formulations---which introduce a prior distribution over decision trees, and formulate learning as posterior…

机器学习 · 统计学 2013-08-26 Balaji Lakshminarayanan , Daniel M. Roy , Yee Whye Teh

We consider the problem of optimizing a real-valued continuous function $f$ using a Bayesian approach, where the evaluations of $f$ are chosen sequentially by combining prior information about $f$, which is described by a random process…

最优化与控制 · 数学 2011-11-22 Romain Benassi , Julien Bect , Emmanuel Vazquez

Deployments of Bayesian Optimization (BO) for functions with stochastic evaluations, such as parameter tuning via cross validation and simulation optimization, typically optimize an average of a fixed set of noisy realizations of the…

机器学习 · 计算机科学 2020-07-03 Henry B. Moss , David S. Leslie , Paul Rayson

This paper presents a method called sampling-computation-optimization (SCO) to design batch Bayesian optimization. SCO does not construct new high-dimensional acquisition functions but samples from the existing one-site acquisition function…

最优化与控制 · 数学 2022-02-22 Kai Jia , Xiaojun Duan , Zhengming Wang , Liang Yan

The performance of the Monte Carlo sampling methods relies on the crucial choice of a proposal density. The notion of optimality is fundamental to design suitable adaptive procedures of the proposal density within Monte Carlo schemes. This…

统计计算 · 统计学 2026-02-24 Fernando Llorente , Luca Martino

This paper addresses the challenging computational problem of estimating intractable expectations over discrete domains. Existing approaches, including Monte Carlo and Russian Roulette estimators, are consistent but often require a large…

机器学习 · 统计学 2025-12-19 Sophia Seulkee Kang , François-Xavier Briol , Toni Karvonen , Zonghao Chen

Bayesian Optimization (BO) is a sample-efficient optimization algorithm widely employed across various applications. In some challenging BO tasks, input uncertainty arises due to the inevitable randomness in the optimization process, such…

机器学习 · 计算机科学 2023-11-07 Lin Yang , Junlong Lyu , Wenlong Lyu , Zhitang Chen