English
Related papers

Related papers: A Stratified Analysis of Bayesian Optimization Met…

200 papers

Optimization of expensive computer models with the help of Gaussian process emulators in now commonplace. However, when several (competing) objectives are considered, choosing an appropriate sampling strategy remains an open question. We…

Optimization and Control · Mathematics 2013-10-03 Victor Picheny

As the amount of economic and other data generated worldwide increases vastly, a challenge for future generations of econometricians will be to master efficient algorithms for inference in empirical models with large information sets. This…

Computation · Statistics 2020-04-27 Dimitris Korobilis , Davide Pettenuzzo

Airline route planning takes into account the factors of commercial and customer preferences, safety, and should allow a flexibility given the tremendous uncertainty about market conditions. The mathematical model on the Bayes formula…

Computers and Society · Computer Science 2019-02-19 L. V. Androshchuk , Aidan Rooney

Due to their intuitive appeal, Bayesian methods of modeling and uncertainty quantification have become popular in modern machine and deep learning. When providing a prior distribution over the parameter space, it is straightforward to…

Machine Learning · Statistics 2025-06-05 Ivan Melev , Goeran Kauermann

Bayesian optimal experimental design is a sub-field of statistics focused on developing methods to make efficient use of experimental resources. Any potential design is evaluated in terms of a utility function, such as the (theoretically…

Machine Learning · Computer Science 2022-10-21 Noble Kennamer , Steven Walton , Alexander Ihler

Bayesian optimization is a popular framework for the optimization of black box functions. Multifidelity methods allows to accelerate Bayesian optimization by exploiting low-fidelity representations of expensive objective functions. Popular…

Machine Learning · Computer Science 2024-07-08 Francesco Di Fiore , Laura Mainini

Optimization of problems with high computational power demands is a challenging task. A probabilistic approach to such optimization called Bayesian optimization lowers performance demands by solving mathematically simpler model of the…

Machine Learning · Computer Science 2021-01-27 Jakub Klus , Pavel Grunt , Martin Dobrovolný

This paper describes a framework for flexible multiple hypothesis testing of autoregressive time series. The modeling approach is Bayesian, though a blend of frequentist and Bayesian reasoning is used to evaluate procedures. Nonparametric…

Applications · Statistics 2010-09-30 James G. Scott

The process of dynamic state estimation (filtering) based on point process observations is in general intractable. Numerical sampling techniques are often practically useful, but lead to limited conceptual insight about optimal…

Machine Learning · Statistics 2015-08-04 Yuval Harel , Ron Meir , Manfred Opper

Mathematical Selection is a method in which we select a particular choice from a set of such. It have always been an interesting field of study for mathematicians. Accordingly, Combinatorial Optimization is a sub field of this domain of…

Computational Complexity · Computer Science 2023-06-29 Anurag Dutta , K. Lakshmanan , A. Ramamoorthy , Liton Chandra Voumik , John Harshith , John Pravin Motha

The ultimate goal of optimization is to find the minimizer of a target function.However, typical criteria for active optimization often ignore the uncertainty about the minimizer. We propose a novel criterion for global optimization and an…

Methodology · Statistics 2012-02-13 Il Memming Park , Marcel Nassar , Mijung Park

Randomized controlled experiments assess new policy impacts on performance metrics to inform launch decisions. Traditional approaches evaluate metrics independently despite correlations, and mixed results (e.g., positive revenue impact,…

Applications · Statistics 2026-01-29 Hoiyi Ng , Guido Imbens

Stacking is a widely used model averaging technique that asymptotically yields optimal predictions among linear averages. We show that stacking is most effective when model predictive performance is heterogeneous in inputs, and we can…

Methodology · Statistics 2021-10-29 Yuling Yao , Gregor Pirš , Aki Vehtari , Andrew Gelman

Model-based sequential approaches to discrete "black-box" optimization, including Bayesian optimization techniques, often access the same points multiple times for a given objective function in interest, resulting in many steps to find the…

Machine Learning · Computer Science 2023-12-29 Keisuke Morita , Yoshihiko Nishikawa , Masayuki Ohzeki

Existing high-dimensional Bayesian optimization (BO) methods aim to overcome the curse of dimensionality by carefully encoding structural assumptions, from locality to sparsity to smoothness, into the optimization procedure. Surprisingly,…

Machine Learning · Computer Science 2026-04-10 Colin Doumont , Donney Fan , Natalie Maus , Jacob R. Gardner , Henry Moss , Geoff Pleiss

Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations. It relies on querying a distribution over functions defined by a relatively cheap surrogate model. An accurate model for…

Bayesian hypothesis testing via Bayes factors offers a principled alternative to classical p-value methods in meta-analysis, particularly suited to its cumulative and sequential nature. Unlike commonly reported p-values for standard null…

Methodology · Statistics 2026-04-22 Joris Mulder , Robbie C. M. van Aert

The optimal selection of experimental conditions is essential to maximizing the value of data for inference and prediction, particularly in situations where experiments are time-consuming and expensive to conduct. We propose a general…

Machine Learning · Statistics 2012-12-04 Xun Huan , Youssef M. Marzouk

Applying Bayesian optimization in problems wherein the search space is unknown is challenging. To address this problem, we propose a systematic volume expansion strategy for the Bayesian optimization. We devise a strategy to guarantee that…

Machine Learning · Statistics 2019-10-30 Huong Ha , Santu Rana , Sunil Gupta , Thanh Nguyen , Hung Tran-The , Svetha Venkatesh

One of the first tasks we learn as children is to grasp objects based on our tactile perception. Incorporating such skill in robots will enable multiple applications, such as increasing flexibility in industrial processes or providing…