English
Related papers

Related papers: Are we Forgetting about Compositional Optimisers i…

200 papers

Bayesian optimal experimental design (OED) seeks to conduct the most informative experiment under budget constraints to update the prior knowledge of a system to its posterior from the experimental data in a Bayesian framework. Such…

Machine Learning · Computer Science 2024-02-29 Rafael Orozco , Felix J. Herrmann , Peng Chen

Complex processes in science and engineering are often formulated as multistage decision-making problems. In this paper, we consider a type of multistage decision-making process called a cascade process. A cascade process is a multistage…

The performance of deep (reinforcement) learning systems crucially depends on the choice of hyperparameters. Their tuning is notoriously expensive, typically requiring an iterative training process to run for numerous steps to convergence.…

Machine Learning · Computer Science 2021-01-19 Vu Nguyen , Sebastian Schulze , Michael A Osborne

Bayesian optimization is a sample-efficient method for black-box global optimization. How- ever, the performance of a Bayesian optimization method very much depends on its exploration strategy, i.e. the choice of acquisition function, and…

Machine Learning · Statistics 2015-03-06 Bobak Shahriari , Ziyu Wang , Matthew W. Hoffman , Alexandre Bouchard-Côté , Nando de Freitas

Autonomous methods to align beamlines can decrease the amount of time spent on diagnostics, and also uncover better global optima leading to better beam quality. The alignment of these beamlines is a high-dimensional, expensive-to-sample…

Bayesian optimisation (BO) is widely used to optimise stochastic black box functions. While most BO approaches focus on optimising conditional expectations, many applications require risk-averse strategies and alternative criteria…

Machine Learning · Statistics 2022-07-11 Victor Picheny , Henry Moss , Léonard Torossian , Nicolas Durrande

Optimal design of experiments for Bayesian inverse problems has recently gained wide popularity and attracted much attention, especially in the computational science and Bayesian inversion communities. An optimal design maximizes a…

Optimization and Control · Mathematics 2023-05-09 Ahmed Attia , Sven Leyffer , Todd Munson

This paper investigates a new class of modifier-adaptation schemes to overcome plant-model mismatch in real-time optimization of uncertain processes. The main contribution lies in the integration of concepts from the areas of Bayesian…

This paper studies the problem of globally optimizing a variable of interest that is part of a causal model in which a sequence of interventions can be performed. This problem arises in biology, operational research, communications and,…

Machine Learning · Statistics 2020-05-27 Virginia Aglietti , Xiaoyu Lu , Andrei Paleyes , Javier González

Bayesian optimization has recently emerged as a popular and efficient tool for global optimization and hyperparameter tuning. Currently, the established Bayesian optimization practice requires a user-defined bounding box which is assumed to…

Machine Learning · Statistics 2015-08-18 Bobak Shahriari , Alexandre Bouchard-Côté , Nando de Freitas

Bayesian optimization is a methodology to optimize black-box functions. Traditionally, it focuses on the setting where you can arbitrarily query the search space. However, many real-life problems do not offer this flexibility; in…

Modelling human function learning has been the subject of in-tense research in cognitive sciences. The topic is relevant in black-box optimization where information about the objective and/or constraints is not available and must be learned…

Computers and Society · Computer Science 2020-03-10 Antonio Candelieri , Riccardo Perego , Ilaria Giordani , Andrea Ponti , Francesco Archetti

When subjected to automated decision-making, decision subjects may strategically modify their observable features in ways they believe will maximize their chances of receiving a favorable decision. In many practical situations, the…

Computer Science and Game Theory · Computer Science 2022-10-10 Keegan Harris , Valerie Chen , Joon Sik Kim , Ameet Talwalkar , Hoda Heidari , Zhiwei Steven Wu

Bayesian optimisation is a sample-efficient search methodology that holds great promise for accelerating drug and materials discovery programs. A frequently-overlooked modelling consideration in Bayesian optimisation strategies however, is…

Bayesian optimization (BO) is a powerful technology for optimizing noisy expensive-to-evaluate black-box functions, with a broad range of real-world applications in science, engineering, economics, manufacturing, and beyond. In this paper,…

Machine Learning · Computer Science 2024-01-30 Joel A. Paulson , Calvin Tsay

In several applications such as databases, planning, and sensor networks, parameters such as selectivity, load, or sensed values are known only with some associated uncertainty. The performance of such a system (as captured by some…

Data Structures and Algorithms · Computer Science 2010-01-28 Sudipto Guha , Kamesh Munagala

Two commonly arising computational tasks in Bayesian learning are Optimization (Maximum A Posteriori estimation) and Sampling (from the posterior distribution). In the convex case these two problems are efficiently reducible to each other.…

Machine Learning · Computer Science 2019-11-07 Kunal Talwar

We propose MUMBO, the first high-performing yet computationally efficient acquisition function for multi-task Bayesian optimization. Here, the challenge is to perform efficient optimization by evaluating low-cost functions somehow related…

Machine Learning · Computer Science 2020-06-23 Henry B. Moss , David S. Leslie , Paul Rayson

Many real-world optimisation problems are defined over both categorical and continuous variables, yet efficient optimisation methods such asBayesian Optimisation (BO) are not designed tohandle such mixed-variable search spaces. Recent…

Machine Learning · Statistics 2022-02-18 Yan Zuo , Amir Dezfouli , Iadine Chades , David Alexander , Benjamin Ward Muir

Optimising black-box functions is important in many disciplines, such as tuning machine learning models, robotics, finance and mining exploration. Bayesian optimisation is a state-of-the-art technique for the global optimisation of…

Machine Learning · Computer Science 2015-03-05 John-Alexander M. Assael , Ziyu Wang , Bobak Shahriari , Nando de Freitas
‹ Prev 1 8 9 10 Next ›