English
Related papers

Related papers: Improving Quadrature for Constrained Integrands

200 papers

Typical Bayesian inference requires parameter identification via likelihood parameterization, which has invited criticism for being less flexible than the Frequentist framework and subject to misspecification. Though misspecification may be…

Methodology · Statistics 2022-11-29 Vivian Y. Meng , David A. Stephens

Bayesian Optimization, leveraging Gaussian process models, has proven to be a powerful tool for minimizing expensive-to-evaluate objective functions by efficiently exploring the search space. Extensions such as constrained Bayesian…

Computation · Statistics 2025-06-03 Yezhuo Li , Qiong Zhang , Madhura Limaye , Gang Li

This paper focusses on the formulation of numerical integration as an inferential task. To date, research effort has largely focussed on the development of Bayesian cubature, whose distributional output provides uncertainty quantification…

Methodology · Statistics 2018-05-21 Toni Karvonen , Chris J. Oates , Simo Särkkä

Functions of one or more variables are usually approximated with a basis: a complete, linearly-independent system of functions that spans a suitable function space. The topic of this paper is the numerical approximation of functions using…

Numerical Analysis · Mathematics 2018-11-07 Ben Adcock , Daan Huybrechs

This paper addresses the integration of additional information sources into a Bayesian optimization framework while ensuring that safety constraints are satisfied. The interdependencies between these information sources are modeled using an…

Machine Learning · Computer Science 2025-05-06 Jannis O. Luebsen , Annika Eichler

A framework to boost the efficiency of Bayesian inference in probabilistic programs is introduced by embedding a sampler inside a variational posterior approximation. We call it the refined variational approximation. Its strength lies both…

Machine Learning · Computer Science 2020-02-25 Victor Gallego , David Rios Insua

Under investigation is the problem of finding the best approximation of a function in a Hilbert space subject to convex constraints and prescribed nonlinear transformations. We show that in many instances these prescriptions can be…

Functional Analysis · Mathematics 2021-06-17 Patrick L. Combettes , Zev C. Woodstock

Bayesian probabilistic numerical methods are a set of tools providing posterior distributions on the output of numerical methods. The use of these methods is usually motivated by the fact that they can represent our uncertainty due to…

Computation · Statistics 2018-08-01 Xiaoyue Xi , François-Xavier Briol , Mark Girolami

The increasing availability of graph-structured data motivates the task of optimising over functions defined on the node set of graphs. Traditional graph search algorithms can be applied in this case, but they may be sample-inefficient and…

Machine Learning · Computer Science 2023-10-31 Xingchen Wan , Pierre Osselin , Henry Kenlay , Binxin Ru , Michael A. Osborne , Xiaowen Dong

Optimization of complex functions, such as the output of computer simulators, is a difficult task that has received much attention in the literature. A less studied problem is that of optimization under unknown constraints, i.e., when the…

Methodology · Statistics 2010-07-06 Robert B. Gramacy , Herbert K. H. Lee

The optimal selection of experimental conditions is essential to maximizing the value of data for inference and prediction, particularly in situations where experiments are time-consuming and expensive to conduct. We propose a general…

Machine Learning · Statistics 2012-12-04 Xun Huan , Youssef M. Marzouk

Bayesian optimization is a popular and versatile approach that is well suited to solve challenging optimization problems. Their popularity comes from their effective minimization of expensive function evaluations, their capability to…

Optimization and Control · Mathematics 2026-05-14 André L. Marchildon , David W. Zingg

Bayesian optimization is normally performed within fixed variable bounds. In cases like hyperparameter tuning for machine learning algorithms, setting the variable bounds is not trivial. It is hard to guarantee that any fixed bounds will…

Optimization and Control · Mathematics 2020-01-15 Wei Chen , Mark Fuge

We present a framework for the efficient computation of optimal Bayesian decisions under intractable likelihoods, by learning a surrogate model for the expected utility (or its distribution) as a function of the action and data spaces. We…

Machine Learning · Statistics 2023-11-13 Justin Alsing , Thomas D. P. Edwards , Benjamin Wandelt

It is crucial for robots to be aware of the presence of constraints in order to acquire safe policies. However, explicitly specifying all constraints in an environment can be a challenging task. State-of-the-art constraint inference…

Robotics · Computer Science 2024-03-06 Dimitris Papadimitriou , Daniel S. Brown

We propose a general method for optimization with semi-infinite constraints that involve a linear combination of functions, focusing on the case of the exponential function. Each function is lower and upper bounded on sub-intervals by…

Optimization and Control · Mathematics 2014-01-13 Bogdan Dumitrescu , Bogdan C. Sicleru , Florin Avram

Inverse scattering aims to infer information about a hidden object by using the received scattered waves and training data collected from forward mathematical models. Recent advances in computing have led to increasing attention towards…

Applications · Statistics 2023-05-03 Chih-Li Sung , Yao Song , Ying Hung

We consider chance constrained optimization where it is sought to optimize a function while complying with constraints, both of which are affected by uncertainties. The high computational cost of realistic simulations strongly limits the…

Optimization and Control · Mathematics 2022-04-18 Julien Pelamatti , Rodolphe Le Riche , Céline Helbert , Christophette Blanchet-Scalliet

Due to their flexibility, frames of Hilbert spaces are attractive alternatives to bases in approximation schemes for problems where identifying a basis is not straightforward or even feasible. Computing a best approximation using frames,…

Numerical Analysis · Mathematics 2020-07-08 Ben Adcock , Mohsen Seifi

Nonlinear function estimation is core to modern machine learning applications. In this paper, to perform nonlinear function estimation, we reduce a nonlinear inverse problem to a linear one using a polynomial kernel expansion. These kernels…

Information Theory · Computer Science 2019-10-02 Hangjin Liu , You , Zhou , Ahmad Beirami , Dror Baron