English
Related papers

Related papers: High-Dimensional Surrogate Modeling for Closed-Loo…

200 papers

This paper introduces a surrogate modeling scheme based on Grassmannian manifold learning to be used for cost-efficient predictions of high-dimensional stochastic systems. The method exploits subspace-structured features of each solution by…

Numerical Analysis · Mathematics 2020-08-26 Dimitris G. Giovanis , Michael D. Shields

Gaussian Processes (GPs) are widely seen as the state-of-the-art surrogate models for Bayesian optimization (BO) due to their ability to model uncertainty and their performance on tasks where correlations are easily captured (such as those…

Machine Learning · Computer Science 2024-12-13 Paul Brunzema , Mikkel Jordahn , John Willes , Sebastian Trimpe , Jasper Snoek , James Harrison

Generating simulated training data needed for constructing sufficiently accurate surrogate models to be used for efficient optimization or parameter identification can incur a huge computational effort in the offline phase. We consider a…

Numerical Analysis · Mathematics 2024-04-03 Phillip Semler , Martin Weiser

Many real-world applications demand accurate and fast predictions, as well as reliable uncertainty estimates. However, quantifying uncertainty on high-dimensional predictions is still a severely under-investigated problem, especially when…

Computational Engineering, Finance, and Science · Computer Science 2025-02-04 Saurabh Deshpande , Hussein Rappel , Mark Hobbs , Stéphane P. A. Bordas , Jakub Lengiewicz

The use of transfer learning within Bayesian optimization addresses the disadvantages of the so-called \textit{cold start} problem by using source data to aid in the optimization of a target problem. We present a method that leverages an…

Optimization and Control · Mathematics 2026-04-01 Ali Tfaily , Youssef Diouane , Nathalie Bartoli , Michael Kokkolaras

Bayesian Optimization is an iterative method, tailored to optimizing expensive black box objective functions. Surrogate models like Gaussian Processes, which are the gold standard in Bayesian Optimization, can be inefficient for inputs with…

Machine Learning · Computer Science 2026-05-22 Sofianos Panagiotis Fotias , Vassilis Gaganis

Bayesian inverse modeling is important for a better understanding of hydrological processes. However, this approach can be computationally demanding, as it usually requires a large number of model evaluations. To address this issue, one can…

Computation · Statistics 2020-02-24 Jiangjiang Zhang , Qiang Zheng , Dingjiang Chen , Laosheng Wu , Lingzao Zeng

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

Machine Learning · Computer Science 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

Sample efficiency is important when optimizing parameters of locomotion controllers, since hardware experiments are time consuming and expensive. Bayesian Optimization, a sample-efficient optimization framework, has recently been widely…

Robotics · Computer Science 2018-10-11 Rika Antonova , Akshara Rai , Christopher G. Atkeson

Posterior sampling by Monte Carlo methods provides a more comprehensive solution approach to inverse problems than computing point estimates such as the maximum posterior using optimization methods, at the expense of usually requiring many…

Numerical Analysis · Mathematics 2024-11-28 Paolo Villani , Daniel Andrés-Arcones , Jörg F. Unger , Martin Weiser

In many mechanistic medical, biological, physical and engineered spatiotemporal dynamic models the numerical solution of partial differential equations (PDEs) can make simulations impractically slow. Biological models require the…

Soft Condensed Matter · Physics 2021-02-11 J. Quetzalcóatl Toledo-Marín , Geoffrey Fox , James P. Sluka , James A. Glazier

This paper presents a novel methodology that uses surrogate models in the form of neural networks to reduce the computation time of simulation-based optimization of a reference trajectory. Simulation-based optimization is necessary when…

Optimization and Control · Mathematics 2023-03-31 Evelyn Ruff , Rebecca Russell , Matthew Stoeckle , Piero Miotto , Jonathan P. How

For many novel applications, such as patient-specific computer-aided surgery, conventional solution techniques of the underlying nonlinear problems are usually computationally too expensive and are lacking information about how certain can…

Machine Learning · Computer Science 2022-07-18 Saurabh Deshpande , Jakub Lengiewicz , Stéphane P. A. Bordas

Approximate Bayesian Computation is widely used in systems biology for inferring parameters in stochastic gene regulatory network models. Its performance hinges critically on the ability to summarize high-dimensional system responses such…

Machine Learning · Statistics 2021-04-13 Mattias Åkesson , Prashant Singh , Fredrik Wrede , Andreas Hellander

Bayesian methods in machine learning, such as Gaussian processes, have great advantages com-pared to other techniques. In particular, they provide estimates of the uncertainty associated with a prediction. Extending the Bayesian approach to…

Quantum Physics · Physics 2019-05-20 Zhikuan Zhao , Alejandro Pozas-Kerstjens , Patrick Rebentrost , Peter Wittek

We consider chance constrained optimization where it is sought to optimize a function while complying with constraints, both of which are affected by uncertainties. The high computational cost of realistic simulations strongly limits the…

Optimization and Control · Mathematics 2022-04-18 Julien Pelamatti , Rodolphe Le Riche , Céline Helbert , Christophette Blanchet-Scalliet

A key requirement for the current generation of artificial decision-makers is that they should adapt well to changes in unexpected situations. This paper addresses the situation in which an AI for aerial dog fighting, with tunable…

Machine Learning · Statistics 2016-12-14 Brett W. Israelsen , Nisar Ahmed , Kenneth Center , Roderick Green , Winston Bennett

Multidisciplinary design optimization methods aim at adapting numerical optimization techniques to the design of engineering systems involving multiple disciplines. In this context, a large number of mixed continuous, integer and…

In this work, we propose a framework for adapting the controller's parameters based on learning optimal solutions from contextual black-box optimization problems. We consider a class of control design problems for dynamical systems…

Systems and Control · Electrical Eng. & Systems 2025-06-27 Viet-Anh Le , Andreas A. Malikopoulos

Bayesian optimisation has gained great popularity as a tool for optimising the parameters of machine learning algorithms and models. Somewhat ironically, setting up the hyper-parameters of Bayesian optimisation methods is notoriously hard.…

Machine Learning · Statistics 2014-07-01 Ziyu Wang , Nando de Freitas
‹ Prev 1 4 5 6 7 8 10 Next ›