English
Related papers

Related papers: Curvature-aware Expected Free Energy as an Acquisi…

200 papers

For Bayesian optimization (BO) on high-dimensional data with complex structure, neural network-based kernels for Gaussian processes (GPs) have been used to learn flexible surrogate functions by the high representation power of deep…

Machine Learning · Statistics 2021-11-02 Tomoharu Iwata

Though the convex optimization has been widely used in power systems, it still cannot guarantee to yield a tight (accurate) solution to some problems. To mitigate this issue, this paper proposes an ensemble learning based convex…

Systems and Control · Electrical Eng. & Systems 2020-05-18 Ren Hu , Qifeng Li , Feng Qiu

Data acquisition efficiency is a central challenge in deploying reinforcement learning in business and healthcare operations, where interactions are costly, slow, and often involve humans in the loop. This paper develops a unified large…

Machine Learning · Computer Science 2026-05-28 Mingjie Hu , Jian-Qiang Hu , Enlu Zhou

We study Bayesian inverse problems with mixed noise, modeled as a combination of additive and multiplicative Gaussian components. While traditional inference methods often assume fixed or known noise characteristics, real-world…

Machine Learning · Computer Science 2025-10-17 Paul Hagemann , Robert Gruhlke , Bernhard Stankewitz , Claudia Schillings , Gabriele Steidl

Active inference, a corollary of the free energy principle, is a formal way of describing the behavior of certain kinds of random dynamical systems that have the appearance of sentience. In this chapter, we describe how active inference…

Machine Learning · Statistics 2021-10-11 Noor Sajid , Lancelot Da Costa , Thomas Parr , Karl Friston

Bayesian optimization (BO) is increasingly employed in critical applications such as materials design and drug discovery. An increasingly popular strategy in BO is to forgo the sole reliance on high-fidelity data and instead use an ensemble…

Machine Learning · Statistics 2023-03-22 Zahra Zanjani Foumani , Mehdi Shishehbor , Amin Yousefpour , Ramin Bostanabad

Bayesian optimization (BO) is a model-based approach to sequentially optimize expensive black-box functions, such as the validation error of a deep neural network with respect to its hyperparameters. In many real-world scenarios, the…

Machine Learning · Statistics 2019-10-17 Valerio Perrone , Iaroslav Shcherbatyi , Rodolphe Jenatton , Cedric Archambeau , Matthias Seeger

Bayesian optimization (BO) is an efficient method for optimizing expensive black-box functions. In real-world applications, BO often faces a major problem of missing values in inputs. The missing inputs can happen in two cases. First, the…

Machine Learning · Computer Science 2020-06-22 Phuc Luong , Dang Nguyen , Sunil Gupta , Santu Rana , Svetha Venkatesh

Many real-world situations allow for the acquisition of additional relevant information when making an assessment with limited or uncertain data. However, traditional ML approaches either require all features to be acquired beforehand or…

Machine Learning · Computer Science 2021-03-15 Yang Li , Junier B. Oliva

Bayesian optimization is an approach to optimizing objective functions that take a long time (minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of less than 20 dimensions, and tolerates stochastic…

Machine Learning · Statistics 2018-07-10 Peter I. Frazier

Information-based Bayesian optimization (BO) algorithms have achieved state-of-the-art performance in optimizing a black-box objective function. However, they usually require several approximations or simplifying assumptions (without…

Machine Learning · Computer Science 2021-08-02 Quoc Phong Nguyen , Zhaoxuan Wu , Bryan Kian Hsiang Low , Patrick Jaillet

This dissertation shows that careful injection of noise into sample data can substantially speed up Expectation-Maximization algorithms. Expectation-Maximization algorithms are a class of iterative algorithms for extracting maximum…

Machine Learning · Statistics 2014-11-26 Osonde Adekorede Osoba

Solving large-scale capacity expansion problems (CEPs) is central to cost-effective decarbonization of regional-scale energy systems. To ensure the intended outcomes of CEPs, modeling uncertainty due to weather-dependent variable renewable…

Systems and Control · Electrical Eng. & Systems 2024-07-18 Aron Brenner , Rahman Khorramfar , Dharik Mallapragada , Saurabh Amin

In a reinforcement learning (RL) framework, we study the exploratory version of the continuous time expected utility (EU) maximization problem with a portfolio constraint that includes widely-used financial regulations such as short-selling…

Mathematical Finance · Quantitative Finance 2024-12-17 Huy Chau , Duy Nguyen , Thai Nguyen

Black-box problems are common in real life like structural design, drug experiments, and machine learning. When optimizing black-box systems, decision-makers always consider multiple performances and give the final decision by comprehensive…

Machine Learning · Computer Science 2021-01-22 Wenjie Chen , Shengcai Liu , Ke Tang

Bayesian optimization is a widely used technique for optimizing black-box functions, with Expected Improvement (EI) being the most commonly utilized acquisition function in this domain. While EI is often viewed as distinct from other…

Machine Learning · Statistics 2025-03-11 Nuojin Cheng , Stephen Becker

We introduce an optimization framework for variational inference based on the coupled free energy, extending variational inference techniques to account for the curved geometry of the coupled exponential family. This family includes…

Machine Learning · Computer Science 2025-07-29 Kenric Nelson , Igor Oliveira , Amenah Al-Najafi , Fode Zhang , Hon Keung Tony Ng

We propose a proof of convergence of an adaptive method used in molecular dynamics to compute free energy profiles. Mathematically, it amounts to studying the long-time behavior of a stochastic process which satisfies a non-linear…

Analysis of PDEs · Mathematics 2007-06-13 Tony Lelievre , Felix Otto , Mathias Rousset , Gabriel Stoltz

A modification of the Adaptive Biasing Force method is introduced, in which the free energy is approximated by a sum of tensor products of one-dimensional functions. This enables to handle a larger number of reaction coordinates than the…

Probability · Mathematics 2020-07-21 Virginie Ehrlacher , Tony Lelièvre , Pierre Monmarché

This paper presents an auto-optimization control framework for wave energy converters (WECs) to maximize energy generation under unknown and changing ocean conditions. The proposed control framework consists of two levels. The high-level…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Siyang Tang , Wen-Hua Chen , Cunjia Liu
‹ Prev 1 3 4 5 6 7 10 Next ›