English
Related papers

Related papers: Accelerating Bayesian Optimization for Nonlinear S…

200 papers

We extend the well-known BFGS quasi-Newton method and its memory-limited variant LBFGS to the optimization of nonsmooth convex objectives. This is done in a rigorous fashion by generalizing three components of BFGS to subdifferentials: the…

Machine Learning · Statistics 2010-11-30 Jin Yu , S. V. N. Vishwanathan , Simon Guenter , Nicol N. Schraudolph

To discover novel materials with high performance, there have been many attempts to adopt Bayesian optimization (BO) to materials science, owing to its efficiency in navigating complex and high-dimensional design spaces. However, the…

Materials Science · Physics 2025-05-12 Sanghyeon Park , Yoonsu Shim , Junpyo Hur , Dongmin Jeon , Jong Min Yuk , Chan-Woo Lee

Bayesian Optimization (BO) has become a core method for solving expensive black-box optimization problems. While much research focussed on the choice of the acquisition function, we focus on online length-scale adaption and the choice of…

Machine Learning · Computer Science 2016-12-12 Kim Peter Wabersich , Marc Toussaint

In this thesis, I explore the possibilities of conducting Bayesian optimization techniques in high dimensional domains. Although high dimensional domains can be defined to be between hundreds and thousands of dimensions, we will primarily…

Machine Learning · Computer Science 2020-10-09 David Yenicelik

An incremental/online state dynamic learning method is proposed for identification of the nonlinear Gaussian state space models. The method embeds the stochastic variational sparse Gaussian process as the probabilistic state dynamic model…

Machine Learning · Statistics 2016-08-31 Vahid Bastani , Lucio Marcenaro , Carlo Regazzoni

Parameter reconstruction is a common problem in optical nano metrology. It generally involves a set of measurements, to which one attempts to fit a numerical model of the measurement process. The model evaluation typically involves to solve…

Computational Physics · Physics 2021-07-13 Matthias Plock , Sven Burger , Philipp-Immanuel Schneider

This paper presents a general stochastic model developed for a class of cooperative wireless relay networks, in which imperfect knowledge of the channel state information at the destination node is assumed. The framework incorporates…

Applications · Statistics 2015-05-19 Gareth W. Peters , Ido Nevat , Scott A. Sisson , Yanan Fan , Jinhong Yuan

In this contribution we present an accelerated optimization-based approach for combined state and parameter reduction of a parametrized linear control system which is then used as a surrogate model in a Bayesian inverse setting. Following…

Optimization and Control · Mathematics 2016-08-22 Christian Himpe , Mario Ohlberger

Model instability and poor prediction of long-term behavior are common problems when modeling dynamical systems using nonlinear "black-box" techniques. Direct optimization of the long-term predictions, often called simulation error…

Systems and Control · Computer Science 2017-01-25 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

We describe a method for searching the optimal hyper-parameters in reservoir computing, which consists of a Gaussian process with Bayesian optimization. It provides an alternative to other frequently used optimization methods such as grid,…

Machine Learning · Computer Science 2017-06-15 Jan Yperman , Thijs Becker

A parametric adaptive physics-informed greedy Latent Space Dynamics Identification (gLaSDI) method is proposed for accurate, efficient, and robust data-driven reduced-order modeling of high-dimensional nonlinear dynamical systems. In the…

Systems and Control · Electrical Eng. & Systems 2023-07-19 Xiaolong He , Youngsoo Choi , William D. Fries , Jon Belof , Jiun-Shyan Chen

Accurate and robust state estimation is critical for autonomous navigation of robot teams. This task is especially challenging for large groups of size, weight, and power (SWAP) constrained aerial robots operating in perceptually-degraded…

Robotics · Computer Science 2023-05-30 Igor Spasojevic , Xu Liu , Alejandro Ribeiro , George J. Pappas , Vijay Kumar

Automated chemical synthesis, materials fabrication, and spectroscopic physical measurements often bring forth the challenge of process trajectory optimization, i.e., discovering the time dependence of temperature, electric field, or…

Disordered Systems and Neural Networks · Physics 2022-06-28 Mani Valleti , Rama K. Vasudevan , Maxim A. Ziatdinov , Sergei V. Kalinin

This paper is concerned with sequential state filtering in the presence of nonlinearity, non-Gaussianity and model uncertainty. For this problem, the Bayesian model averaged particle filter (BMAPF) is perhaps one of the most efficient…

Computation · Statistics 2020-01-28 Bin Liu

We investigate the convergence of a backward Euler finite element discretization applied to a multi-domain and multi-scale elliptic-parabolic system, derived from the Doyle-Fuller-Newman model for lithium-ion cells. We establish…

Numerical Analysis · Mathematics 2025-07-09 Shu Xu , Liqun Cao

X-ray absorption spectroscopy (XAS) is a leading technique for understanding structural changes in advanced battery materials such as lithium-excess cathodes. However, extracting critical information like oxidation states from the…

Discovering novel materials with desired properties is essential for driving innovation. Industry 4.0 and smart manufacturing have promised transformative advances in this area through real-time data integration and automated production…

Machine Learning · Computer Science 2025-04-08 Avijit Saha Asru , Hamed Khosravi , Imtiaz Ahmed , Abdullahil Azeem

This paper investigates a new class of modifier-adaptation schemes to overcome plant-model mismatch in real-time optimization of uncertain processes. The main contribution lies in the integration of concepts from the areas of Bayesian…

We consider the problem of estimating the parameters of a Gaussian or binary distribution in such a way that the resulting undirected graphical model is sparse. Our approach is to solve a maximum likelihood problem with an added l_1-norm…

Artificial Intelligence · Computer Science 2007-07-06 Onureena Banerjee , Laurent El Ghaoui , Alexandre d'Aspremont

Neural density estimators have proven remarkably powerful in performing efficient simulation-based Bayesian inference in various research domains. In particular, the BayesFlow framework uses a two-step approach to enable amortized parameter…

Methodology · Statistics 2022-11-10 Marvin Schmitt , Paul-Christian Bürkner , Ullrich Köthe , Stefan T. Radev