中文
相关论文

相关论文: Adaptive Simulation-based Training of AI Decision-…

200 篇论文

Bayesian optimization (BO) is widely adopted in black-box optimization problems and it relies on a surrogate model to approximate the black-box response function. With the increasing number of black-box optimization tasks solved and even…

机器学习 · 计算机科学 2023-08-10 Wenlong Lyu , Shoubo Hu , Jie Chuai , Zhitang Chen

We introduce a novel adaptive Gaussian Process Regression (GPR) methodology for efficient construction of surrogate models for Bayesian inverse problems with expensive forward model evaluations. An adaptive design strategy focuses on…

数值分析 · 数学 2024-05-01 Paolo Villani , Jörg Unger , Martin Weiser

Bayesian optimization (BO) with Gaussian process (GP) surrogate models is a powerful black-box optimization method. Acquisition functions are a critical part of a BO algorithm as they determine how the new samples are selected. Some of the…

机器学习 · 计算机科学 2024-12-30 Jingyi Wang , Haowei Wang , Cosmin G. Petra , Nai-Yuan Chiang

Parameter estimation is crucial for modeling, tracking, and control of complex dynamical systems. However, parameter uncertainties can compromise system performance under a controller relying on nominal parameter values. Typically,…

机器人学 · 计算机科学 2020-02-20 Mouhyemen Khan , Abhijit Chatterjee

Bayesian Optimization is a popular tool for tuning algorithms in automatic machine learning (AutoML) systems. Current state-of-the-art methods leverage Random Forests or Gaussian processes to build a surrogate model that predicts algorithm…

机器学习 · 计算机科学 2021-01-08 Jeroen van Hoof , Joaquin Vanschoren

The performance of deep (reinforcement) learning systems crucially depends on the choice of hyperparameters. Their tuning is notoriously expensive, typically requiring an iterative training process to run for numerous steps to convergence.…

机器学习 · 计算机科学 2021-01-19 Vu Nguyen , Sebastian Schulze , Michael A Osborne

In the field of machine learning (ML) for materials optimization, active learning algorithms, such as Bayesian Optimization (BO), have been leveraged for guiding autonomous and high-throughput experimentation systems. However, very few…

Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations. It relies on querying a distribution over functions defined by a relatively cheap surrogate model. An accurate model for…

Experimental (design) optimization is a key driver in designing and discovering new products and processes. Bayesian Optimization (BO) is an effective tool for optimizing expensive and black-box experimental design processes. While Bayesian…

机器学习 · 计算机科学 2024-02-28 Arun Kumar A , Alistair Shilton , Sunil Gupta , Santu Rana , Stewart Greenhill , Svetha Venkatesh

The fusion of experimental automation and machine learning has catalyzed a new era in materials research, prominently featuring Gaussian Process Bayesian Optimization (GPBO) driven autonomous experiments navigating complex experimental…

材料科学 · 物理学 2024-05-28 Sumner B. Harris , Rama Vasudevan , Yongtao Liu

Bayesian optimization (BO) has become a popular strategy for global optimization of expensive real-world functions. Contrary to a common expectation that BO is suited to optimizing black-box functions, it actually requires domain knowledge…

机器学习 · 计算机科学 2024-08-06 Zi Wang , George E. Dahl , Kevin Swersky , Chansoo Lee , Zachary Nado , Justin Gilmer , Jasper Snoek , Zoubin Ghahramani

Faced with problems of increasing complexity, recent research in Bayesian Optimisation (BO) has focused on adapting deep probabilistic models as flexible alternatives to Gaussian Processes (GPs). In a similar vein, this paper investigates…

机器学习 · 计算机科学 2022-05-31 Alexandre Maraval , Matthieu Zimmer , Antoine Grosnit , Rasul Tutunov , Jun Wang , Haitham Bou Ammar

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical…

机器学习 · 计算机科学 2024-07-18 Hwanwoo Kim , Daniel Sanz-Alonso

We propose a novel actor-critic, model-free reinforcement learning algorithm which employs a Bayesian method of parameter space exploration to solve environments. A Gaussian process is used to learn the expected return of a policy given the…

机器学习 · 计算机科学 2020-03-03 Ashish Rao , Bidipta Sarkar , Tejas Narayanan

Bayesian optimization (BO) is a powerful framework for estimating parameters of expensive simulation models, particularly in settings where the likelihood is intractable and evaluations are costly. In stochastic models every simulation is…

统计方法学 · 统计学 2026-04-16 Arindam Fadikar , Abby Stevens , Mickael Binois , Nicholson Collier , David O'Gara , Jonathan Ozik

We present an adaptive approach to the construction of Gaussian process surrogates for Bayesian inference with expensive-to-evaluate forward models. Our method relies on the fully Bayesian approach to training Gaussian process models and…

机器学习 · 统计学 2018-10-01 Timur Takhtaganov , Juliane Müller

Bayesian optimization (BO) is a popular paradigm for global optimization of expensive black-box functions, but there are many domains where the function is not completely a black-box. The data may have some known structure (e.g. symmetries)…

机器学习 · 计算机科学 2022-12-08 Samuel Kim , Peter Y. Lu , Charlotte Loh , Jamie Smith , Jasper Snoek , Marin Soljačić

Gaussian processes~(Kriging) are interpolating data-driven models that are frequently applied in various disciplines. Often, Gaussian processes are trained on datasets and are subsequently embedded as surrogate models in optimization…

Simulation models are widely used in practice to facilitate decision-making in a complex, dynamic and stochastic environment. But they are computationally expensive to execute and optimize, due to lack of analytical tractability. Simulation…

最优化与控制 · 数学 2021-06-14 L. Jeff Hong , Xiaowei Zhang

BayesianOptimization(BO) is a sample-efficient black-box optimizer, and extensive methods have been proposed to build the absolute function response of the black-box function through a probabilistic surrogate model, including…

机器学习 · 计算机科学 2024-02-07 Xiaoxing Wang , Jiaxing Li , Chao Xue , Wei Liu , Weifeng Liu , Xiaokang Yang , Junchi Yan , Dacheng Tao