中文
相关论文

相关论文: Efficient Conditioning Why Pseudo Observation Batc…

200 篇论文

A body of work has been done to automate machine learning algorithm to highlight the importance of model choice. Automating the process of choosing the best forecasting model and its corresponding parameters can result to improve a wide…

机器学习 · 计算机科学 2021-09-02 Nadhir Hassen , Irina Rish

Building surrogate models is one common approach when we attempt to learn unknown black-box functions. Bayesian optimization provides a framework which allows us to build surrogate models based on sequential samples drawn from the function…

机器学习 · 计算机科学 2021-09-17 Hengrui Luo , James W. Demmel , Younghyun Cho , Xiaoye S. Li , Yang Liu

Bayesian optimization is a coherent, ubiquitous approach to decision-making under uncertainty, with applications including multi-arm bandits, active learning, and black-box optimization. Bayesian optimization selects decisions (i.e.…

机器学习 · 计算机科学 2023-12-13 Samuel Stanton , Wesley Maddox , Andrew Gordon Wilson

Bayesian optimization (BO) with Gaussian process (GP) surrogate models is a powerful black-box optimization method. Acquisition functions are a critical part of a BO algorithm as they determine how the new samples are selected. Some of the…

机器学习 · 计算机科学 2024-12-30 Jingyi Wang , Haowei Wang , Cosmin G. Petra , Nai-Yuan Chiang

Bayesian optimization (BO) methods often rely on the assumption that the objective function is well-behaved, but in practice, this is seldom true for real-world objectives even if noise-free observations can be collected. Common approaches,…

We consider an optimization problem of an expensive-to-evaluate black-box function, in which we can obtain noisy function values in parallel. For this problem, parallel Bayesian optimization (PBO) is a promising approach, which aims to…

机器学习 · 计算机科学 2026-03-13 Shuhei Sugiura , Ichiro Takeuchi , Shion Takeno

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

机器学习 · 计算机科学 2025-10-09 Akash Yadav , Ruda Zhang

The surrogate-assisted optimization algorithm is a promising approach for solving expensive multi-objective optimization problems. However, most existing surrogate-assisted multi-objective optimization algorithms have three main drawbacks:…

神经与进化计算 · 计算机科学 2018-11-06 Xi Lin , Hui-Ling Zhen , Zhenhua Li , Qingfu Zhang , Sam Kwong

Many control problems require repeated tuning and adaptation of controllers across distinct closed-loop tasks, where data efficiency and adaptability are critical. We propose a hierarchical Bayesian optimization (BO) framework that is…

系统与控制 · 电气工程与系统科学 2026-03-27 Sebastian Hirt , Lukas Theiner , Maik Pfefferkorn , Rolf Findeisen

Data-driven surrogate models offer quick approximations to complex numerical and experimental systems but typically lack uncertainty quantification, limiting their reliability in safety-critical applications. While Bayesian methods provide…

We developed a parallel Bayesian optimization algorithm for large eddy simulations. These simulations challenge optimization methods because they take hours or days to compute, and their objective function contains noise as turbulent…

流体动力学 · 物理学 2014-11-04 Chaitanya Talnikar , Patrick Blonigan , Julien Bodart , Qiqi Wang

Bayesian optimization has emerged as a prominent methodology for optimizing expensive black-box functions by leveraging Gaussian process surrogates, which focus on capturing the global characteristics of the objective function. However, in…

机器学习 · 计算机科学 2026-03-03 Qiyu Wei , Haowei Wang , Richard Allmendinger , Mauricio A. Álvarez

Choosing appropriate hyperparameters plays a crucial role in the success of neural networks as hyper-parameters directly control the behavior and performance of the training algorithms. To obtain efficient tuning, Bayesian optimization…

机器学习 · 统计学 2024-02-08 Jiazhao Zhang , Ying Hung , Chung-Ching Lin , Zicheng Liu

Faced with problems of increasing complexity, recent research in Bayesian Optimisation (BO) has focused on adapting deep probabilistic models as flexible alternatives to Gaussian Processes (GPs). In a similar vein, this paper investigates…

机器学习 · 计算机科学 2022-05-31 Alexandre Maraval , Matthieu Zimmer , Antoine Grosnit , Rasul Tutunov , Jun Wang , Haitham Bou Ammar

While Contrastive Learning (CL) has revolutionized self-supervised representation learning, its latent representations remain highly entangled and opaque, limiting their interpretability in safety-critical applications. We identify that a…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Peng Cui , Jiahao Zhang , Lijie Hu

The computational efficiency of approximate Bayesian computation (ABC) has been improved by using surrogate models such as Gaussian processes (GP). In one such promising framework the discrepancy between the simulated and observed data is…

机器学习 · 统计学 2020-08-07 Marko Järvenpää , Aki Vehtari , Pekka Marttinen

Bayesian optimization is a highly efficient approach to optimizing objective functions which are expensive to query. These objectives are typically represented by Gaussian process (GP) surrogate models which are easy to optimize and support…

机器学习 · 计算机科学 2024-05-09 Yucen Lily Li , Tim G. J. Rudner , Andrew Gordon Wilson

Parameter calibration is essential for reducing uncertainty and improving predictive fidelity in physics-based models, yet it is often limited by the high computational cost of model evaluations. Bayesian calibration methods provide a…

统计方法学 · 统计学 2026-01-21 Maike F. Holthuijzen , Atlanta Chakraborty , Elizabeth Krath , Tommie Catanach

Bayesian optimization has recently attracted the attention of the automatic machine learning community for its excellent results in hyperparameter tuning. BO is characterized by the sample efficiency with which it can optimize expensive…

机器学习 · 计算机科学 2017-07-19 Ruben Martinez-Cantin , Michael McCourt , Kevin Tee

The popularity of Bayesian optimization methods for efficient exploration of parameter spaces has lead to a series of papers applying Gaussian processes as surrogates in the optimization of functions. However, most proposed approaches only…

机器学习 · 统计学 2015-10-16 Javier González , Zhenwen Dai , Philipp Hennig , Neil D. Lawrence