中文
相关论文

相关论文: Uncertainty-Aware Mixed-Variable Machine Learning …

200 篇论文

Bayesian optimization (BO) is a widely-used method for optimizing expensive (to evaluate) problems. At the core of most BO methods is the modeling of the objective function using a Gaussian Process (GP) whose covariance is selected from a…

Bayesian optimization (BO) is a sample-efficient method and has been widely used for optimizing expensive black-box functions. Recently, there has been a considerable interest in BO literature in optimizing functions that are affected by…

机器学习 · 计算机科学 2023-12-22 Xiaobin Huang , Lei Song , Ke Xue , Chao Qian

This paper presents a new type of hybrid model for Bayesian optimization (BO) adept at managing mixed variables, encompassing both quantitative (continuous and integer) and qualitative (categorical) types. Our proposed new hybrid models…

机器学习 · 计算机科学 2024-01-22 Hengrui Luo , Younghyun Cho , James W. Demmel , Xiaoye S. Li , Yang Liu

It is useful to estimate the expected predictive performance of models planned to be used for prediction. We focus on leave-one-out cross-validation (LOO-CV), which has become a popular method for estimating predictive performance of…

统计方法学 · 统计学 2025-10-29 Tuomas Sivula , Måns Magnusson , Asael Alonzo Matamoros , Aki Vehtari

Bayesian optimization (BO) is a sample efficient approach to automatically tune the hyperparameters of machine learning models. In practice, one frequently has to solve similar hyperparameter tuning problems sequentially. For example, one…

机器学习 · 计算机科学 2021-02-26 Samuel Horváth , Aaron Klein , Peter Richtárik , Cédric Archambeau

Many real-world optimisation problems are defined over both categorical and continuous variables, yet efficient optimisation methods such asBayesian Optimisation (BO) are not designed tohandle such mixed-variable search spaces. Recent…

机器学习 · 统计学 2022-02-18 Yan Zuo , Amir Dezfouli , Iadine Chades , David Alexander , Benjamin Ward Muir

We present a scale-bridging approach based on a multi-fidelity (MF) machine-learning (ML) framework leveraging Gaussian processes (GP) to fuse atomistic computational model predictions across multiple levels of fidelity. Through the…

计算物理 · 物理学 2020-08-06 Anh Tran , Julien Tranchida , Tim Wildey , Aidan P. Thompson

Material flow analyses (MFAs) are powerful tools for highlighting resource efficiency opportunities in supply chains. MFAs are often represented as directed graphs, with nodes denoting processes and edges representing mass flows. However,…

应用统计 · 统计学 2026-04-08 Jiankan Liao , Xun Huan , Daniel Cooper

Design optimization of engineering systems with multiple competing objectives is a painstakingly tedious process especially when the objective functions are expensive-to-evaluate computer codes with parametric uncertainties. The…

最优化与控制 · 数学 2019-06-20 Piyush Pandita , Ilias Bilionis , Jitesh Panchal , B. P. Gautham , Amol Joshi , Pramod Zagade

The inability of artificial neural networks to assess the uncertainty of their predictions is an impediment to their widespread use. We distinguish two types of learnable uncertainty: model uncertainty due to a lack of training data and…

机器学习 · 计算机科学 2022-06-14 Hans Weytjens , Jochen De Weerdt

Bayesian optimization (BO) is an effective approach to optimize expensive black-box functions, that seeks to trade-off between exploitation (selecting parameters where the maximum is likely) and exploration (selecting parameters where we…

机器学习 · 统计学 2021-10-19 Tristan Fauvel , Matthew Chalk

Modern scientific and engineering design increasingly involves distributed optimization, where agents such as laboratories, simulations, or industrial partners pursue related goals under differing conditions. These agents often face…

机器学习 · 统计学 2025-10-21 Zihan Wang , Yi-Ping Chen , Tuba Dolar , Wei Chen

Automatic Machine Learning (Auto-ML) systems tackle the problem of automating the design of prediction models or pipelines for data science. In this paper, we present Lifelong Bayesian Optimization (LBO), an online, multitask Bayesian…

机器学习 · 统计学 2019-06-24 Yao Zhang , James Jordon , Ahmed M. Alaa , Mihaela van der Schaar

Material flow analyses (MFAs) provide insight into supply chain level opportunities for resource efficiency. MFAs can be represented as networks with nodes that represent materials, processes, sectors or locations. MFA network structure…

应用统计 · 统计学 2025-05-08 Jiankan Liao , Xun Huan , Daniel Cooper

Bayesian Optimization (BO) is a standard tool for hyperparameter tuning thanks to its sample efficiency on expensive black-box functions. While most BO pipelines begin with uniform random initialization, default hyperparameter values…

机器学习 · 计算机科学 2026-02-10 Nicolás Villagrán Prieto , Eduardo C. Garrido-Merchán

In chemistry, deep neural network models have been increasingly utilized in a variety of applications such as molecular property predictions, novel molecule designs, and planning chemical reactions. Despite the rapid increase in the use of…

化学物理 · 物理学 2019-05-17 Seongok Ryu , Yongchan Kwon , Woo Youn Kim

The performance of deep (reinforcement) learning systems crucially depends on the choice of hyperparameters. Their tuning is notoriously expensive, typically requiring an iterative training process to run for numerous steps to convergence.…

机器学习 · 计算机科学 2021-01-19 Vu Nguyen , Sebastian Schulze , Michael A Osborne

There are a lot of real-world black-box optimization problems that need to optimize multiple criteria simultaneously. However, in a multi-objective optimization (MOO) problem, identifying the whole Pareto front requires the prohibitive…

Bayesian Optimization (BO) is a class of black-box, surrogate-based heuristics that can efficiently optimize problems that are expensive to evaluate, and hence admit only small evaluation budgets. BO is particularly popular for solving…

机器学习 · 计算机科学 2024-06-25 Maria Laura Santoni , Elena Raponi , Renato De Leone , Carola Doerr

The accuracy of some density functional (DF) models, widely used in material science, depends on empirical or free parameters which are commonly tuned using reference physical properties. The optimal value of the free parameters is…

计算物理 · 物理学 2020-07-01 Rodrigo A. Vargas-Hernández