中文
相关论文

相关论文: Efficient Contextual Preferential Bayesian Optimiz…

200 篇论文

Bayesian optimisation is a popular technique for hyperparameter learning but typically requires initial exploration even in cases where similar prior tasks have been solved. We propose to transfer information across tasks using learnt…

机器学习 · 统计学 2019-05-28 Ho Chung Leon Law , Peilin Zhao , Lucian Chan , Junzhou Huang , Dino Sejdinovic

Causal discovery is crucial for understanding complex systems and informing decisions. While observational data can uncover causal relationships under certain assumptions, it often falls short, making active interventions necessary. Current…

机器学习 · 计算机科学 2024-06-18 Yuxuan Wang , Mingzhou Liu , Xinwei Sun , Wei Wang , Yizhou Wang

Estimating the parameters of mathematical models is a common problem in almost all branches of science. However, this problem can prove notably difficult when processes and model descriptions become increasingly complex and an explicit…

机器学习 · 统计学 2024-02-09 Stefan T. Radev , Ulf K. Mertens , Andreas Voss , Lynton Ardizzone , Ullrich Köthe

We study a generalization of classical active learning to real-world settings with concrete prediction targets where sampling is restricted to an accessible region of the domain, while prediction targets may lie outside this region. We…

机器学习 · 计算机科学 2025-02-11 Jonas Hübotter , Bhavya Sukhija , Lenart Treven , Yarden As , Andreas Krause

We introduce a unified framework for contextual and causal Bayesian optimisation, which aims to design intervention policies maximising the expectation of a target variable. Our approach leverages both observed contextual information and…

机器学习 · 计算机科学 2026-02-04 Vahan Arsenyan , Antoine Grosnit , Haitham Bou-Ammar , Arnak Dalalyan

Bayesian optimization (BO) with Gaussian processes (GP) as surrogate models is widely used to optimize analytically unknown and expensive-to-evaluate functions. In this paper, we propose Prior-mean-RObust Bayesian Optimization (PROBO) that…

人工智能 · 计算机科学 2021-11-17 Julian Rodemann , Thomas Augustin

Bayesian optimization is a sample-efficient approach to global optimization that relies on theoretically motivated value heuristics (acquisition functions) to guide its search process. Fully maximizing acquisition functions produces the…

机器学习 · 统计学 2018-12-04 James T. Wilson , Frank Hutter , Marc Peter Deisenroth

Bayesian optimization (BO) has become a popular strategy for global optimization of many expensive real-world functions. Contrary to a common belief that BO is suited to optimizing black-box functions, it actually requires domain knowledge…

The classical approach to inverse problems is based on the optimization of a misfit function. Despite its computational appeal, such an approach suffers from many shortcomings, e.g., non-uniqueness of solutions, modeling prior knowledge,…

机器学习 · 统计学 2014-10-22 Panagiotis Tsilifis , Ilias Bilionis , Ioannis Katsounaros , Nicholas Zabaras

Bayesian Optimization, leveraging Gaussian process models, has proven to be a powerful tool for minimizing expensive-to-evaluate objective functions by efficiently exploring the search space. Extensions such as constrained Bayesian…

统计计算 · 统计学 2025-06-03 Yezhuo Li , Qiong Zhang , Madhura Limaye , Gang Li

Implicit stochastic models, where the data-generation distribution is intractable but sampling is possible, are ubiquitous in the natural sciences. The models typically have free parameters that need to be inferred from data collected in…

机器学习 · 统计学 2020-08-17 Steven Kleinegesse , Michael U. Gutmann

Model-based approaches bear great promise for decision making of agents interacting with the physical world. In the context of spatial environments, different types of problems such as localisation, mapping, navigation or autonomous…

Bayesian optimisation has proven to be a powerful tool for expensive global black-box optimisation problems. In this paper, we propose new Bayesian optimisation variants of the popular Knowledge Gradient acquisition functions for problems…

机器学习 · 计算机科学 2025-12-22 Xietao Wang Lin , Juan Ungredda , Max Butler , James Town , Alma Rahat , Hemant Singh , Juergen Branke

Bayesian Optimization aims at optimizing an unknown non-convex/concave function that is costly to evaluate. We are interested in application scenarios where concurrent function evaluations are possible. Under such a setting, BO could choose…

人工智能 · 计算机科学 2012-05-02 Javad Azimi , Ali Jalali , Xiaoli Fern

Bayesian optimization (BO) is a widely-used method for optimizing expensive (to evaluate) problems. At the core of most BO methods is the modeling of the objective function using a Gaussian Process (GP) whose covariance is selected from a…

Bayesian optimisation presents a sample-efficient methodology for global optimisation. Within this framework, a crucial performance-determining subroutine is the maximisation of the acquisition function, a task complicated by the fact that…

Bayesian optimization is popular for optimizing time-consuming black-box objectives. Nonetheless, for hyperparameter tuning in deep neural networks, the time required to evaluate the validation error for even a few hyperparameter settings…

机器学习 · 计算机科学 2019-03-13 Jian Wu , Saul Toscano-Palmerin , Peter I. Frazier , Andrew Gordon Wilson

Robot skills systems are meant to reduce robot setup time for new manufacturing tasks. Yet, for dexterous, contact-rich tasks, it is often difficult to find the right skill parameters. One strategy is to learn these parameters by allowing…

机器人学 · 计算机科学 2022-08-03 Matthias Mayr , Carl Hvarfner , Konstantinos Chatzilygeroudis , Luigi Nardi , Volker Krueger

A salient approach to interpretable machine learning is to restrict modeling to simple models. In the Bayesian framework, this can be pursued by restricting the model structure and prior to favor interpretable models. Fundamentally,…

机器学习 · 计算机科学 2020-09-08 Homayun Afrabandpey , Tomi Peltola , Juho Piironen , Aki Vehtari , Samuel Kaski

A recent development in Bayesian optimization is the use of local optimization strategies, which can deliver strong empirical performance on high-dimensional problems compared to traditional global strategies. The "folk wisdom" in the…

机器学习 · 计算机科学 2024-03-12 Kaiwen Wu , Kyurae Kim , Roman Garnett , Jacob R. Gardner