中文
相关论文

相关论文: LAGO: A Local-Global Optimization Framework Combin…

200 篇论文

Real-world optimization problems often involve complex objective functions with costly evaluations. While Bayesian optimization (BO) with Gaussian processes is effective for these challenges, it suffers in high-dimensional spaces due to…

机器学习 · 计算机科学 2024-12-17 Nobuo Namura , Sho Takemori

Bayesian Optimisation (BO) is a state-of-the-art global optimisation technique for black-box problems where derivative information is unavailable, and sample efficiency is crucial. However, improving the general scalability of BO has proved…

最优化与控制 · 数学 2024-12-13 Luo Long , Coralia Cartis , Paz Fink Shustin

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

机器学习 · 统计学 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan

This paper deals with the identification of linear stochastic dynamical systems, where the unknowns include system coefficients and noise variances. Conventional approaches that rely on the maximum likelihood estimation (MLE) require…

机器学习 · 统计学 2025-08-18 Jinwen Xu , Qin Lu , Yaakov Bar-Shalom

Bayesian optimization has recently emerged as a popular method for the sample-efficient optimization of expensive black-box functions. However, the application to high-dimensional problems with several thousand observations remains…

机器学习 · 计算机科学 2020-02-26 David Eriksson , Michael Pearce , Jacob R Gardner , Ryan Turner , Matthias Poloczek

We introduce a novel policy learning method that integrates analytical gradients from differentiable environments with the Proximal Policy Optimization (PPO) algorithm. To incorporate analytical gradients into the PPO framework, we…

机器学习 · 计算机科学 2023-12-15 Sanghyun Son , Laura Yu Zheng , Ryan Sullivan , Yi-Ling Qiao , Ming C. Lin

Bayesian optimization is a popular and versatile approach that is well suited to solve challenging optimization problems. Their popularity comes from their effective minimization of expensive function evaluations, their capability to…

最优化与控制 · 数学 2026-05-14 André L. Marchildon , David W. Zingg

Bayesian optimization (BO) is a popular algorithm for solving challenging optimization tasks. It is designed for problems where the objective function is expensive to evaluate, perhaps not available in exact form, without gradient…

机器学习 · 统计学 2018-08-22 Umberto Noè , Dirk Husmeier

High-dimensional Bayesian optimization (BO) tasks such as molecular design often require 10,000 function evaluations before obtaining meaningful results. While methods like sparse variational Gaussian processes (SVGPs) reduce computational…

机器学习 · 计算机科学 2025-06-11 Natalie Maus , Kyurae Kim , Geoff Pleiss , David Eriksson , John P. Cunningham , Jacob R. Gardner

Optimization problems aim to find the optimal solution, which is becoming increasingly complex and difficult to solve. Traditional evolutionary optimization methods always overlook the granular characteristics of solution space. In the real…

机器学习 · 计算机科学 2025-02-19 Shuyin Xia , Xinyu Lin , Guan Wang , De-Gang Chen , Sen Zhao , Guoyin Wang , Jing Liang

Bayesian Optimization (BO) is a key methodology for accelerating molecular discovery by estimating the mapping from molecules to their properties while seeking the optimal candidate. Typically, BO iteratively updates a probabilistic…

机器学习 · 计算机科学 2025-12-17 Qi Chen , Fabio Ramos , Alán Aspuru-Guzik , Florian Shkurti

The Low Order-Value Optimization (LOVO) problem involves minimizing the minimum among a finite number of function values within a feasible set. LOVO has several practical applications such as robust parameter estimation, protein alignment,…

最优化与控制 · 数学 2025-11-27 Anderson E. Schwertner , Francisco N. C. Sobral

Bayesian optimization (BO) is a popular method to optimize costly black-box functions. While traditional BO optimizes each new target task from scratch, meta-learning has emerged as a way to leverage knowledge from related tasks to optimize…

机器学习 · 计算机科学 2024-07-01 Jiarong Pan , Stefan Falkner , Felix Berkenkamp , Joaquin Vanschoren

Bayesian optimization (BO) is a powerful framework for optimizing expensive black-box objectives, yet extending it to graph-structured domains remains challenging due to the discrete and combinatorial nature of graphs. Existing approaches…

机器学习 · 计算机科学 2025-11-12 Shu Hong , Yongsheng Mei , Mahdi Imani , Tian Lan

Many real-world optimisation problems such as hyperparameter tuning in machine learning or simulation-based optimisation can be formulated as expensive-to-evaluate black-box functions. A popular approach to tackle such problems is Bayesian…

机器学习 · 计算机科学 2021-05-28 Juan Ungredda , Juergen Branke

Bayesian optimization (BO) is a powerful paradigm for derivative-free global optimization of a black-box objective function (BOF) that is expensive to evaluate. However, the overhead of BO can still be prohibitive for problems with highly…

机器学习 · 计算机科学 2019-12-18 Bin Liu

Bayesian Optimization (BO) is a well-established method for addressing black-box optimization problems. In many real-world scenarios, optimization often involves multiple functions, emphasizing the importance of leveraging data and learned…

机器学习 · 计算机科学 2025-03-11 Khoa Nguyen , Viet Huynh , Binh Tran , Tri Pham , Tin Huynh , Thin Nguyen

In practice, objective functions of real-time control systems can have multiple local minimums or can dramatically change over the function space, making them hard to optimize. To efficiently optimize such systems, in this paper, we develop…

最优化与控制 · 数学 2022-01-26 Haowei Wang , Songhao Wang , Qun Meng , Szu Hui Ng

The advent of parameter-efficient fine-tuning methods has significantly reduced the computational burden of adapting large-scale pretrained models to diverse downstream tasks. However, existing approaches often struggle to achieve robust…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Haotian Zhang , Liu Liu , Baosheng Yu , Jiayan Qiu , Yanwei Ren , Xianglong Liu

Gradient-based trajectory optimization (GTO) has gained wide popularity for quadrotor trajectory replanning. However, it suffers from local minima, which is not only fatal to safety but also unfavorable for smooth navigation. In this paper,…

机器人学 · 计算机科学 2020-04-17 Boyu Zhou , Fei Gao , Jie Pan , Shaojie Shen