中文
相关论文

相关论文: A Trust-Region Algorithm for Noisy Equality Constr…

200 篇论文

We consider an optimization problem of an expensive-to-evaluate black-box function, in which we can obtain noisy function values in parallel. For this problem, parallel Bayesian optimization (PBO) is a promising approach, which aims to…

机器学习 · 计算机科学 2026-03-13 Shuhei Sugiura , Ichiro Takeuchi , Shion Takeno

Bayesian optimization (BO) with Gaussian process (GP) surrogate models is a powerful black-box optimization method. Acquisition functions are a critical part of a BO algorithm as they determine how the new samples are selected. Some of the…

机器学习 · 计算机科学 2024-12-30 Jingyi Wang , Haowei Wang , Cosmin G. Petra , Nai-Yuan Chiang

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

机器学习 · 统计学 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan

Bayesian optimization (BO) is effective for expensive black-box problems but remains challenging in high dimensions. We propose NeST-BO, a curvature-aware local BO method that targets a (modified) Newton step by jointly learning gradient…

机器学习 · 计算机科学 2026-03-30 Wei-Ting Tang , Akshay Kudva , Joel A. Paulson

Bayesian optimization (BO) is a successful methodology to optimize black-box functions that are expensive to evaluate. While traditional methods optimize each black-box function in isolation, there has been recent interest in speeding up BO…

机器学习 · 统计学 2019-09-30 Valerio Perrone , Huibin Shen , Matthias Seeger , Cedric Archambeau , Rodolphe Jenatton

Bayesian Optimization (BO) machine learning method is increasingly used to guide experimental optimization tasks in materials science. To emulate the large number of input variables and noise-containing results in experimental materials…

We describe an iterative procedure for optimizing policies, with guaranteed monotonic improvement. By making several approximations to the theoretically-justified procedure, we develop a practical algorithm, called Trust Region Policy…

机器学习 · 计算机科学 2017-04-24 John Schulman , Sergey Levine , Philipp Moritz , Michael I. Jordan , Pieter Abbeel

We propose a novel algorithm, TR-SVR, for solving unconstrained stochastic optimization problems. This method builds on the trust-region framework, which effectively balances local and global exploration in optimization tasks. TR-SVR…

最优化与控制 · 数学 2024-12-03 Xinshou Zheng

Many real-world tasks require optimizing expensive black-box functions accessible only through noisy evaluations, a setting commonly addressed with Bayesian optimization (BO). While Bayesian neural networks (BNNs) have recently emerged as…

机器学习 · 计算机科学 2026-01-14 Farhad Mirkarimi

The problem of monotone submodular maximization has been studied extensively due to its wide range of applications. However, there are cases where one can only access the objective function in a distorted or noisy form because of the…

数据结构与算法 · 计算机科学 2022-10-24 Lingxiao Huang , Yuyi Wang , Chunxue Yang , Huanjian Zhou

Bayesian optimisation (BO) is widely used to optimise stochastic black box functions. While most BO approaches focus on optimising conditional expectations, many applications require risk-averse strategies and alternative criteria…

机器学习 · 统计学 2022-07-11 Victor Picheny , Henry Moss , Léonard Torossian , Nicolas Durrande

Bayesian optimization (BO) is a sequential approach for optimizing black-box objective functions using zeroth-order noisy observations. In BO, Gaussian processes (GPs) are employed as probabilistic surrogate models to estimate the objective…

机器学习 · 计算机科学 2025-04-02 Dongwon Kim , Matteo Zecchin , Sangwoo Park , Joonhyuk Kang , Osvaldo Simeone

We propose a novel constrained Bayesian Optimization (BO) algorithm optimizing the design process of Laterally-Diffused Metal-Oxide-Semiconductor (LDMOS) transistors while realizing a target Breakdown Voltage (BV). We convert the…

机器学习 · 计算机科学 2023-08-21 Ping-Ju Chuang , Ali Saadat , Sara Ghazvini , Hal Edwards , William G. Vandenberghe

A stochastic-gradient-based interior-point algorithm for minimizing a continuously differentiable objective function (that may be nonconvex) subject to bound constraints is presented, analyzed, and demonstrated through experimental results.…

最优化与控制 · 数学 2024-03-15 Frank E. Curtis , Vyacheslav Kungurtsev , Daniel P. Robinson , Qi Wang

Bayesian optimization (BO) is a popular approach for optimizing expensive-to-evaluate black-box objective functions. An important challenge in BO is its application to high-dimensional search spaces due in large part to the curse of…

机器学习 · 计算机科学 2025-05-27 Wei-Ting Tang , Joel A. Paulson

Bayesian optimisation is a popular method for efficient optimisation of expensive black-box functions. Traditionally, BO assumes that the search space is known. However, in many problems, this assumption does not hold. To this end, we…

机器学习 · 统计学 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Huong Ha , Svetha Venkatesh

Bayesian optimization is a powerful method for optimizing black-box functions with limited function evaluations. Recent works have shown that optimization in a latent space through deep generative models such as variational autoencoders…

机器学习 · 计算机科学 2023-11-21 Seunghun Lee , Jaewon Chu , Sihyeon Kim , Juyeon Ko , Hyunwoo J. Kim

Decentralized optimization is typically studied under the assumption of noise-free transmission. However, real-world scenarios often involve the presence of noise due to factors such as additive white Gaussian noise channels or…

最优化与控制 · 数学 2023-07-28 Suhail M. Shah , Raghu Bollapragada

There is a recent proliferation of research on the integration of machine learning and optimization. One expansive area within this research stream is predictive-model embedded optimization, which proposes the use of pre-trained predictive…

机器学习 · 计算机科学 2022-10-20 Chenbo Shi , Mohsen Emadikhiav , Leonardo Lozano , David Bergman

In this work we introduce the stochastic nonlinear constrained derivative-free optimization method (S)NOWPAC (Stochastic Nonlinear Optimization With Path-Augmented Constraints). The method extends the derivative-free optimizer NOWPAC to be…

最优化与控制 · 数学 2022-01-24 F. Menhorn , F. Augustin , H. -J. Bungartz , Y. M. Marzouk