中文
相关论文

相关论文: LineWalker: Line Search for Black Box Derivative-F…

200 篇论文

Studying complex phenomena in detail by performing real experiments is often an unfeasible task. Virtual experiments using simulations are usually used to support the development process. However, numerical simulations are limited by their…

最优化与控制 · 数学 2022-11-17 Pietro Lualdi , Ralf Sturm , Tjark Siefkes

Offline optimization has recently emerged as an increasingly popular approach to mitigate the prohibitively expensive cost of online experimentation. The key idea is to learn a surrogate of the black-box function that underlines the target…

机器学习 · 计算机科学 2025-03-07 Manh Cuong Dao , Phi Le Nguyen , Thao Nguyen Truong , Trong Nghia Hoang

In this paper, a new sequential surrogate-based optimization (SSBO) algorithm is developed, which aims to improve the global search ability and local search efficiency for the global optimization of expensive black-box models. The proposed…

机器学习 · 统计学 2018-11-30 Chunlin Gong , Xu Li , Hua Su , Jinlei Guo , Liangxian Gu

Bayesian optimization (BO) is an effective method of finding the global optima of black-box functions. Recently BO has been applied to neural architecture search and shows better performance than pure evolutionary strategies. All these…

机器学习 · 计算机科学 2019-05-16 Lizheng Ma , Jiaxu Cui , Bo Yang

Structured optimization problems are ubiquitous in fields like data science and engineering. The goal in structured optimization is using a prescribed set of points, called atoms, to build up a solution that minimizes or maximizes a given…

最优化与控制 · 数学 2021-01-14 Andrea Cristofari , Francesco Rinaldi

The optimization of expensive black-box functions is ubiquitous in science and engineering. A common solution to this problem is Bayesian optimization (BO), which is generally comprised of two components: (i) a surrogate model and (ii) an…

In this work we consider unconstrained optimization problems. The objective function is known through a zeroth order stochastic oracle that gives an estimate of the true objective function. To solve these problems, we propose a…

最优化与控制 · 数学 2025-08-04 Alberto De Santis , Giampaolo Liuzzi , Stefano Lucidi

We are interested in derivative-free optimization of high-dimensional functions. The sample complexity of existing methods is high and depends on problem dimensionality, unlike the dimensionality-independent rates of first-order methods.…

机器学习 · 计算机科学 2020-04-28 Ozan Sener , Vladlen Koltun

Surrogate models for computational simulations are input-output approximations that allow computationally intensive analyses, such as uncertainty propagation and inference, to be performed efficiently. When a simulation output does not…

计算工程、金融与科学 · 计算机科学 2014-08-05 Alex A. Gorodetsky , Youssef M. Marzouk

Offline optimization is a fundamental challenge in science and engineering, where the goal is to optimize black-box functions using only offline datasets. This setting is particularly relevant when querying the objective function is…

机器学习 · 计算机科学 2026-01-07 Minsu Kim , Jiayao Gu , Ye Yuan , Taeyoung Yun , Zixuan Liu , Yoshua Bengio , Can Chen

We propose an extension of Thompson sampling to optimization problems over function spaces where the objective is a known functional of an unknown operator's output. We assume that queries to the operator (such as running a high-fidelity…

机器学习 · 统计学 2026-01-21 Rafael Oliveira , Xuesong Wang , Kian Ming A. Chai , Edwin V. Bonilla

We consider the problem of offline black-box optimization, where the goal is to discover optimal designs (e.g., molecules or materials) from past experimental data. A key challenge in this setting is data scarcity: in many scientific…

机器学习 · 计算机科学 2026-05-22 Azza Fadhel , The Hung Tran , Trong Nghia Hoang , Jana Doppa

Spatial prediction refers to the estimation of unobserved values from spatially distributed observations. Although recent advances have improved the capacity to model diverse observation types, adoption in practice remains limited in…

机器学习 · 统计学 2025-10-10 Yuta Shikuri , Hironori Fujisawa

Offline optimization is an emerging problem in many experimental engineering domains including protein, drug or aircraft design, where online experimentation to collect evaluation data is too expensive or dangerous. To avoid that, one has…

机器学习 · 计算机科学 2024-05-10 Yassine Chemingui , Aryan Deshwal , Trong Nghia Hoang , Janardhan Rao Doppa

AI-assisted molecular optimization is a very active research field as it is expected to provide the next-generation drugs and molecular materials. An important difficulty is that the properties to be optimized rely on costly evaluations.…

机器学习 · 计算机科学 2025-05-19 Jules Leguy , Thomas Cauchy , Beatrice Duval , Benoit Da Mota

Model-based methods are popular in derivative-free optimization (DFO). In most of them, a single model function is built to approximate the objective function. This is generally based on the assumption that the objective function is one…

最优化与控制 · 数学 2023-01-04 Yiwen Chen , Gabriel Jarry-Bolduc , Warren Hare

Bayesian Optimization (BO) is a powerful method for optimizing black-box functions by combining prior knowledge with ongoing function evaluations. BO constructs a probabilistic surrogate model of the objective function given the covariates,…

机器学习 · 统计学 2025-08-26 Roi Naveiro , Becky Tang

Parametric shape optimization aims at minimizing an objective function f(x) where x are CAD parameters. This task is difficult when f is the output of an expensive-to-evaluate numerical simulator and the number of CAD parameters is large.…

机器学习 · 统计学 2021-05-06 David Gaudrie , Rodolphe Le Riche , Victor Picheny , Benoit Enaux , Vincent Herbert

Optimization problems with nonlinear cost functions and combinatorial constraints appear in many real-world applications but remain challenging to solve efficiently compared to their linear counterparts. To bridge this gap, we propose…

机器学习 · 计算机科学 2023-07-20 Aaron Ferber , Taoan Huang , Daochen Zha , Martin Schubert , Benoit Steiner , Bistra Dilkina , Yuandong Tian

Black-box optimization (BBO) can be used to optimize functions whose analytic form is unknown. A common approach to realising BBO is to learn a surrogate model which approximates the target black-box function which can then be solved via…

机器学习 · 计算机科学 2023-02-10 Jonas Nüßlein , Christoph Roch , Thomas Gabor , Jonas Stein , Claudia Linnhoff-Popien , Sebastian Feld