中文
相关论文

相关论文: LineWalker: Line Search for Black Box Derivative-F…

200 篇论文

Black-box policy optimization is a class of reinforcement learning algorithms that explores and updates the policies at the parameter level. This class of algorithms is widely applied in robotics with movement primitives or…

机器学习 · 计算机科学 2022-03-22 Marius Memmel , Puze Liu , Davide Tateo , Jan Peters

The predictive quality of machine learning models is typically measured in terms of their (approximate) expected prediction error or the so-called Area Under the Curve (AUC) for a particular data distribution. However, when the models are…

机器学习 · 计算机科学 2018-02-08 Hiva Ghanbari , Katya Scheinberg

Mixed-integer optimization is at the core of many online decision-making systems that demand frequent updates of decisions in real time. However, due to their combinatorial nature, mixed-integer linear programs (MILPs) can be difficult to…

最优化与控制 · 数学 2026-04-21 Shivi Dixit , Rishabh Gupta , Qi Zhang

Optimization algorithms appear in the core calculations of numerous Artificial Intelligence (AI) and Machine Learning methods, as well as Engineering and Business applications. Following recent works on the theoretical deficiencies of AI, a…

最优化与控制 · 数学 2024-10-29 Nikolaos P. Bakas , Vagelis Plevris , Andreas Langousis , Savvas A. Chatzichristofis

Surrogate modeling has become a valuable technique for black-box optimization tasks with expensive evaluation of the objective function. In this paper, we investigate the relationship between the predictive accuracy of surrogate models and…

神经与进化计算 · 计算机科学 2022-10-04 Zbyněk Pitra , Jan Koza , Jiří Tumpach , Martin Holeňa

This paper presents a novel methodology that uses surrogate models in the form of neural networks to reduce the computation time of simulation-based optimization of a reference trajectory. Simulation-based optimization is necessary when…

最优化与控制 · 数学 2023-03-31 Evelyn Ruff , Rebecca Russell , Matthew Stoeckle , Piero Miotto , Jonathan P. How

Optimizing the reliability and the robustness of a design is important but often unaffordable due to high sample requirements. Surrogate models based on statistical and machine learning methods are used to increase the sample efficiency.…

机器学习 · 统计学 2022-05-06 Can Bogoclu , Dirk Roos , Tamara Nestorović

Direct search methods represent a robust and reliable class of algorithms for solving black-box optimization problems. In this paper, we explore the application of those strategies to Riemannian optimization, wherein minimization is to be…

最优化与控制 · 数学 2022-02-23 Vyacheslav Kungurtsev , Francesco Rinaldi , Damiano Zeffiro

Multi-objective optimization is a crucial matter in computer systems design space exploration because real-world applications often rely on a trade-off between several objectives. Derivatives are usually not available or impractical to…

机器学习 · 计算机科学 2019-07-26 Luigi Nardi , David Koeplinger , Kunle Olukotun

In this paper, we consider the problem of minimizing a smooth function, given as finite sum of black-box functions, over a convex set. In order to advantageously exploit the structure of the problem, for instance when the terms of the…

最优化与控制 · 数学 2026-03-13 Francesco Cecere , Matteo Lapucci , Davide Pucci , Marco Sciandrone

This paper introduces a practical sampling method for training surrogate models in the context of uncertainty propagation. We propose a heuristic method to uniformly draw samples within highest density regions of the density given by the…

统计方法学 · 统计学 2025-09-15 Jocelyn Minini , Micha Wasem

This paper develops a surrogate model refinement approach for the simulation of dynamical systems and the solution of optimization problems governed by dynamical systems in which surrogates replace expensive-to-compute state- and…

最优化与控制 · 数学 2025-09-08 Jonathan R. Cangelosi , Matthias Heinkenschloss

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical…

机器学习 · 计算机科学 2024-07-18 Hwanwoo Kim , Daniel Sanz-Alonso

A surrogate model approximates the outputs of a solver of Partial Differential Equations (PDEs) with a low computational cost. In this article, we propose a method to build learning-based surrogates in the context of parameterized PDEs,…

机器学习 · 计算机科学 2024-06-28 Alejandro Ribés , Nawfal Benchekroun , Théo Delagnes

We propose a novel learning-based surrogate data assimilation (DA) model for efficient state estimation in a limited area. Our model employs a feedforward neural network for online computation, eliminating the need for integrating…

数值分析 · 数学 2023-07-17 Wei Kang , Liang Xu , Hong Zhou

Optimization problems involving mixed variables (i.e., variables of numerical and categorical nature) can be challenging to solve, especially in the presence of mixed-variable constraints. Moreover, when the objective function is the result…

最优化与控制 · 数学 2024-12-12 Mengjia Zhu , Alberto Bemporad

In materials informatics, searching for chemical materials with desired properties is challenging due to the vastness of the chemical space. Moreover, the high cost of evaluating properties necessitates a search with a few clues. In…

量子物理 · 物理学 2023-12-18 Mikiya Doi , Yoshihiro Nakao , Takuro Tanaka , Masami Sako , Masayuki Ohzeki

We introduce a method for the nonlinear dimension reduction of a high-dimensional function $u:\mathbb{R}^d\rightarrow\mathbb{R}$, $d\gg1$. Our objective is to identify a nonlinear feature map $g:\mathbb{R}^d\rightarrow\mathbb{R}^m$, with a…

数值分析 · 数学 2022-07-21 Daniele Bigoni , Youssef Marzouk , Clémentine Prieur , Olivier Zahm

Global optimization of large-scale, complex systems such as multi-physics black-box simulations and real-world industrial systems is important but challenging. This work presents a novel Surrogate-Based Optimization framework based on…

机器学习 · 计算机科学 2026-01-13 Maaz Ahmad , Iftekhar A. Karimi

Global optimization of expensive functions has important applications in physical and computer experiments. It is a challenging problem to develop efficient optimization scheme, because each function evaluation can be costly and the…

机器学习 · 统计学 2020-01-22 Ray-Bing Chen , Yuan Wang , C. F. Jeff Wu