English
Related papers

Related papers: Offline Model-Based Optimization: Comprehensive Re…

200 papers

AI-assisted molecular optimization is a very active research field as it is expected to provide the next-generation drugs and molecular materials. An important difficulty is that the properties to be optimized rely on costly evaluations.…

Machine Learning · Computer Science 2025-05-19 Jules Leguy , Thomas Cauchy , Beatrice Duval , Benoit Da Mota

Offline reinforcement learning (RL) faces a significant challenge of distribution shift. Model-free offline RL penalizes the Q value for out-of-distribution (OOD) data or constrains the policy closed to the behavior policy to tackle this…

Machine Learning · Computer Science 2024-04-18 Xiao-Yin Liu , Xiao-Hu Zhou , Guotao Li , Hao Li , Mei-Jiang Gui , Tian-Yu Xiang , De-Xing Huang , Zeng-Guang Hou

Derivative-Free Optimization (DFO) involves methods that rely solely on evaluations of the objective function. One of the earliest strategies for designing DFO methods is to adapt first-order methods by replacing gradients with…

Optimization and Control · Mathematics 2025-02-12 Timothé Taminiau , Estelle Massart , Geovani Nunes Grapiglia

We consider the problem of optimizing expensive black-box functions over high-dimensional combinatorial spaces which arises in many science, engineering, and ML applications. We use Bayesian Optimization (BO) and propose a novel surrogate…

Machine Learning · Computer Science 2023-03-06 Aryan Deshwal , Sebastian Ament , Maximilian Balandat , Eytan Bakshy , Janardhan Rao Doppa , David Eriksson

In this paper, we develop a unified machine learning (ML) approach to predict high-quality solutions for single-machine scheduling problems with a non-decreasing min-sum objective function with or without release times. Our ML approach is…

Optimization and Control · Mathematics 2025-01-09 Anbang Liu , Zhi-Long Chen , Jinyang Jiang , Xi Chen

Design optimization under uncertainty is notoriously difficult when the objective function is expensive to evaluate. State-of-the-art techniques, e.g, stochastic optimization or sampling average approximation, fail to learn exploitable…

Optimization and Control · Mathematics 2019-06-20 Piyush Pandita , Ilias Bilionis , Jitesh Panchal

Explainable AI is a crucial component for edge services, as it ensures reliable decision making based on complex AI models. Surrogate models are a prominent approach of XAI where human-interpretable models, such as a linear regression…

Machine Learning · Computer Science 2025-03-12 Foivos Charalampakos , Thomas Tsouparopoulos , Iordanis Koutsopoulos

Many control problems require repeated tuning and adaptation of controllers across distinct closed-loop tasks, where data efficiency and adaptability are critical. We propose a hierarchical Bayesian optimization (BO) framework that is…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Sebastian Hirt , Lukas Theiner , Maik Pfefferkorn , Rolf Findeisen

Reliability-based design optimization (RBDO) is an active field of research with an ever increasing number of contributions. Numerous methods have been proposed for the solution of RBDO, a complex problem that combines optimization and…

Methodology · Statistics 2019-01-11 M. Moustapha , B. Sudret

Optimizing costly black-box functions within a constrained evaluation budget presents significant challenges in many real-world applications. Surrogate Optimization (SO) is a common resolution, yet its proprietary nature introduced by the…

Machine Learning · Computer Science 2024-10-21 Nazanin Nezami , Hadis Anahideh

The optimization of expensive black-box functions is ubiquitous in science and engineering. A common solution to this problem is Bayesian optimization (BO), which is generally comprised of two components: (i) a surrogate model and (ii) an…

A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization. Bayesian optimization (BO) is a powerful tool that models and optimizes such…

Machine Learning · Computer Science 2023-02-14 Tianyi Bai , Yang Li , Yu Shen , Xinyi Zhang , Wentao Zhang , Bin Cui

Optimization problems with nonlinear cost functions and combinatorial constraints appear in many real-world applications but remain challenging to solve efficiently compared to their linear counterparts. To bridge this gap, we propose…

Machine Learning · Computer Science 2023-07-20 Aaron Ferber , Taoan Huang , Daochen Zha , Martin Schubert , Benoit Steiner , Bistra Dilkina , Yuandong Tian

Computational models in fields such as computational neuroscience are often evaluated via stochastic simulation or numerical approximation. Fitting these models implies a difficult optimization problem over complex, possibly noisy parameter…

Machine Learning · Statistics 2017-11-03 Luigi Acerbi , Wei Ji Ma

Evaluating and optimizing policies in the presence of unobserved confounders is a problem of growing interest in offline reinforcement learning. Using conventional methods for offline RL in the presence of confounding can not only lead to…

Machine Learning · Statistics 2023-11-08 Chinmaya Kausik , Yangyi Lu , Kevin Tan , Maggie Makar , Yixin Wang , Ambuj Tewari

Consider the following instance of the Offline Meta Reinforcement Learning (OMRL) problem: given the complete training logs of $N$ conventional RL agents, trained on $N$ different tasks, design a meta-agent that can quickly maximize reward…

Machine Learning · Computer Science 2021-02-15 Ron Dorfman , Idan Shenfeld , Aviv Tamar

Machine-learning (ML) parameterizations of subgrid processes (here of turbulence, convection, and radiation) may one day replace conventional parameterizations by emulating high-resolution physics without the cost of explicit simulation.…

Atmospheric and Oceanic Physics · Physics 2024-12-19 Jerry Lin , Sungduk Yu , Liran Peng , Tom Beucler , Eliot Wong-Toi , Zeyuan Hu , Pierre Gentine , Margarita Geleta , Mike Pritchard

Bayesian optimization is a highly efficient approach to optimizing objective functions which are expensive to query. These objectives are typically represented by Gaussian process (GP) surrogate models which are easy to optimize and support…

Machine Learning · Computer Science 2024-05-09 Yucen Lily Li , Tim G. J. Rudner , Andrew Gordon Wilson

Bayesian optimization (BO) is a global optimization strategy designed to find the minimum of an expensive black-box function, typically defined on a compact subset of $\mathcal{R}^d$, by using a Gaussian process (GP) as a surrogate model…

Machine Learning · Statistics 2018-09-24 Eero Siivola , Aki Vehtari , Jarno Vanhatalo , Javier González , Michael Riis Andersen

Bayesian optimization (BO) has demonstrated potential for optimizing control performance in data-limited settings, especially for systems with unknown dynamics or unmodeled performance objectives. The BO algorithm efficiently trades-off…

Machine Learning · Computer Science 2022-11-02 Ankush Chakrabarty