English
Related papers

Related papers: Boosting Offline Optimizers with Surrogate Sensiti…

200 papers

When a black-box optimization objective can only be evaluated with costly or noisy measurements, most standard optimization algorithms are unsuited to find the optimal solution. Specialized algorithms that deal with exactly this situation…

Machine Learning · Computer Science 2021-06-11 Laurens Bliek , Sicco Verwer , Mathijs de Weerdt

Optimizing costly black-box functions within a constrained evaluation budget presents significant challenges in many real-world applications. Surrogate Optimization (SO) is a common resolution, yet its proprietary nature introduced by the…

Machine Learning · Computer Science 2024-10-21 Nazanin Nezami , Hadis Anahideh

Recent advances in batch (offline) reinforcement learning have shown promising results in learning from available offline data and proved offline reinforcement learning to be an essential toolkit in learning control policies in a model-free…

Machine Learning · Computer Science 2022-12-19 Ashish Kumar , Ilya Kuzovkin

This study proposes an adaptive data-driven hyperparameter tuning framework for black-box 3D LiDAR odometry algorithms. The proposed framework comprises offline parameter-error function modeling and online adaptive parameter selection. In…

Robotics · Computer Science 2021-07-12 Kenji Koide , Masashi Yokozuka , Shuji Oishi , Atsuhiko Banno

Offline policy optimization could have a large impact on many real-world decision-making problems, as online learning may be infeasible in many applications. Importance sampling and its variants are a commonly used type of estimator in…

Machine Learning · Computer Science 2022-07-05 Yao Liu , Yannis Flet-Berliac , Emma Brunskill

Given a prediction task, understanding when one can and cannot design a consistent convex surrogate loss, particularly a low-dimensional one, is an important and active area of machine learning research. The prediction task may be given as…

Machine Learning · Computer Science 2021-02-17 Jessie Finocchiaro , Rafael Frongillo , Bo Waggoner

Complex black-box predictive models may have high accuracy, but opacity causes problems like lack of trust, lack of stability, sensitivity to concept drift. On the other hand, interpretable models require more work related to feature…

Machine Learning · Computer Science 2019-03-01 Alicja Gosiewska , Aleksandra Gacek , Piotr Lubon , Przemyslaw Biecek

Adaptive experimental designs have gained increasing attention across a range of domains. In this paper, we propose a new methodological framework, surrogate-leveraged online adaptive causal inference (SLOACI), which integrates predictive…

Methodology · Statistics 2025-12-09 Yingying Fan , Zihan Wang , Waverly Wei

Recent Meta-Black-Box Optimization (MetaBBO) approaches have shown possibility of enhancing the optimization performance through learning meta-level policies to dynamically configure low-level optimizers. However, existing MetaBBO…

Machine Learning · Computer Science 2025-03-25 Zeyuan Ma , Zhiyang Huang , Jiacheng Chen , Zhiguang Cao , Yue-Jiao Gong

A surrogate-based topology optimisation algorithm for linear elastic structures under parametric loads and boundary conditions is proposed. Instead of learning the parametric solution of the state (and adjoint) problems or the optimisation…

Numerical Analysis · Mathematics 2025-11-04 Matteo Giacomini , Antonio Huerta

Nonlinear optimization-based control policies, such as those those arising in nonlinear Model Predictive Control, have seen remarkable success in recent years. These policies require solving computationally demanding nonlinear optimization…

Optimization and Control · Mathematics 2025-12-02 Riccardo Zuliani , Efe C. Balta , John Lygeros

Surrogate models are frequently employed as efficient substitutes for the costly execution of real-world processes. However, constructing a high-quality surrogate model often demands extensive data acquisition. A solution to this issue is…

Machine Learning · Computer Science 2025-05-05 Shuaiqun Pan , Diederick Vermetten , Manuel López-Ibáñez , Thomas Bäck , Hao Wang

In the continual effort to improve product quality and decrease operations costs, computational modeling is increasingly being deployed to determine feasibility of product designs or configurations. Surrogate modeling of these computer…

Machine Learning · Statistics 2021-11-10 Nathan Wycoff , Mickaël Binois , Robert B. Gramacy

We consider offline policy optimization (OPO) in contextual bandits, where one is given a fixed dataset of logged interactions. While pessimistic regularizers are typically used to mitigate distribution shift, prior implementations thereof…

Machine Learning · Computer Science 2023-10-27 Lequn Wang , Akshay Krishnamurthy , Aleksandrs Slivkins

Offline reinforcement learning enables agents to leverage large pre-collected datasets of environment transitions to learn control policies, circumventing the need for potentially expensive or unsafe online data collection. Significant…

Machine Learning · Computer Science 2022-03-17 Cong Lu , Philip J. Ball , Jack Parker-Holder , Michael A. Osborne , Stephen J. Roberts

Online Feedback Optimization uses optimization algorithms as dynamic systems to design optimal control inputs. The results obtained from Online Feedback Optimization depend on the setup of the chosen optimization algorithm. In this work we…

Optimization and Control · Mathematics 2025-03-11 Marta Zagorowska , Lars Imsland

e consider the experimental design problem in an online environment, an important practical task for reducing the variance of estimates in randomized experiments which allows for greater precision, and in turn, improved decision making. In…

Methodology · Statistics 2022-03-07 David Arbour , Drew Dimmery , Tung Mai , Anup Rao

The Area Under the Curve (AUC) is an important performance metric for classification tasks, particularly in class-imbalanced scenarios. However, minimizing the AUC presents significant challenges due to the non-convex and discontinuous…

Machine Learning · Computer Science 2025-10-27 JunRu Luo , Difei Cheng , Bo Zhang

In real case applications within the virtual prototyping process, it is not always possible to reduce the complexity of the physical models and to obtain numerical models which can be solved quickly. Usually, every single numerical…

Methodology · Statistics 2024-08-08 Thomas Most , Johannes Will

The increasing use of stochastic models for describing complex phenomena warrants surrogate models that capture the reference model characteristics at a fraction of the computational cost, foregoing potentially expensive Monte Carlo…

Machine Learning · Computer Science 2024-06-10 Neil Kichler , Sher Afghan , Uwe Naumann