English
Related papers

Related papers: Extending classical surrogate modelling to high-di…

200 papers

Explainability of black-box machine learning models is crucial, in particular when deployed in critical applications such as medicine or autonomous cars. Existing approaches produce explanations for the predictions of models, however, how…

Machine Learning · Computer Science 2021-11-18 Jonas Schulz , Rafael Poyiadzi , Raul Santos-Rodriguez

In physics and engineering, many processes are modeled using non-differentiable black-box simulators, making the optimization of such functions particularly challenging. To address such cases, inspired by the Gradient Theorem, we propose…

Prediction+optimization is a common real-world paradigm where we have to predict problem parameters before solving the optimization problem. However, the criteria by which the prediction model is trained are often inconsistent with the goal…

Machine Learning · Computer Science 2021-11-23 Kai Yan , Jie Yan , Chuan Luo , Liting Chen , Qingwei Lin , Dongmei Zhang

Understanding structure-property relations is essential to optimally design materials for specific applications. Two-scale simulations are often employed to analyze the effect of the microstructure on a component's macroscopic properties.…

Computational Engineering, Finance, and Science · Computer Science 2022-10-25 Theron Guo , Francesco A. B. Silva , Ondřej Rokoš , Karen Veroy

In this paper, a new sequential surrogate-based optimization (SSBO) algorithm is developed, which aims to improve the global search ability and local search efficiency for the global optimization of expensive black-box models. The proposed…

Machine Learning · Statistics 2018-11-30 Chunlin Gong , Xu Li , Hua Su , Jinlei Guo , Liangxian Gu

Convection-dominated problems are known for their slow Kolmogorov $n$-width decays and are challenging for model order reduction (MOR). In this work, we propose a hybrid surrogate modeling approach and a non-intrusive variant that overcome…

Dynamical Systems · Mathematics 2026-05-29 Lihong Feng , Ali Hassan , Shuwen Sun

The vision of personalized medicine is to identify interventions that maintain or restore a person's health based on their individual biology. Medical digital twins, computational models that integrate a wide range of health-related data…

Quantitative Methods · Quantitative Biology 2025-10-21 Luis L. Fonseca , Lucas Böttcher , Borna Mehrad , Reinhard C. Laubenbacher

Surrogate modeling is of great practical significance for parametric differential equation systems. In contrast to classical numerical methods, using physics-informed deep learning methods to construct simulators for such systems is a…

Numerical Analysis · Mathematics 2025-01-03 Xili Wang , Kejun Tang , Jiayu Zhai , Xiaoliang Wan , Chao Yang

The growing demand for energy-efficient, high-performance AI systems has led to increased attention on alternative computing platforms (e.g., photonic, neuromorphic) due to their potential to accelerate learning and inference. However,…

Machine Learning · Computer Science 2026-05-05 Andrei Chertkov , Artem Basharin , Mikhail Saygin , Evgeny Frolov , Stanislav Straupe , Ivan Oseledets

Highly regulated industries, like banking and insurance, ask for transparent decision-making algorithms. At the same time, competitive markets are pushing for the use of complex black box models. We therefore present a procedure to develop…

Machine Learning · Statistics 2020-12-11 Roel Henckaerts , Katrien Antonio , Marie-Pier Côté

We present a novel physics-constrained polynomial chaos expansion as a surrogate modeling method capable of performing both scientific machine learning (SciML) and uncertainty quantification (UQ) tasks. The proposed method possesses a…

Machine Learning · Statistics 2024-05-14 Himanshu Sharma , Lukáš Novák , Michael D. Shields

The active learning (AL) technique, one of the state-of-the-art methods for constructing surrogate models, has shown high accuracy and efficiency in forward uncertainty quantification (UQ) analysis. This paper provides a comprehensive study…

Methodology · Statistics 2024-04-12 Maijia Su , Ziqi Wang , Oreste Salvatore Bursi , Marco Broccardo

Given a prediction task, understanding when one can and cannot design a consistent convex surrogate loss, particularly a low-dimensional one, is an important and active area of machine learning research. The prediction task may be given as…

Machine Learning · Computer Science 2021-02-17 Jessie Finocchiaro , Rafael Frongillo , Bo Waggoner

Optimizing the reliability and the robustness of a design is important but often unaffordable due to high sample requirements. Surrogate models based on statistical and machine learning methods are used to increase the sample efficiency.…

Machine Learning · Statistics 2022-05-06 Can Bogoclu , Dirk Roos , Tamara Nestorović

In the framework of reduced basis methods, we recently introduced a new certified hierarchical and adaptive surrogate model, which can be used for efficient approximation of input-output maps that are governed by parametrized partial…

Numerical Analysis · Mathematics 2023-03-01 Tizian Wenzel , Bernard Haasdonk , Hendrik Kleikamp , Mario Ohlberger , Felix Schindler

Risk modeling with EHR data is challenging due to a lack of direct observations on the disease outcome, and the high dimensionality of the candidate predictors. In this paper, we develop a surrogate assisted semi-supervised-learning (SAS)…

Statistics Theory · Mathematics 2021-05-05 Jue Hou , Zijian Guo , Tianxi Cai

The widespread integration of deep neural networks in developing data-driven surrogate models for high-fidelity simulations of complex physical systems highlights the critical necessity for robust uncertainty quantification techniques and…

Computational Engineering, Finance, and Science · Computer Science 2024-05-15 Pratyush Kumar Singh , Kathryn A. Farrell-Maupin , Danial Faghihi

The availability of fast to evaluate and reliable predictive models is highly relevant in multi-query scenarios where evaluating some quantities in real, or near-real-time becomes crucial. As a result, reduced-order modelling techniques…

Computation · Statistics 2021-08-04 Aarón Villanueva , Martin Beroiz , Juan Cabral , Martin Chalela , Mariano Dominguez

An established way to improve the transferability of black-box evasion attacks is to craft the adversarial examples on an ensemble-based surrogate to increase diversity. We argue that transferability is fundamentally related to uncertainty.…

Machine Learning · Computer Science 2022-06-22 Martin Gubri , Maxime Cordy , Mike Papadakis , Yves Le Traon , Koushik Sen

Surrogate models are often used as computationally efficient approximations to complex simulation models, enabling tasks such as solving inverse problems, sensitivity analysis, and probabilistic forward predictions, which would otherwise be…

Machine Learning · Statistics 2026-05-13 Philipp Reiser , Paul-Christian Bürkner , Anneli Guthke