English
Related papers

Related papers: Efficient training of artificial neural network su…

200 papers

The topology optimization of artificial neural networks can be particularly difficult if the fitness evaluations require expensive experiments or simulations. For that reason, the optimization methods may need to be supported by surrogate…

Neural and Evolutionary Computing · Computer Science 2018-07-23 Jörg Stork , Martin Zaefferer , Thomas Bartz-Beielstein

We present a fast and accurate data-driven surrogate model for divertor plasma detachment prediction leveraging the latent feature space concept in machine learning research. Our approach involves constructing and training two neural…

Surrogate models are used to alleviate the computational burden in engineering tasks, which require the repeated evaluation of computationally demanding models of physical systems, such as the efficient propagation of uncertainties. For…

Machine Learning · Statistics 2022-09-28 Felix Schneider , Iason Papaioannou , Gerhard Müller

Recent advances in machine learning, specifically transformer architecture, have led to significant advancements in commercial domains. These powerful models have demonstrated superior capability to learn complex relationships and often…

Machine Learning · Computer Science 2024-05-29 Matthew L. Olson , Shusen Liu , Jayaraman J. Thiagarajan , Bogdan Kustowski , Weng-Keen Wong , Rushil Anirudh

Crash simulations play an essential role in improving vehicle safety, design optimization, and injury risk estimation. Unfortunately, numerical solutions of such problems using state-of-the-art high-fidelity models require significant…

Machine Learning · Computer Science 2024-02-16 Jonas Kneifl , Jörg Fehr , Steven L. Brunton , J. Nathan Kutz

Surrogate models provide compact relations between user-defined input parameters and output quantities of interest, enabling the efficient evaluation of complex parametric systems in many-query settings. Such capabilities are essential in a…

Numerical Analysis · Mathematics 2026-03-16 Matteo Giacomini , Pedro Díez

Deep surrogate models for parametric partial differential equations (PDEs) can deliver high-fidelity approximations but remain prohibitively data-hungry: training often requires thousands of fine-grid simulations, each incurring substantial…

Machine Learning · Computer Science 2026-03-03 Yang Meng , Ruoxi Jiang , Zhuokai Zhao , Chong Liu , Rebecca Willett , Yuxin Chen

In NeuroEvolution, the topologies of artificial neural networks are optimized with evolutionary algorithms to solve tasks in data regression, data classification, or reinforcement learning. One downside of NeuroEvolution is the large amount…

Neural and Evolutionary Computing · Computer Science 2019-02-12 Jörg Stork , Martin Zaefferer , Thomas Bartz-Beielstein

Neural networks are increasingly used in complex (data-driven) simulations as surrogates or for accelerating the computation of classical surrogates. In many applications physical constraints, such as mass or energy conservation, must be…

Computational Physics · Physics 2020-02-25 Jim Magiera , Deep Ray , Jan S. Hesthaven , Christian Rohde

Simulating the time evolution of physical systems is pivotal in many scientific and engineering problems. An open challenge in simulating such systems is their multi-resolution dynamics: a small fraction of the system is extremely dynamic,…

Machine Learning · Computer Science 2023-05-03 Tailin Wu , Takashi Maruyama , Qingqing Zhao , Gordon Wetzstein , Jure Leskovec

Highly accurate datasets from numerical or physical experiments are often expensive and time-consuming to acquire, posing a significant challenge for applications that require precise evaluations, potentially across multiple scenarios and…

Machine Learning · Computer Science 2026-02-06 Paolo Conti , Mengwu Guo , Attilio Frangi , Andrea Manzoni

Neural networks can be used as surrogates for PDE models. They can be made physics-aware by penalizing underlying equations or the conservation of physical properties in the loss function during training. Current approaches allow to…

Machine Learning · Computer Science 2022-07-01 Raphael Leiteritz , Patrick Buchfink , Bernard Haasdonk , Dirk Pflüger

A surrogate model approximates the outputs of a solver of Partial Differential Equations (PDEs) with a low computational cost. In this article, we propose a method to build learning-based surrogates in the context of parameterized PDEs,…

Machine Learning · Computer Science 2024-06-28 Alejandro Ribés , Nawfal Benchekroun , Théo Delagnes

Neural networks have become very popular in surrogate modeling because of their ability to characterize arbitrary, high dimensional functions in a data driven fashion. This paper advocates for the training of surrogates that are consistent…

Machine Learning · Computer Science 2022-06-08 Rushil Anirudh , Jayaraman J. Thiagarajan , Peer-Timo Bremer , Brian K. Spears

Graph neural networks, trained on experimental or calculated data are becoming an increasingly important tool in computational materials science. Networks, once trained, are able to make highly accurate predictions at a fraction of the cost…

Materials Science · Physics 2024-06-19 Johannes Allotey , Keith T. Butler , Jeyan Thiyagalingam

We explore the possibility of fully replacing a plasma physics kinetic simulator with a graph neural network-based simulator. We focus on this class of surrogate models given the similarity between their message-passing update mechanism and…

Plasma Physics · Physics 2024-05-31 Diogo D Carvalho , Diogo R Ferreira , Luis O Silva

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

Computational Intelligence (CI) techniques have shown great potential as a surrogate model of expensive physics simulation, with demonstrated ability to make fast predictions, albeit at the expense of accuracy in some cases. For many…

Surrogate models for partial-differential equations are widely used in the design of meta-materials to rapidly evaluate the behavior of composable components. However, the training cost of accurate surrogates by machine learning can rapidly…

Machine Learning · Computer Science 2020-11-04 Raphaël Pestourie , Youssef Mroueh , Thanh V. Nguyen , Payel Das , Steven G. Johnson

The performance of machine learning surrogates is critically dependent on data quality and quantity. This presents a major challenge, as high-fidelity (HF) data is often scarce and computationally expensive to acquire, while low-fidelity…

Machine Learning · Computer Science 2026-02-03 Jice Zeng , David Barajas-Solano , Hui Chen