English
Related papers

Related papers: Optimizing Neural Network Surrogate Models: Applic…

200 papers

Multiscale problems are widely observed across diverse domains in physics and engineering. Translating these problems into numerical simulations and solving them using numerical schemes, e.g. the finite element method, is costly due to the…

CNN-based surrogates have become prevalent in scientific applications to replace conventional time-consuming physical approaches. Although these surrogates can yield satisfactory results with significantly lower computation costs over small…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-07 Baixi Sun , Xiaodong Yu , Chengming Zhang , Jiannan Tian , Sian Jin , Kamil Iskra , Tao Zhou , Tekin Bicer , Pete Beckman , Dingwen Tao

Large-scale numerical simulations are used across many scientific disciplines to facilitate experimental development and provide insights into underlying physical processes, but they come with a significant computational cost. Deep neural…

The minimization of loss functions is the heart and soul of Machine Learning. In this paper, we propose an off-the-shelf optimization approach that can minimize virtually any non-differentiable and non-decomposable loss function (e.g.…

Machine Learning · Computer Science 2019-05-27 Josif Grabocka , Randolf Scholz , Lars Schmidt-Thieme

Poroelasticity -- coupled fluid flow and elastic deformation in porous media -- often involves spatially variable permeability, especially in subsurface systems. In such cases, simulations with random permeability fields are widely used for…

Machine Learning · Computer Science 2025-09-16 Sangjoon Park , Yeonjong Shin , Jinhyun Choo

As an emerging network model, spiking neural networks (SNNs) have aroused significant research attentions in recent years. However, the energy-efficient binary spikes do not augur well with gradient descent-based training approaches.…

Machine Learning · Computer Science 2023-04-27 Siqi Wang , Tee Hiang Cheng , Meng-Hiot Lim

The ongoing decarbonisation of power systems is driving an increasing reliance on distributed energy resources, which introduces complex and nonlinear interactions that are difficult to capture in conventional optimisation models. As a…

Systems and Control · Electrical Eng. & Systems 2026-01-22 Yogesh Pipada Sunil Kumar , S. Ali Pourmousavi , Jon A. R. Liisberg , Julian Lesmos-Vinasco

Machine learning surrogate emulators are needed in engineering design and optimization tasks to rapidly emulate computationally expensive physics-based models. In micromechanics problems the local full-field response variables are desired…

Computational Engineering, Finance, and Science · Computer Science 2024-05-17 Patxi Fernandez-Zelaia , Jason Mayeur , Jiahao Cheng , Yousub Lee , Kevin Knipe , Kai Kadau

Solving complex real problems often demands advanced algorithms, and then continuous improvements in the internal operations of a search technique are needed. Hybrid algorithms, parallel techniques, theoretical advances, and much more are…

Neural and Evolutionary Computing · Computer Science 2025-08-12 Tomohiro Harada , Enrique Alba , Gabriel Luque

Developing accurate, data-efficient surrogate models is central to advancing AI for Science. Neural operators (NOs), which approximate mappings between infinite-dimensional function spaces using conventional neural architectures, have…

Machine Learning · Computer Science 2025-09-26 Dibyajyoti Nayak , Somdatta Goswami

Accurate models of the scrape-off layer are required for the design and operation of tokamak fusion reactors. Scrape-off layer simulations are computationally expensive, difficult to operate and suffer from numerical instabilities. A…

Plasma Physics · Physics 2026-04-22 Stefan Dasbach , Sebastijan Brezinsek , Yunfeng Liang , Dirk Reiser , Sven Wiesen

Spiking Neural Networks (SNNs) offer inherent advantages for low-power inference through sparse, event-driven computation. However, the theoretical energy benefits of SNNs are often decoupled from real hardware performance due to the opaque…

Hardware Architecture · Computer Science 2026-03-27 Ilkin Aliyev , Jesus Lopez , Tosiron Adegbija

Identifying weak gravitational wave signals in noise and estimating the source properties require high-precision waveform templates. Numerical relativity (NR) simulations can provide the most accurate waveforms. However, it is challenging…

General Relativity and Quantum Cosmology · Physics 2025-03-07 Xing-Yu Zhong , Wen-Biao Han , Ling Sun

Modern neural architecture search (NAS) is inherently multi-objective, balancing trade-offs such as accuracy, parameter count, and computational cost. This complexity makes NAS computationally expensive and nearly impossible to solve…

Machine Learning · Computer Science 2025-06-04 Yuyang Zhou , Ferrante Neri , Yew-Soon Ong , Ruibin Bai

We propose a general framework for machine learning based optimization under uncertainty. Our approach replaces the complex forward model by a surrogate, which is learned simultaneously in a one-shot sense when solving the optimal control…

Optimization and Control · Mathematics 2023-12-25 Philipp A. Guth , Claudia Schillings , Simon Weissmann

An accurate and efficient simulation of the hysteretic behavior of materials and components is essential for structural analysis. The surrogate model based on neural networks shows significant potential in balancing efficiency and accuracy.…

Machine Learning · Computer Science 2023-06-21 Yongjia Xu , Xinzheng Lu , Yifan Fei , Yuli Huang

Optimization and uncertainty quantification have been playing an increasingly important role in computational hemodynamics. However, existing methods based on principled modeling and classic numerical techniques have faced significant…

Medical Physics · Physics 2022-09-07 Pan Du , Xiaozhi Zhu , Jian-Xun Wang

This paper presents a novel learning-based approach to construct a surrogate problem that approximates a given parametric nonconvex optimization problem. The surrogate function is designed to be the minimum of a finite set of functions,…

Optimization and Control · Mathematics 2026-04-08 Renzi Wang , Panagiotis Patrinos , Alberto Bemporad

AI-driven surrogate modeling has become an increasingly effective alternative to physics-based simulations for 3D design, analysis, and manufacturing. These models leverage data-driven methods to predict physical quantities traditionally…

Machine Learning · Computer Science 2025-05-06 Yu-hsuan Chen , Jing Bi , Cyril Ngo Ngoc , Victor Oancea , Jonathan Cagan , Levent Burak Kara

The ongoing development of quantum processors is driving breakthroughs in scientific discovery. Despite this progress, the formidable cost of fabricating large-scale quantum processors means they will remain rare for the foreseeable future,…

Quantum Physics · Physics 2025-07-24 Wei-You Liao , Yuxuan Du , Xinbiao Wang , Tian-Ci Tian , Yong Luo , Bo Du , Dacheng Tao , He-Liang Huang