English
Related papers

Related papers: Optimizing Neural Network Surrogate Models: Applic…

200 papers

We develop new strategies to build numerical relativity surrogate models for eccentric binary black hole systems, which are expected to play an increasingly important role in current and future gravitational-wave detectors. We introduce a…

General Relativity and Quantum Cosmology · Physics 2021-03-26 Tousif Islam , Vijay Varma , Jackie Lodman , Scott E. Field , Gaurav Khanna , Mark A. Scheel , Harald P. Pfeiffer , Davide Gerosa , Lawrence E. Kidder

Numerical solutions of partial differential equations (PDEs) require expensive simulations, limiting their application in design optimization, model-based control, and large-scale inverse problems. Surrogate modeling techniques seek to…

Computational Physics · Physics 2022-05-18 James Duvall , Karthik Duraisamy , Shaowu Pan

Recent Meta-Black-Box Optimization (MetaBBO) approaches have shown possibility of enhancing the optimization performance through learning meta-level policies to dynamically configure low-level optimizers. However, existing MetaBBO…

Machine Learning · Computer Science 2025-03-25 Zeyuan Ma , Zhiyang Huang , Jiacheng Chen , Zhiguang Cao , Yue-Jiao Gong

Production optimization in stress-sensitive unconventional reservoirs is governed by a nonlinear trade-off between pressure-driven flow and stress-induced degradation of fracture conductivity and matrix permeability. While higher drawdown…

Machine Learning · Computer Science 2026-04-02 Mahammad Valiyev , Jodel Cornelio , Behnam Jafarpour

The dominant paradigm for power system dynamic simulation is to build system-level simulations by combining physics-based models of individual components. The sheer size of the system along with the rapid integration of inverter-based…

Systems and Control · Electrical Eng. & Systems 2024-10-24 Matthew Bossart , Jose Daniel Lara , Ciaran Roberts , Rodrigo Henriquez-Auba , Duncan Callaway , Bri-Mathias Hodge

Gravitational waves from the coalescences of black hole and neutron stars afford us the unique opportunity to determine the sources' properties, such as their masses and spins, with unprecedented accuracy. To do so, however, theoretical…

General Relativity and Quantum Cosmology · Physics 2022-11-30 Lucy M. Thomas , Geraint Pratten , Patricia Schmidt

Developing surrogates for computer models has become increasingly important for addressing complex problems in science and engineering. This article introduces an artificial intelligent (AI) surrogate, referred to as the DeepSurrogate, for…

Offline optimization has recently emerged as an increasingly popular approach to mitigate the prohibitively expensive cost of online experimentation. The key idea is to learn a surrogate of the black-box function that underlines the target…

Machine Learning · Computer Science 2025-03-07 Manh Cuong Dao , Phi Le Nguyen , Thao Nguyen Truong , Trong Nghia Hoang

The growing demand for energy-efficient, high-performance AI systems has led to increased attention on alternative computing platforms (e.g., photonic, neuromorphic) due to their potential to accelerate learning and inference. However,…

Machine Learning · Computer Science 2026-05-05 Andrei Chertkov , Artem Basharin , Mikhail Saygin , Evgeny Frolov , Stanislav Straupe , Ivan Oseledets

This paper develops a surrogate model refinement approach for the simulation of dynamical systems and the solution of optimization problems governed by dynamical systems in which surrogates replace expensive-to-compute state- and…

Optimization and Control · Mathematics 2025-09-08 Jonathan R. Cangelosi , Matthias Heinkenschloss

The transition of the power grid requires new technologies and methodologies, which can only be developed and tested in simulations. Especially larger simulation setups with many levels of detail can become quite slow. Therefore, the number…

Signal Processing · Electrical Eng. & Systems 2020-06-23 Stephan Balduin , Tom Westermann , Erika Puiutta

Neuromorphic computing systems are set to revolutionize energy-constrained robotics by achieving orders-of-magnitude efficiency gains, while enabling native temporal processing. Spiking Neural Networks (SNNs) represent a promising…

Artificial Intelligence · Computer Science 2025-10-29 Korneel Van den Berghe , Stein Stroobants , Vijay Janapa Reddi , G. C. H. E. de Croon

Surrogate modeling of non-linear oscillator networks remains challenging due to discrepancies between simplified analytical models and real-world complexity. To bridge this gap, we investigate hybrid reservoir computing, combining reservoir…

Systems and Control · Electrical Eng. & Systems 2025-05-20 Andrew Shannon , Conor Houghton , David Barton , Martin Homer

Hyperparameter optimization is the process of identifying the appropriate hyperparameter configuration of a given machine learning model with regard to a given learning task. For smaller data sets, an exhaustive search is possible; However,…

Machine Learning · Computer Science 2022-09-30 Blaž Škrlj , Adi Schwartz , Jure Ferlež , Davorin Kopič , Naama Ziporin

Artificial Neural Networks (NNWs) are appealing functions to substitute high dimensional and non-linear history-dependent problems in computational mechanics since they offer the possibility to drastically reduce the computational time.…

Computational Engineering, Finance, and Science · Computer Science 2023-10-11 Ling Wu , Ludovic Noels

Surrogate models are used to reduce the burden of expensive-to-evaluate objective functions in optimization. By creating models which map genomes to objective values, these models can estimate the performance of unknown inputs, and so be…

Neural and Evolutionary Computing · Computer Science 2019-07-17 Alexander Hagg , Martin Zaefferer , Jörg Stork , Adam Gaier

We consider minimizing functions for which it is expensive to compute the (possibly stochastic) gradient. Such functions are prevalent in reinforcement learning, imitation learning and adversarial training. Our target optimization framework…

Machine Learning · Computer Science 2023-06-09 Jonathan Wilder Lavington , Sharan Vaswani , Reza Babanezhad , Mark Schmidt , Nicolas Le Roux

Surrogate Neural Networks are nowadays routinely used in industry as substitutes for computationally demanding engineering simulations (e.g., in structural analysis). They allow to generate faster predictions and thus analyses in industrial…

Recurrent neural network (RNN)'s architecture is a key factor influencing its performance. We propose algorithms to optimize hidden sizes under running time constraint. We convert the discrete optimization into a subset selection problem.…

Machine Learning · Statistics 2018-02-22 Junqi Jin , Ziang Yan , Kun Fu , Nan Jiang , Changshui Zhang

Gravitational wave observations from merging compact objects are becoming commonplace, and as detectors improve and gravitational wave sources become more varied, it is increasingly important to have dense and expansive template banks of…

General Relativity and Quantum Cosmology · Physics 2023-01-25 Deborah Ferguson