English
Related papers

Related papers: Initial Steps Towards Tackling High-dimensional Su…

200 papers

In recent years, neural networks (NNs) have become increasingly popular for surrogate modeling tasks in mechanics and materials modeling applications. While traditional NNs are deterministic functions that rely solely on data to learn the…

Machine Learning · Statistics 2025-01-03 Javad Ghorbanian , Nicholas Casaprima , Audrey Olivier

Traditionally, an artificial neural network (ANN) is trained slowly by a gradient descent algorithm such as the backpropagation algorithm since a large number of hyperparameters of the ANN need to be fine-tuned with many training epochs. To…

Machine Learning · Computer Science 2020-01-27 Luna M. Zhang

This paper proposes a new family of algorithms for training neural networks (NNs). These are based on recent developments in the field of non-convex optimization, going under the general name of successive convex approximation (SCA)…

Machine Learning · Statistics 2017-06-16 Simone Scardapane , Paolo Di Lorenzo

Modern computational methods, involving highly sophisticated mathematical formulations, enable several tasks like modeling complex physical phenomenon, predicting key properties and design optimization. The higher fidelity in these computer…

Computational Engineering, Finance, and Science · Computer Science 2023-04-13 Lele Luan , Nesar Ramachandra , Sandipp Krishnan Ravi , Anindya Bhaduri , Piyush Pandita , Prasanna Balaprakash , Mihai Anitescu , Changjie Sun , Liping Wang

Neuroevolution is an active and growing research field, especially in times of increasingly parallel computing architectures. Learning methods for Artificial Neural Networks (ANN) can be divided into two groups. Neuroevolution is mainly…

Neural and Evolutionary Computing · Computer Science 2011-04-11 Onay Urfalioglu , Orhan Arikan

In engineering design, surrogate models are widely employed to replace computationally expensive simulations by leveraging design variables and geometric parameters from computer-aided design (CAD) models. However, these models often lose…

Machine Learning · Computer Science 2024-06-05 Jangseop Park , Namwoo Kang

Neural surrogates for Partial Differential Equations (PDEs) often suffer significant performance degradation when evaluated on problem configurations outside their training distribution, such as new initial conditions or structural…

Machine Learning · Computer Science 2026-02-11 Paul Setinek , Gianluca Galletti , Thomas Gross , Dominik Schnürer , Johannes Brandstetter , Werner Zellinger

Ensuring the microbiological safety of large, heterogeneous water distribution systems (WDS) typically requires managing appropriate levels of disinfectant residuals including chlorine. WDS include complex fluid interactions that are…

Neural and Evolutionary Computing · Computer Science 2026-04-14 Rivaaj Monsia , Daniel Young , Olivier Francon , Risto Miikkulainen

With computational models becoming more expensive and complex, surrogate models have gained increasing attention in many scientific disciplines and are often necessary to conduct sensitivity studies, parameter optimization etc. In the…

Methodology · Statistics 2023-07-24 Matthias Fischer , Carsten Proppe

We adopt a two-dimensional tensor-network (TN) ansatz to simulate variational quantum algorithms on two-dimensional qubit architectures, demonstrating its capability to accurately simulate deep circuits through the Quantum Approximate…

Quantum Physics · Physics 2026-04-23 Ryo Watanabe , Dries Sels , Joseph Tindall

Machine learning methods are increasingly used to build computationally inexpensive surrogates for complex physical models. The predictive capability of these surrogates suffers when data are noisy, sparse, or time-dependent. As we are…

Machine Learning · Computer Science 2024-05-20 A. Diaw , M. McKerns , I. Sagert , L. G. Stanton , M. S. Murillo

Survival Analysis (SA) models the time until an event occurs, with applications in fields like medicine, defense, finance, and aerospace. Recent research indicates that Neural Networks (NNs) can effectively capture complex data patterns in…

Machine Learning · Statistics 2025-09-08 Michael Potter , Stefano Maxenti , Michael Everett

Using Neuroevolution combined with Novelty Search to promote behavioural diversity is capable of constructing high-performing ensembles for classification. However, using gradient descent to train evolved architectures during the search can…

Machine Learning · Computer Science 2022-02-09 Rui P. Cardoso , Emma Hart , David Burth Kurka , Jeremy V. Pitt

This paper introduces a novel surrogate modeling framework for aerodynamic applications based on Neural Fields. The proposed approach, MARIO (Modulated Aerodynamic Resolution Invariant Operator), addresses non parametric geometric…

Numerically solving a large parametric nonlinear dynamical system is challenging due to its high complexity and the high computational costs. In recent years, machine-learning-aided surrogates are being actively researched. However, many…

Machine Learning · Computer Science 2024-10-18 Shuwen Sun , Lihong Feng , Peter Benner

There is an increasing interest in emulating Spiking Neural Networks (SNNs) on neuromorphic computing devices due to their low energy consumption. Recent advances have allowed training SNNs to a point where they start to compete with…

Neural and Evolutionary Computing · Computer Science 2022-01-14 Nicolas Perez-Nieves , Dan F. M. Goodman

It has been shown that cooperative coevolution (CC) can effectively deal with large scale optimization problems (LSOPs) through a divide-and-conquer strategy. However, its performance is severely restricted by the current…

Neural and Evolutionary Computing · Computer Science 2018-03-05 Bei Pang , Zhigang Ren , Yongsheng Liang , An Chen

Spiking neural networks (SNNs) have shown promise in various dynamic visual tasks, yet those ready for practical deployment often lack the compactness and robustness essential in resource-limited and safety-critical settings. Prior research…

Neural and Evolutionary Computing · Computer Science 2024-08-05 Zichen Song , Jiakang Li , Songning Lai , Sitan Huang

Evolutionary algorithms (EAs) provide unique advantages for optimizing neural networks in complex search spaces. This paper introduces a new web platform, NeuroEvo (neuroevo.io), that allows users to interactively design and train neural…

Neural and Evolutionary Computing · Computer Science 2022-10-04 Philip Schroeder

Neuroevolution is a promising area of research that combines evolutionary algorithms with neural networks. A popular subclass of neuroevolutionary methods, called evolution strategies, relies on dense noise perturbations to mutate networks,…

Neural and Evolutionary Computing · Computer Science 2023-02-14 Tim Whitaker , Darrell Whitley