English
Related papers

Related papers: Deep convolutional neural networks for uncertainty…

200 papers

Modeling uncertainty in deep neural networks, despite recent important advances, is still an open problem. Bayesian neural networks are a powerful solution, where the prior over network weights is a design choice, often a normal…

Machine Learning · Statistics 2019-10-29 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Gal Novik

Solving optimization problems with unknown parameters often requires learning a predictive model to predict the values of the unknown parameters and then solving the problem using these values. Recent work has shown that including the…

Machine Learning · Computer Science 2020-10-23 Kai Wang , Bryan Wilder , Andrew Perrault , Milind Tambe

Large-scale numerical simulations are used across many scientific disciplines to facilitate experimental development and provide insights into underlying physical processes, but they come with a significant computational cost. Deep neural…

Numerically solving a large parametric nonlinear dynamical system is challenging due to its high complexity and the high computational costs. In recent years, machine-learning-aided surrogates are being actively researched. However, many…

Machine Learning · Computer Science 2024-10-18 Shuwen Sun , Lihong Feng , Peter Benner

This paper proposes a machine-learning-based solution approach for solving multi-horizon stochastic programs. The approach embeds a deep learning neural network into a multi-horizon stochastic program to approximate the recourse operational…

Optimization and Control · Mathematics 2025-12-03 Hongyu Zhang , Gabriele Sormani , Enza Messina , Alan King , Francesca Maggioni

This paper introduces a practical sampling method for training surrogate models in the context of uncertainty propagation. We propose a heuristic method to uniformly draw samples within highest density regions of the density given by the…

Methodology · Statistics 2025-09-15 Jocelyn Minini , Micha Wasem

Phase-field modeling is an effective but computationally expensive method for capturing the mesoscale morphological and microstructure evolution in materials. Hence, fast and generalizable surrogate models are needed to alleviate the cost…

Materials Science · Physics 2022-07-01 Vivek Oommen , Khemraj Shukla , Somdatta Goswami , Remi Dingreville , George Em Karniadakis

Numerical simulation of multi-phase fluid dynamics in porous media is critical for many energy and environmental applications in Earth's subsurface. Data-driven surrogate modeling provides computationally inexpensive alternatives to…

Computational Physics · Physics 2024-04-16 Jiamin Jiang , Bo Guo

Mesh-based simulations play a key role when modeling complex physical systems that, in many disciplines across science and engineering, require the solution of parametrized time-dependent nonlinear partial differential equations (PDEs). In…

Numerical Analysis · Mathematics 2023-08-04 Nicola Rares Franco , Stefania Fresca , Filippo Tombari , Andrea Manzoni

The transition of the power grid requires new technologies and methodologies, which can only be developed and tested in simulations. Especially larger simulation setups with many levels of detail can become quite slow. Therefore, the number…

Signal Processing · Electrical Eng. & Systems 2020-06-23 Stephan Balduin , Tom Westermann , Erika Puiutta

Continuum robots enable dexterous manipulation in constrained environments, but require accurate and efficient models for real-time manipulation and control. Traditional physics-based models can be computationally expensive and may suffer…

Robotics · Computer Science 2026-05-20 Branden Frieden , James M. Ferguson , Alan Kuntz , Varun Shankar

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

A deep-learning-based surrogate model is developed and applied for predicting dynamic subsurface flow in channelized geological models. The surrogate model is based on deep convolutional and recurrent neural network architectures,…

Machine Learning · Computer Science 2020-05-20 Meng Tang , Yimin Liu , Louis J. Durlofsky

One method to solve expensive black-box optimization problems is to use a surrogate model that approximates the objective based on previous observed evaluations. The surrogate, which is cheaper to evaluate, is optimized instead to find an…

Optimization and Control · Mathematics 2021-05-28 Rickard Karlsson , Laurens Bliek , Sicco Verwer , Mathijs de Weerdt

We study consistency properties of machine learning methods based on minimizing convex surrogates. We extend the recent framework of Osokin et al. (2017) for the quantitative analysis of consistency properties to the case of inconsistent…

Machine Learning · Computer Science 2019-01-10 Kirill Struminsky , Simon Lacoste-Julien , Anton Osokin

In complex large-scale systems such as climate, important effects are caused by a combination of confounding processes that are not fully observable. The identification of sources from observations of system state is vital for attribution…

Machine Learning · Statistics 2023-03-22 Joseph Hart , Mamikon Gulian , Indu Manickam , Laura Swiler

State-of-the-art Deep Neural Networks (DNNs) often incorporate multi-branch connections, enabling multi-scale feature extraction and enhancing the capture of diverse features. This design improves network capacity and generalisation to…

Neural and Evolutionary Computing · Computer Science 2025-06-26 Fergal Stapleton , Daniel García Núñez , Yanan Sun , Edgar Galván

It has been shown that cooperative coevolution (CC) can effectively deal with large scale optimization problems (LSOPs) through a divide-and-conquer strategy. However, its performance is severely restricted by the current…

Neural and Evolutionary Computing · Computer Science 2018-03-05 Bei Pang , Zhigang Ren , Yongsheng Liang , An Chen

Deep-learning has achieved good performance and shown great potential for solving forward and inverse problems. In this work, two categories of innovative deep-learning based inverse modeling methods are proposed and compared. The first…

Signal Processing · Electrical Eng. & Systems 2021-04-28 Nanzhe Wang , Haibin Chang , Dongxiao Zhang

The widespread integration of deep neural networks in developing data-driven surrogate models for high-fidelity simulations of complex physical systems highlights the critical necessity for robust uncertainty quantification techniques and…

Computational Engineering, Finance, and Science · Computer Science 2024-05-15 Pratyush Kumar Singh , Kathryn A. Farrell-Maupin , Danial Faghihi