English
Related papers

Related papers: Deep UQ: Learning deep neural network surrogate mo…

200 papers

In engineering, uncertainty propagation aims to characterise system outputs under uncertain inputs. For interval uncertainty, the goal is to determine output bounds given interval-valued inputs, which is critical for robust design…

Machine Learning · Computer Science 2026-03-24 Ghifari Adam Faza , Jolan Wauters , Fabio Cuzzolin , Hans Hallez , David Moens

We analyze an ensemble-based approach for uncertainty quantification (UQ) in atomistic neural networks. This method generates an epistemic uncertainty signal without requiring changes to the underlying multi-headed regression neural network…

Chemical Physics · Physics 2025-11-21 Idan Fonea , Amir Peles , Sivan Niv , Goren Gordon , Amir Natan

Achieving a practical quantum speedup for deep neural networks (DNNs) remains a central yet elusive goal, hindered by the dual challenges of constructing deep architectures and the prohibitive overhead of data loading and measurement. We…

Deep Neural Networks (DNN) are increasingly used as components of larger software systems that need to process complex data, such as images, written texts, audio/video signals. DNN predictions cannot be assumed to be always correct for…

Software Engineering · Computer Science 2022-12-15 Michael Weiss , Paolo Tonella

We build surrogate models for dynamic 3D subsurface single-phase flow problems with multiple vertical producing wells. The surrogate model provides efficient pressure estimation of the entire formation at any timestep given a stochastic…

Computational Engineering, Finance, and Science · Computer Science 2021-11-17 Rui Xu , Dongxiao Zhang , Nanzhe Wang

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks due to large training datasets and powerful transformer architecture. However, the reliability of responses from LLMs remains a question.…

Computation and Language · Computer Science 2025-02-26 Tiejin Chen , Xiaoou Liu , Longchao Da , Jia Chen , Vagelis Papalexakis , Hua Wei

Computer models play a key role in many scientific and engineering problems. One major source of uncertainty in computer model experiment is input parameter uncertainty. Computer model calibration is a formal statistical procedure to infer…

Machine Learning · Statistics 2020-09-09 Saumya Bhatnagar , Won Chang , Seonjin Kim Jiali Wang

Using a cyclotron based model problem, we demonstrate for the first time the applicability and usefulness of a uncertainty quantification (UQ) approach in order to construct surrogate models for quantities such as emittance, energy spread…

Accelerator Physics · Physics 2018-12-13 Andreas Adelmann

This paper presents a neural network--enhanced surrogate modeling approach for diffusion problems with spatially varying random field coefficients. The method builds on numerical homogenization, which compresses fine-scale coefficients into…

Numerical Analysis · Mathematics 2025-09-17 Fabian Kröpfl , Daniel Peterseim , Elisabeth Ullmann

Data-driven surrogate modeling has emerged as a promising approach for reducing computational expenses of multiscale simulations. Recurrent Neural Network (RNN) is a common choice for modeling of path-dependent behavior. However, previous…

Computational Engineering, Finance, and Science · Computer Science 2023-12-29 Yangzi He , Shabnam J. Semnani

In scientific applications, predictive modeling is often of limited use without accurate uncertainty quantification (UQ) to indicate when a model may be extrapolating or when more data needs to be collected. Bayesian Neural Networks (BNNs)…

Machine Learning · Computer Science 2025-09-26 Scott Koermer , Natalie Klein

Numerically solving a large parametric nonlinear dynamical system is challenging due to its high complexity and the high computational costs. In recent years, machine-learning-aided surrogates are being actively researched. However, many…

Machine Learning · Computer Science 2024-10-18 Shuwen Sun , Lihong Feng , Peter Benner

This work presents a deep learning surrogate model for the fast simulation of high-dimensional frequency selective surfaces. We consider unit-cells which are built as multiple concatenated stacks of screens and their design requires the…

Signal Processing · Electrical Eng. & Systems 2023-09-22 Lucas Polo-López , Luc Le Magoarou , Romain Contreres , María García-Vigueras

Stochastic partial differential equations (SPDEs) are ubiquitous in engineering and computational sciences. The stochasticity arises as a consequence of uncertainty in input parameters, constitutive relations, initial/boundary conditions,…

Data Analysis, Statistics and Probability · Physics 2020-01-29 Sharmila Karumuri , Rohit Tripathy , Ilias Bilionis , Jitesh Panchal

Machine learning (ML) has been leveraged to tackle a diverse range of tasks in almost all branches of nuclear engineering. Many of the successes in ML applications can be attributed to the recent performance breakthroughs in deep learning,…

Systems and Control · Electrical Eng. & Systems 2025-03-25 Xu Wu , Lesego E. Moloko , Pavel M. Bokov , Gregory K. Delipei , Joshua Kaizer , Kostadin N. Ivanov

Safe deployment of graph neural networks (GNNs) under distribution shift requires models to provide accurate confidence indicators (CI). However, while it is well-known in computer vision that CI quality diminishes under distribution shift,…

Machine Learning · Computer Science 2023-09-21 Puja Trivedi , Mark Heimann , Rushil Anirudh , Danai Koutra , Jayaraman J. Thiagarajan

We develop a novel deep learning method for uncertainty quantification in stochastic partial differential equations based on Bayesian neural network (BNN) and Hamiltonian Monte Carlo (HMC). A BNN efficiently learns the posterior…

Machine Learning · Statistics 2022-10-24 Jeahan Jung , Minseok Choi

We propose a framework that directly tackles the probability distribution of the value function parameters in Deep Q Network (DQN), with powerful variational inference subroutines to approximate the posterior of the parameters. We will…

Machine Learning · Computer Science 2017-12-01 Yunhao Tang , Alp Kucukelbir

Large Language Diffusion Models (LLDMs) are emerging as an alternative to autoregressive models, offering faster inference through higher parallelism. Similar to autoregressive LLMs, they remain prone to hallucinations, making reliable…

Computation and Language · Computer Science 2026-05-15 Artem Vazhentsev , Vladislav Smirnov , David Li , Maxim Panov , Timothy Baldwin , Artem Shelmanov

Many real-world applications demand accurate and fast predictions, as well as reliable uncertainty estimates. However, quantifying uncertainty on high-dimensional predictions is still a severely under-investigated problem, especially when…

Computational Engineering, Finance, and Science · Computer Science 2025-02-04 Saurabh Deshpande , Hussein Rappel , Mark Hobbs , Stéphane P. A. Bordas , Jakub Lengiewicz