English
Related papers

Related papers: A survey of unsupervised learning methods for high…

200 papers

Manifold learning approaches seek the intrinsic, low-dimensional data structure within a high-dimensional space. Mainstream manifold learning algorithms, such as Isomap, UMAP, $t$-SNE, Diffusion Map, and Laplacian Eigenmaps do not use data…

Machine Learning · Statistics 2023-07-04 Jake S. Rhodes

Machine learning for differential equations paves the way for computationally efficient alternatives to numerical solvers, with potentially broad impacts in science and engineering. Though current algorithms typically require simulated…

Machine Learning · Computer Science 2024-02-15 Grégoire Mialon , Quentin Garrido , Hannah Lawrence , Danyal Rehman , Yann LeCun , Bobak T. Kiani

We analyze an ensemble-based approach for uncertainty quantification (UQ) in atomistic neural networks. This method generates an epistemic uncertainty signal without requiring changes to the underlying multi-headed regression neural network…

Chemical Physics · Physics 2025-11-21 Idan Fonea , Amir Peles , Sivan Niv , Goren Gordon , Amir Natan

Polynomial chaos expansions (PCE) are widely used for uncertainty quantification (UQ) tasks, particularly in the applied mathematics community. However, PCE has received comparatively less attention in the statistics literature, and fully…

Methodology · Statistics 2025-10-30 Kellin N. Rumsey , Devin Francom , Graham C. Gibson , J. Derek Tucker , Gabriel Huerta

A problem of considerable importance within the field of uncertainty quantification (UQ) is the development of efficient methods for the construction of accurate surrogate models. Such efforts are particularly important to applications…

Computational Physics · Physics 2019-03-01 Rohit Tripathy , Ilias Bilionis

In this work we introduce a manifold learning-based surrogate modeling framework for uncertainty quantification in high-dimensional stochastic systems. Our first goal is to perform data mining on the available simulation data to identify a…

Machine Learning · Statistics 2024-11-11 Dimitris G. Giovanis , Dimitrios Loukrezis , Ioannis G. Kevrekidis , Michael D. Shields

We present a comparison of methods for uncertainty quantification (UQ) in deep learning algorithms in the context of a simple physical system. Three of the most common uncertainty quantification methods - Bayesian Neural Networks (BNN),…

Machine Learning · Computer Science 2020-12-08 João Caldeira , Brian Nord

Uncertainty quantification seeks to provide a quantitative means to understand complex systems that are impacted by parametric uncertainty. The polynomial chaos method is a computational approach to solve stochastic partial differential…

Numerical Analysis · Mathematics 2017-09-27 Melvin Leok , Gautam Wilkins

The curse of dimensionality is ubiquitous in both numerical and data-driven methods. This is particularly severe for space-time methods, which treat the combined space-time domain simultaneously. We investigate the effectiveness of a…

Solving high-dimensional partial differential equations (PDEs) is a major challenge in scientific computing. We develop a new numerical method for solving elliptic-type PDEs by adapting the Q-learning algorithm in reinforcement learning.…

Numerical Analysis · Mathematics 2023-06-27 Samuel N. Cohen , Deqing Jiang , Justin Sirignano

This work proposes a sampling-based (non-intrusive) approach within the context of low-rank separated representations to tackle the issue of curse-of-dimensionality associated with the solution of models, e.g., PDEs/ODEs, with…

Mathematical Physics · Physics 2013-06-20 Alireza Doostan , AbdoulAhad Validi , Gianluca Iaccarino

Deep neural networks (DNNs) have achieved tremendous success in computer vision, natural language processing, and scientific and engineering domains. However, DNNs can make unexpected, incorrect, yet overconfident predictions, leading to…

Machine Learning · Computer Science 2025-12-16 Wenchong He , Zhe Jiang , Tingsong Xiao , Zelin Xu , Yukun Li

Polynomial chaos expansion (PCE) is a powerful surrogate model-based reliability analysis method. Generally, a PCE model with a higher expansion order is usually required to obtain an accurate surrogate model for some complex non-linear…

Machine Learning · Computer Science 2022-04-05 Xiaohu Zheng , Wen Yao , Yunyang Zhang , Xiaoya Zhang

Inverse problems aim to determine model parameters of a mathematical problem from given observational data. Neural networks can provide an efficient tool to solve these problems. In the context of Bayesian inverse problems, Uncertainty…

Numerical Analysis · Mathematics 2025-09-16 Andrea Tonini , Tan Bui-Thanh , Francesco Regazzoni , Luca Dede' , Alfio Quarteroni

Deep learning (DL) has shown great potential in medical image enhancement problems, such as super-resolution or image synthesis. However, to date, little consideration has been given to uncertainty quantification over the output image. Here…

Deep learning methods based on backward stochastic differential equations (BSDEs) have emerged as competitive alternatives to physics-informed neural networks (PINNs) for solving high-dimensional partial differential equations (PDEs). By…

Machine Learning · Computer Science 2026-05-15 Jaemin Seo , Surin Lee , Jae Yong Lee

Identifying parameters in partial differential equations (PDEs) represents a very broad class of applied inverse problems. In recent years, several unsupervised learning approaches using (deep) neural networks have been developed to solve…

Numerical Analysis · Mathematics 2025-08-22 Siyu Cen , Bangti Jin , Qimeng Quan , Zhi Zhou

Quasi-Monte Carlo (QMC) integration over unbounded domains $\mathbb{R}^s$ remains challenging due to the high dimensionality of sampling space and the boundary growth of the integrand. In applications such as uncertainty quantification…

Numerical Analysis · Mathematics 2026-03-03 Zexin Pan , Du Ouyang , Zhijian He

Uncertainty quantification (UQ) in machine learning is currently drawing increasing research interest, driven by the rapid deployment of deep neural networks across different fields, such as computer vision, natural language processing, and…

Machine Learning · Computer Science 2022-08-26 Zongren Zou , Xuhui Meng , Apostolos F Psaros , George Em Karniadakis

Quantifying the uncertainty of supervised learning models plays an important role in making more reliable predictions. Epistemic uncertainty, which usually is due to insufficient knowledge about the model, can be reduced by collecting more…

Machine Learning · Computer Science 2022-01-27 Xinlei Zhou , Han Liu , Farhad Pourpanah , Tieyong Zeng , Xizhao Wang