English
Related papers

Related papers: Using Deep Learning to Improve Ensemble Smoother: …

200 papers

A novel strategy is proposed to improve the accuracy of state estimation and reconstruction from low-fidelity models and sparse data from sensors. This strategy combines ensemble Data Assimilation (DA) and Machine Learning (ML) tools,…

Fluid Dynamics · Physics 2025-01-31 Miguel M. Valero , Marcello Meldi

Complex systems are often described with competing models. Such divergence of interpretation on the system may stem from model fidelity, mathematical simplicity, and more generally, our limited knowledge of the underlying processes.…

Numerical Analysis · Mathematics 2017-07-21 Lun Yang , Akil Narayan , Peng Wang

Ensemble Kalman Sampler (EKS) is a method to find approximately $i.i.d.$ samples from a target distribution. As of today, why the algorithm works and how it converges is mostly unknown. The continuous version of the algorithm is a set of…

Numerical Analysis · Mathematics 2025-03-07 Zhiyan Ding , Qin Li

Spectral Embedding (SE) has often been used to map data points from non-linear manifolds to linear subspaces for the purpose of classification and clustering. Despite significant advantages, the subspace structure of data in the original…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Hira Yaseen , Arif Mahmood

A non-intrusive data assimilation methodology is developed to improve the statistical predictions of large-eddy simulations (LES). The ensemble-variational (EnVar) approach aims to minimize a cost function that is defined as the discrepancy…

Fluid Dynamics · Physics 2021-09-28 Vincent Mons , Yifan Du , Tamer A. Zaki

During the last few years discontinuous Galerkin (DG) methods have received increased interest from the geophysical community. In these methods the solution in each grid cell is approximated as a linear combination of basis functions.…

Atmospheric and Oceanic Physics · Physics 2025-02-19 Ivo Pasmans , Yumeng Chen , Alberto Carrassi , Chris K. R. T. Jones

Neural network ensembles, such as Bayesian neural networks (BNNs), have shown success in the areas of uncertainty estimation and robustness. However, a crucial challenge prohibits their use in practice. BNNs require a large number of…

Machine Learning · Computer Science 2022-07-15 Namuk Park , Songkuk Kim

The Ensemble Kalman methodology in an inverse problems setting can be viewed as an iterative scheme, which is a weakly tamed discretization scheme for a certain stochastic differential equation (SDE). Assuming a suitable approximation…

Probability · Mathematics 2018-06-19 Dirk Blömker , Claudia Schillings , Philipp Wacker

Deep learning has emerged as a technique of choice for rapid feature extraction across imaging disciplines, allowing rapid conversion of the data streams to spatial or spatiotemporal arrays of features of interest. However, applications of…

Data Analysis, Statistics and Probability · Physics 2021-01-25 Ayana Ghosh , Bobby G. Sumpter , Ondrej Dyck , Sergei V. Kalinin , Maxim Ziatdinov

Different approaches to using data-driven methods for subgrid-scale closure modeling have emerged recently. Most of these approaches are data-hungry, and lack interpretability and out-of-distribution generalizability. Here, we use {online}…

Over recent years, there has been a rapid development of deep learning (DL) in both industry and academia fields. However, finding the optimal hyperparameters of a DL model often needs high computational cost and human expertise. To…

Neural and Evolutionary Computing · Computer Science 2022-08-24 Nan Li , Lianbo Ma , Guo Yu , Bing Xue , Mengjie Zhang , Yaochu Jin

Entropic Outlier Sparsification (EOS) is proposed as a robust computational strategy for the detection of data anomalies in a broad class of learning methods, including the unsupervised problems (like detection of non-Gaussian outliers in…

Methodology · Statistics 2022-06-08 Illia Horenko

Classical discriminant analysis assumes identically distributed training data, yet in many applications observations are collected over time and the class-conditional distributions drift. This population drift renders stationary classifiers…

Machine Learning · Computer Science 2025-08-25 Shuilian Xie , Mahdi Imani , Edward R. Dougherty , Ulisses M. Braga-Neto

In a data stream environment, classification models must handle concept drift efficiently and effectively. Ensemble methods are widely used for this purpose; however, the ones available in the literature either use a large data chunk to…

Machine Learning · Computer Science 2023-03-15 Sepehr Bakhshi , Pouya Ghahramanian , Hamed Bonab , Fazli Can

This paper constructs an ensemble-based sampling smoother for four-dimensional data assimilation using a Hybrid/Hamiltonian Monte-Carlo approach. The smoother samples efficiently from the posterior probability density of the solution at the…

Numerical Analysis · Computer Science 2015-05-19 Ahmed Attia , Vishwas Rao , Adrian Sandu

Ensembling has proven to be a powerful technique for boosting model performance, uncertainty estimation, and robustness in supervised learning. Advances in self-supervised learning (SSL) enable leveraging large unlabeled corpora for…

Machine Learning · Computer Science 2023-04-11 Yangjun Ruan , Saurabh Singh , Warren Morningstar , Alexander A. Alemi , Sergey Ioffe , Ian Fischer , Joshua V. Dillon

Deep Learning (DL) methods have emerged as one of the most powerful tools for functional approximation and prediction. While the representation properties of DL have been well studied, uncertainty quantification remains challenging and…

Machine Learning · Statistics 2022-10-25 Yuexi Wang , Nicholas G. Polson , Vadim O. Sokolov

This paper investigates ensemble Kalman inversion (EKI) for variational inverse problems with convex, potentially non-smooth regularization. While deterministic EKI and its Tikhonov-regularized variants have primarily been analyzed for…

Numerical Analysis · Mathematics 2026-03-24 Simon Weissmann

Extreme learning machine (ELM) as a neural network algorithm has shown its good performance, such as fast speed, simple structure etc, but also, weak robustness is an unavoidable defect in original ELM for blended data. We present a new…

Machine Learning · Computer Science 2014-09-24 Bo Han , Bo He , Rui Nian , Mengmeng Ma , Shujing Zhang , Minghui Li , Amaury Lendasse

The ensemble smoother with multiple data assimilation (ES-MDA) is becoming a popular assisted history matching method. In its standard form, the method requires the specification of the number of iterations in advance. If the selected…

Numerical Analysis · Mathematics 2024-06-11 Alexandre A. Emerick