English
Related papers

Related papers: Sampling error mitigation through spectrum smoothi…

200 papers

Uncertainty quantification in automated image analysis is highly desired in many applications. Typically, machine learning models in classification or segmentation are only developed to provide binary answers; however, quantifying the…

This work introduces a novel nonlinear optimal filtering method, termed the Ensemble Schr{\"o}dinger Bridge nonlinear filter. The proposed filter combines the standard prediction step with a diffusion-generative-modeling-based analysis…

Machine Learning · Computer Science 2026-05-12 Hui Sun

The iterative ensemble Kalman filter (IEnKF) is widely used in inverse problems to estimate system parameters from limited observations. However, the IEnKF, when applied to nonlinear systems, can be plagued by poor convergence. Here we…

Optimization and Control · Mathematics 2019-10-11 Jiacheng Wu , Jian-Xun Wang , Shawn C. Shadden

Spectral clustering refers to a family of unsupervised learning algorithms that compute a spectral embedding of the original data based on the eigenvectors of a similarity graph. This non-linear transformation of the data is both the key of…

Machine Learning · Computer Science 2019-01-30 Nicolas Tremblay , Andreas Loukas

The ensemble Kalman filter (EnKF) is an efficient algorithm for many data assimilation problems. In certain circumstances, however, divergence of the EnKF might be spotted. In previous studies, the authors proposed an…

Atmospheric and Oceanic Physics · Physics 2014-08-19 Xiaodong Luo , Ibrahim Hoteit

Deep Learning methods are known to suffer from calibration issues: they typically produce over-confident estimates. These problems are exacerbated in the low data regime. Although the calibration of probabilistic models is well studied,…

Machine Learning · Statistics 2021-11-30 Rahul Rahaman , Alexandre H. Thiery

On noisy intermediate-scale quantum (NISQ) devices, expectation values of many observables are obtained through sampling-based approximations to trace-like quantities. A central limitation of this approach is destructive cancellation under…

Quantum Physics · Physics 2026-05-06 Myeongsu Kim , Manas Sajjan , Sabre Kais

Statistical learning algorithms provide a generally-applicable framework to sidestep time-consuming experiments, or accurate physics-based modeling, but they introduce a further source of error on top of the intrinsic limitations of the…

Chemical Physics · Physics 2024-05-17 Matthias Kellner , Michele Ceriotti

Boltzmann sampling based on Metropolis algorithm has been extensively used for simulating a canonical ensemble. An estimate of a mechanical property, like energy, of an equilibrium system, can be made by averaging over a large number…

Statistical Mechanics · Physics 2017-10-04 K P N Murthy

Despite increasing popularity in empirical studies, the integration of machine learning generated variables into regression models for statistical inference suffers from the measurement error problem, which can bias estimation and threaten…

Econometrics · Economics 2024-12-23 Gordon Burtch , Edward McFowland , Mochen Yang , Gediminas Adomavicius

Implicit samplers are algorithms for producing independent, weighted samples from multi-variate probability distributions. These are often applied in Bayesian data assimilation algorithms. We use Laplace asymptotic expansions to analyze two…

Numerical Analysis · Mathematics 2014-10-24 Jonathan Goodman , Kevin K. Lin , Matthias Morzfeld

In order to reach the sensitivity required to detect gravitational waves, pulsar timing array experiments need to mitigate as much noise as possible in timing data. A dominant amount of noise is likely due to variations in the dispersion…

Instrumentation and Methods for Astrophysics · Physics 2015-06-19 K. J. Lee , C. G. Bassa , G. H. Janssen , R. Karuppusamy , M. Kramer , K. Liu , D. Perrodin , R. Smits , B. W. Stappers , R. van Haasteren , L. Lentati

In the strong-constraint formulation of the history-matching problem, we assume that all the model errors relate to a selection of uncertain model input parameters. One does not account for additional model errors that could result from,…

Data Analysis, Statistics and Probability · Physics 2018-12-04 Geir Evensen

In this paper, we propose a new framework for solving state estimation problems with an additional sparsity-promoting $L_1$-regularizer term. We first formulate such problems as minimization of the sum of linear or nonlinear quadratic error…

Information Theory · Computer Science 2019-10-02 Rui Gao , Filip Tronarp , Simo Särkkä

Ensembling is a simple and popular technique for boosting evaluation performance by training multiple models (e.g., with different initializations) and aggregating their predictions. This approach is commonly reserved for the largest…

Machine Learning · Computer Science 2020-05-05 Dan Kondratyuk , Mingxing Tan , Matthew Brown , Boqing Gong

Ensembles improve prediction performance and allow uncertainty quantification by aggregating predictions from multiple models. In deep ensembling, the individual models are usually black box neural networks, or recently, partially…

Machine Learning · Statistics 2022-05-26 Lucas Kook , Andrea Götschi , Philipp FM Baumann , Torsten Hothorn , Beate Sick

Sampling experiments provide a viable route to show quantum advantages of quantum devices over classical computers in well-defined computational tasks. However, quantum devices such as boson samplers are susceptible to various errors,…

Quantum Physics · Physics 2025-05-02 Deepesh Singh , Ryan J. Marshman , Nathan Walk , Jens Eisert , Timothy C. Ralph , Austin P. Lund

For objects in the low Earth orbit region, uncertainty in atmospheric density estimation is an important source of orbit prediction error, which is critical for space situational awareness activities such as the satellite conjunction…

Space Physics · Physics 2022-11-01 Smriti Nandan Paul , Richard J. Licata , Piyush M. Mehta

The random demodulator is a recent compressive sensing architecture providing efficient sub-Nyquist sampling of sparse band-limited signals. The compressive sensing paradigm requires an accurate model of the analog front-end to enable…

Information Theory · Computer Science 2013-03-26 Pawel Jerzy Pankiewicz , Thomas Arildsen , Torben Larsen

In recent years, several ensemble-based filtering methods have been proposed and studied. The main challenge in such procedures is the updating of a prior ensemble to a posterior ensemble at every step of the filtering recursions. In the…

Methodology · Statistics 2019-04-11 Margrethe Kvale Loe , Håkon Tjelmeland