English
Related papers

Related papers: Uncertainty-Aware PCA for Arbitrarily Distributed …

200 papers

The prohibitive cost of performing Uncertainty Quantification (UQ) tasks with a very large number of input parameters can be addressed, if the response exhibits some special structure that can be discovered and exploited. Several physical…

Computational Physics · Physics 2016-02-16 Ilias Bilionis , Rohit Tripathy , Marcial Gonzalez

Statistical inference from high-dimensional data with low-dimensional structures has recently attracted lots of attention. In machine learning, deep generative modeling approaches implicitly estimate distributions of complex objects by…

Statistics Theory · Mathematics 2022-02-21 Rong Tang , Yun Yang

We consider Bayesian inference problems with computationally intensive likelihood functions. We propose a Gaussian process (GP) based method to approximate the joint distribution of the unknown parameters and the data. In particular, we…

Computation · Statistics 2018-03-15 Hongqiao Wang , Jinglai Li

We formulate a reduced-order strategy for efficiently forecasting complex high-dimensional dynamical systems entirely based on data streams. The first step of our method involves reconstructing the dynamics in a reduced-order subspace of…

Data Analysis, Statistics and Probability · Physics 2017-03-08 Zhong Yi Wan , Themistoklis P. Sapsis

Gaussian processes are a widely embraced technique for regression and classification due to their good prediction accuracy, analytical tractability and built-in capabilities for uncertainty quantification. However, they suffer from the…

Optimization and Control · Mathematics 2024-02-07 Mickael Binois , Victor Picheny

We consider the problem of distributedly estimating Gaussian processes in multi-agent frameworks. Each agent collects few measurements and aims to collaboratively reconstruct a common estimate based on all data. Agents are assumed with…

Multiagent Systems · Computer Science 2018-05-11 Gianluigi Pillonetto , Luca Schenato , Damiano Varagnolo

The assumption of Gaussian or Gaussian mixture data has been extensively exploited in a long series of precise performance analyses of machine learning (ML) methods, on large datasets having comparably numerous samples and features. To…

Machine Learning · Statistics 2025-03-14 Xiaoyi Mai , Zhenyu Liao

Incomplete covariate vectors are known to be problematic for estimation and inferences on model parameters, but their impact on prediction performance is less understood. We develop an imputation-free method that builds on a random…

Methodology · Statistics 2024-05-31 Matthew J. Heiner , Garritt L. Page , Fernando Andrés Quintana

We introduce a new approximate multiresolution analysis (MRA) using a single Gaussian as the scaling function, which we call Gaussian MRA (GMRA). As an initial application, we employ this new tool to accurately and efficiently compute the…

Numerical Analysis · Mathematics 2017-06-07 Gregory Beylkin , Lucas Monzon , Ignas Satkauskas

In several application domains, high-dimensional observations are collected and then analysed in search for naturally occurring data clusters which might provide further insights about the nature of the problem. In this paper we describe a…

Machine Learning · Statistics 2012-03-07 Brian McWilliams , Giovanni Montana

Principal component analysis (PCA) is very popular to perform dimension reduction. The selection of the number of significant components is essential but often based on some practical heuristics depending on the application. Only few works…

Machine Learning · Statistics 2017-09-19 Clément Elvira , Pierre Chainais , Nicolas Dobigeon

Uncertainty analysis in the outcomes of model predictions is a key element in decision-based material design to establish confidence in the models and evaluate the fidelity of models. Uncertainty Propagation (UP) is a technique to determine…

Machine Learning · Computer Science 2023-02-13 Danial Khatamsaz , Vahid Attari , Raymundo Arroyave , Douglas L. Allaire

Principal component analysis (PCA) represents a standard approach to identify collective variables $\{x_i\}\!=\!\boldsymbol{x}$, which can be used to construct the free energy landscape $\Delta G(\boldsymbol{x})$ of a molecular system.…

Biomolecules · Quantitative Biology 2019-05-30 Matthias Post , Steffen Wolf , Gerhard Stock

Bayesian model comparison (BMC) offers a principled probabilistic approach to study and rank competing models. In standard BMC, we construct a discrete probability distribution over the set of possible models, conditional on the observed…

Machine Learning · Statistics 2023-02-22 Marvin Schmitt , Stefan T. Radev , Paul-Christian Bürkner

Quantifying aleatoric uncertainty in medical image segmentation is critical since it is a reflection of the natural variability observed among expert annotators. A conventional approach is to model the segmentation distribution using the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Phi Van Nguyen , Ngoc Huynh Trinh , Duy Minh Lam Nguyen , Phu Loc Nguyen , Quoc Long Tran

A new methodology is proposed for generating realizations of a random vector with values in a finite-dimensional Euclidean space that are statistically consistent with a data set of observations of this vector. The probability distribution…

Probability · Mathematics 2016-08-24 Christian Soize , Roger Ghanem

This paper addresses the problem of identifying a lower dimensional space where observed data can be sparsely represented. This under-complete dictionary learning task can be formulated as a blind separation problem of sparse sources…

Methodology · Statistics 2010-08-30 Nicolas Dobigeon , Jean-Yves Tourneret

It is now practically the norm for data to be very high dimensional in areas such as genetics, machine vision, image analysis and many others. When analyzing such data, parametric models are often too inflexible while nonparametric…

Methodology · Statistics 2011-05-31 Abhishek Bhattacharya , Garritt Page , David Dunson

In many inverse problems such as 3D X-ray Computed Tomography (CT), the estimation of an unknown quantity, such as a volume or an image, can be greatly enhanced, compared to maximum-likelihood techniques, by incorporating a prior model on…

Computation · Statistics 2018-09-03 Camille Chapdelaine

The complex Gaussian distribution has been widely used as a fundamental spectral and noise model in signal processing and communication. However, its Gaussian structure often limits its ability to represent the diverse amplitude…

Machine Learning · Statistics 2026-03-30 Toru Nakashika