English
Related papers

Related papers: Sensitivity Analysis of the Information Gain in In…

200 papers

Uncertainties exist in both physics-based and data-driven models. Variance-based sensitivity analysis characterizes how the variance of a model output is propagated from the model inputs. The Sobol index is one of the most widely used…

Methodology · Statistics 2020-06-09 Zhanlin Liu , Youngjun Choe

Probabilistic regression techniques in control and robotics applications have to fulfill different criteria of data-driven adaptability, computational efficiency, scalability to high dimensions, and the capacity to deal with different…

Machine Learning · Computer Science 2021-03-31 Hany Abdulsamad , Peter Nickl , Pascal Klink , Jan Peters

This paper studies distributed adaptive estimation over sensor networks with partially unknown source dynamics. We present parallel continuous-time and discrete-time designs in which each node runs a local adaptive observer and exchanges…

Systems and Control · Electrical Eng. & Systems 2026-05-18 Moh Kamalul Wafi , Hamidreza Montazeri Hedesh , Milad Siami

We consider the problem of reducing the dimensions of parameters and data in non-Gaussian Bayesian inference problems. Our goal is to identify an "informed" subspace of the parameters and an "informative" subspace of the data so that a…

Computation · Statistics 2022-07-19 Ricardo Baptista , Youssef Marzouk , Olivier Zahm

We consider the asymptotic behavior of posterior distributions if the model is misspecified. Given a prior distribution and a random sample from a distribution $P_0$, which may not be in the support of the prior, we show that the posterior…

Statistics Theory · Mathematics 2007-06-13 B. J. K. Kleijn , A. W. van der Vaart

The methodology developed in this article is motivated by a wide range of prediction and uncertainty quantification problems that arise in Statistics, Machine Learning and Applied Mathematics, such as non-parametric regression, multi-class…

Methodology · Statistics 2019-03-26 Victor Chen , Matthew M. Dunlop , Omiros Papaspiliopoulos , Andrew M. Stuart

We present a convolutional framework which significantly reduces the complexity and thus, the computational effort for distributed reinforcement learning control of dynamical systems governed by partial differential equations (PDEs).…

Machine Learning · Computer Science 2023-12-27 Sebastian Peitz , Jan Stenner , Vikas Chidananda , Oliver Wallscheid , Steven L. Brunton , Kunihiko Taira

Inverse problems are often ill-posed, with solutions that depend sensitively on data. In any numerical approach to the solution of such problems, regularization of some form is needed to counteract the resulting instability. This paper is…

Numerical Analysis · Mathematics 2009-09-14 S. L. Cotter , M. Dashti , A. M. Stuart

Bayesian inference for high-dimensional inverse problems is computationally costly and requires selecting a suitable prior distribution. Amortized variational inference addresses these challenges via a neural network that approximates the…

Machine Learning · Statistics 2023-01-19 Ali Siahkoohi , Gabrio Rizzuti , Rafael Orozco , Felix J. Herrmann

Given i.i.d. data from an unknown distribution, we consider the problem of predicting future items. An adaptive way to estimate the probability density is to recursively subdivide the domain to an appropriate data-dependent granularity. A…

Probability · Mathematics 2009-12-30 Marcus Hutter

In this work, we investigate the use of Besov priors in the context of Bayesian inverse problems. The solution to Bayesian inverse problems is the posterior distribution which naturally enables us to interpret the uncertainties. Besov…

Numerical Analysis · Mathematics 2025-06-23 Andreas Horst , Babak Maboudi Afkham , Yiqiu Dong , Jakob Lemvig

The accessibility of spatially distributed data, enabled by affordable sensors, field, and numerical experiments, has facilitated the development of data-driven solutions for scientific problems, including climate change, weather…

Machine Learning · Computer Science 2023-11-09 Vardhan Dongre , Gurpreet Singh Hora

Based on independently distributed $X_1 \sim N_p(\theta_1, \sigma^2_1 I_p)$ and $X_2 \sim N_p(\theta_2, \sigma^2_2 I_p)$, we consider the efficiency of various predictive density estimators for $Y_1 \sim N_p(\theta_1, \sigma^2_Y I_p)$, with…

Statistics Theory · Mathematics 2017-09-25 Éric Marchand , Abdolnasser Sadeghkhani

This paper deals with the reconstruction of small-amplitude perturbations in the electric properties (permittivity and conductivity) of a medium from boundary measurements of the electric field at a fixed frequency. The underlying model is…

Numerical Analysis · Mathematics 2019-11-07 Marion Darbas , Jérémy Heleine , Stephanie Lohrengel

Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use…

Numerical Analysis · Mathematics 2016-01-20 Matthias Morzfeld , Xuemin Tu , Jon Wilkening , Alexandre J. Chorin

This work introduces a sampling method capable of solving Bayesian inverse problems in function space. It does not assume the log-concavity of the likelihood, meaning that it is compatible with nonlinear inverse problems. The method…

Machine Learning · Statistics 2024-05-27 Lorenzo Baldassari , Ali Siahkoohi , Josselin Garnier , Knut Solna , Maarten V. de Hoop

Inverse problems involving systems of partial differential equations (PDEs) with many measurements or experiments can be very expensive to solve numerically. In a recent paper we examined dimensionality reduction methods, both stochastic…

Numerical Analysis · Computer Science 2014-12-02 Farbod Roosta-Khorasani , Kees van den Doel , Uri Ascher

We propose a geometric framework to assess global sensitivity in Bayesian nonparametric models for density estimation. We study sensitivity of nonparametric Bayesian models for density estimation, based on Dirichlet-type priors, to…

Methodology · Statistics 2018-10-10 Abhijoy Saha , Sebastian Kurtek

In this article a novel approach for training deep neural networks using Bayesian techniques is presented. The Bayesian methodology allows for an easy evaluation of model uncertainty and additionally is robust to overfitting. These are…

Machine Learning · Computer Science 2019-04-03 Konstantin Posch , Jürgen Pilz

Derivative training is an established method that can significantly increase the accuracy of neural networks in certain low-dimensional tasks. In this paper, we extend this improvement to an illustrative image analysis problem:…

Machine Learning · Computer Science 2025-02-04 Vsevolod I. Avrutskiy