English
Related papers

Related papers: Conditional neural control variates for variance r…

200 papers

This work presents a multilevel variant of Stein variational gradient descent to more efficiently sample from target distributions. The key ingredient is a sequence of distributions with growing fidelity and costs that converges to the…

Numerical Analysis · Mathematics 2021-04-06 Terrence Alsup , Luca Venturi , Benjamin Peherstorfer

We consider the problem of variable selection in Bayesian multivariate linear regression models, involving multiple response and predictor variables, under multivariate normal errors. In the absence of a known covariance structure,…

Methodology · Statistics 2025-07-25 Joyee Ghosh , Xun Li

Estimation of parameters that obey specific constraints is crucial in statistics and machine learning; for example, when parameters are required to satisfy boundedness, monotonicity, or linear inequalities. Traditional approaches impose…

Methodology · Statistics 2026-04-03 Lachlan Astfalck , Deborshee Sen , Sayan Patra , Edward Cripps , David Dunson

Monte Carlo estimation in plays a crucial role in stochastic reaction networks. However, reducing the statistical uncertainty of the corresponding estimators requires sampling a large number of trajectories. We propose control variates…

Methodology · Statistics 2021-10-19 Michael Backenköhler , Luca Bortolussi , Verena Wolf

In a Bayesian setting, inverse problems and uncertainty quantification (UQ) - the propagation of uncertainty through a computational (forward) model - are strongly connected. In the form of conditional expectation the Bayesian update…

Numerical Analysis · Mathematics 2014-04-09 Alexander Litvinenko , Hermann G. Matthies

Solving high-dimensional PDE-governed inverse problems is often challenging due to complex non-Gaussian posterior distributions, expensive forward model evaluations, and misspecified prior information. To address these issues, we propose a…

Machine Learning · Computer Science 2026-05-29 Yueyang Wang , Xili Wang , Kejun Tang , Xiaoliang Wan , Tao Zhou , Chao Yang

Kinetic equations play a major rule in modeling large systems of interacting particles. Uncertainties may be due to various reasons, like lack of knowledge on the microscopic interaction details or incomplete informations at the boundaries.…

Numerical Analysis · Mathematics 2019-05-01 Giacomo Dimarco , Lorenzo Pareschi

We consider continuous-time diffusion models driven by fractional Brownian motion. Observations are assumed to possess a non-trivial likelihood given the latent path. Due to the non-Markovianity and high-dimensionality of the latent paths,…

Methodology · Statistics 2015-03-25 Alexandros Beskos , Joseph Dureau , Konstantinos Kalogeropoulos

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than…

Machine Learning · Statistics 2022-09-07 Joel Janek Dabrowski , Daniel Edward Pagendam

This paper introduces two variational inference approaches for infinite-dimensional inverse problems, developed through gradient descent with a constant learning rate. The proposed methods enable efficient approximate sampling from the…

Numerical Analysis · Mathematics 2026-03-05 Jiaming Sui , Junxiong Jia , Jinglai Li

Causal effect moderation investigates how the effect of interventions (or treatments) on outcome variables changes based on observed characteristics of individuals, known as potential effect moderators. With advances in data collection,…

Methodology · Statistics 2024-11-26 Soham Bakshi , Walter Dempsey , Snigdha Panigrahi

Bayesian methods have proved powerful in many applications for the inference of model parameters from data. These methods are based on Bayes' theorem, which itself is deceptively simple. However, in practice the computations required are…

Methodology · Statistics 2020-07-10 Michael A. Chappell , Mark W. Woolrich

Inverse problems of partial differential equations are ubiquitous across various scientific disciplines and can be formulated as statistical inference problems using Bayes' theorem. To address large-scale problems, it is crucial to develop…

Numerical Analysis · Mathematics 2025-12-23 Yang Zhao , Haoyu Lu , Junxiong Jia , Tao Zhou

Bayesian inference promises a framework for principled uncertainty quantification of neural network predictions. Barriers to adoption include the difficulty of fully characterizing posterior distributions on network parameters and the…

Machine Learning · Statistics 2025-01-22 Katharine Fisher , Youssef Marzouk

The formulation of Bayesian inverse problems involves choosing prior distributions; choices that seem equally reasonable may lead to significantly different conclusions. We develop a computational approach to better understand the impact of…

Computation · Statistics 2026-01-08 John E. Darges , Alen Alexanderian , Pierre A. Gremaud

Bayesian approach, as a useful tool for quantifying uncertainties, has been widely used for solving inverse problems of partial differential equations (PDEs). One of the key difficulties for employing Bayesian approach for the issue is how…

Numerical Analysis · Mathematics 2026-02-09 Junxiong Jia , Qian Zhao , Zongben Xu , Deyu Meng , Yee Leung

Posterior sampling by Monte Carlo methods provides a more comprehensive solution approach to inverse problems than computing point estimates such as the maximum posterior using optimization methods, at the expense of usually requiring many…

Numerical Analysis · Mathematics 2024-11-28 Paolo Villani , Daniel Andrés-Arcones , Jörg F. Unger , Martin Weiser

Score-based models, trained with denoising score matching, are remarkably effective in generating high dimensional data. However, the high variance of their training objective hinders optimisation. We attempt to reduce it with a control…

Machine Learning · Computer Science 2024-08-23 Paul Jeha , Will Grathwohl , Michael Riis Andersen , Carl Henrik Ek , Jes Frellsen

Dynamic factor models are often estimated by point-estimation methods, disregarding parameter uncertainty. We propose a method accounting for parameter uncertainty by means of posterior approximation, using variational inference. Our…

Methodology · Statistics 2022-10-14 Erik Spånberg

Many problems in computational science and engineering become one-to-many after coarse graining, partial observation, or inverse reconstruction: a resolved state may not determine a unique subgrid forcing, a structural descriptor may not…

Machine Learning · Statistics 2026-05-28 Junfeng Chen