English
Related papers

Related papers: Variational Gaussian approximation of the Kushner …

200 papers

We study optimization problems whereby the optimization variable is a probability measure. Since the probability space is not a vector space, many classical and powerful methods for optimization (e.g., gradients) are of little help. Thus,…

Optimization and Control · Mathematics 2024-06-18 Nicolas Lanzetti , Antonio Terpin , Florian Dörfler

In the present paper we consider the semiclassical magnetic Schr\"odinger equation, which describes the dynamics of particles under the influence of a magnetic field. The solution of the time-dependent Schr\"odinger equation is approximated…

Numerical Analysis · Mathematics 2023-10-26 Selina Burkhard , Benjamin Dörich , Marlis Hochbruck , Caroline Lasser

We apply a Gaussian variational approximation to model reduction in large biochemical networks of unary and binary reactions. We focus on a small subset of variables (subnetwork) of interest, e.g. because they are accessible experimentally,…

Chemical Physics · Physics 2017-08-02 Barbara Bravi , Peter Sollich

Direct quantile regression involves estimating a given quantile of a response variable as a function of input variables. We present a new framework for direct quantile regression where a Gaussian process model is learned, minimising the…

Methodology · Statistics 2012-07-03 Alexis Boukouvalas , Remi Barillec , Dan Cornford

On the basis of the Vlasov chain of equations, a new infinite dispersion chain of equations is obtained for the distribution functions of mixed higher order kinematical values. In contrast to the Vlasov chain, the dispersion chain contains…

Mathematical Physics · Physics 2022-01-26 E. E. Perepelkin , B. I. Sadovnikov , N. G. Inozemtseva , I. I. Aleksandrov

We propose a transfer principle to study the adapted 2-Wasserstein distance between stochastic processes. First, we obtain an explicit formula for the distance between real-valued mean-square continuous Gaussian processes by introducing the…

Probability · Mathematics 2025-06-09 Yifan Jiang , Fang Rui Lim

Gaussian processes (GPs) offer a flexible class of priors for nonparametric Bayesian regression, but popular GP posterior inference methods are typically prohibitively slow or lack desirable finite-data guarantees on quality. We develop an…

Machine Learning · Statistics 2019-03-28 Jonathan H. Huggins , Trevor Campbell , Mikołaj Kasprzak , Tamara Broderick

We consider the problem of estimating a continuous-time Gauss-Markov source process observed through a vector Gaussian channel with an adjustable channel gain matrix. For a given (generally time-varying) channel gain matrix, we provide…

Information Theory · Computer Science 2022-02-08 Takashi Tanaka , Vrushabh Zinage , Valery Ugrinovskii , Mikael Skoglund

We develop a non-perturbative method to derive the probability distribution $P(\delta_R)$ of the density contrast within spherical cells in the quasi-linear regime. Indeed, since this corresponds to a rare-event limit a steepest-descent…

Astrophysics · Physics 2009-11-06 P. Valageas

Using quasi-Newton methods in stochastic optimization is not a trivial task given the difficulty of extracting curvature information from the noisy gradients. Moreover, pre-conditioning noisy gradient observations tend to amplify the noise.…

Optimization and Control · Mathematics 2024-04-02 Andre Carlon , Luis Espath , Raul Tempone

Laplace's method approximates a target density with a Gaussian distribution at its mode. It is computationally efficient and asymptotically exact for Bayesian inference due to the Bernstein-von Mises theorem, but for complex targets and…

Machine Learning · Computer Science 2026-03-12 Hanlin Yu , Marcelo Hartmann , Bernardo Williams , Mark Girolami , Arto Klami

Recently, several studies proposed non-linear transformations, such as a logarithmic or Gaussianization transformation, as efficient tools to recapture information about the (Gaussian) initial conditions. During non-linear evolution, part…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-16 Julien Carron , Istvan Szapudi

Natural gradients can improve convergence in stochastic variational inference significantly but inverting the Fisher information matrix is daunting in high dimensions. Moreover, in Gaussian variational approximation, natural gradient…

Computation · Statistics 2025-02-05 Linda S. L. Tan

We revisit the problem of estimating the mean of a real-valued distribution, presenting a novel estimator with sub-Gaussian convergence: intuitively, "our estimator, on any distribution, is as accurate as the sample mean is for the Gaussian…

Statistics Theory · Mathematics 2020-11-18 Jasper C. H. Lee , Paul Valiant

Variational representations of divergences and distances between high-dimensional probability distributions offer significant theoretical insights and practical advantages in numerous research areas. Recently, they have gained popularity in…

Machine Learning · Computer Science 2022-03-25 Jeremiah Birrell , Markos A. Katsoulakis , Yannis Pantazis

A kernel method is proposed to estimate the condensed density of the generalized eigenvalues of pencils of Hankel matrices whose elements have a joint noncentral Gaussian distribution with nonidentical covariance. These pencils arise when…

Statistics Theory · Mathematics 2015-10-02 Piero Barone

The problem of estimating the dynamic direction of arrival of far field signals impinging on a uniform linear array, with mutual coupling effects, is addressed. This work proposes two novel approaches able to provide accurate solutions,…

Information Theory · Computer Science 2017-02-15 Matthew Hawes , Lyudmila Mihaylova , François Septier , Simon Godsill

The state estimation problem for nonlinear systems with stochastic uncertainties can be formulated in the Bayesian framework, where the objective is to replace the state completely by its probability density function. Without the…

Optimization and Control · Mathematics 2024-04-04 Lukas Ecker , Kurt Schlacher

Our study is dedicated to the probabilistic representation and numerical approximation of solutions to coupled systems of variational inequalities. The dynamics of each component of the solution is driven by a different linear parabolic…

Probability · Mathematics 2014-01-10 Romuald Elie , Idris Kharroubi

Approximating the solution of the nonlinear filtering problem with Gaussian mixtures has been a very popular method since the 1970s. However, the vast majority of such approximations are introduced in an ad-hoc manner without theoretical…

Probability · Mathematics 2014-01-28 Dan Crisan , Kai Li