English
Related papers

Related papers: Likelihood Ratio Gradient Estimation for Steady-St…

200 papers

In computational mechanics, multiple models are often present to describe a physical system. While Bayesian model selection is a helpful tool to compare these models using measurement data, it requires the computationally expensive…

Computation · Statistics 2025-04-14 Subhayan De , Reza Farzad , Patrick T. Brewick , Erik A. Johnson , Steven F. Wojtkiewicz

The problem of estimating an unknown discrete distribution from its samples is a fundamental tenet of statistical learning. Over the past decade, it attracted significant research effort and has been solved for a variety of divergence…

Machine Learning · Computer Science 2018-10-30 Yi Hao , Alon Orlitsky , Venkatadheeraj Pichapati

Stochastic differential equations provide a powerful tool for modelling dynamic phenomena affected by random noise. In case of repeated observations of time series for several experimental units, it is often the case that some of the…

Methodology · Statistics 2024-09-06 Fernando Baltazar-Larios , Mogens Bladt , Michael Sørensen

Reparameterization (RP) and likelihood ratio (LR) gradient estimators are used to estimate gradients of expectations throughout machine learning and reinforcement learning; however, they are usually explained as simple mathematical tricks,…

Machine Learning · Computer Science 2021-06-01 Paavo Parmas , Masashi Sugiyama

We obtain sharp sufficient conditions for exponentially integrable stochastic processes $X=\{X(t)\!\!: t\in [0,1]\}$, to have sample paths with bounded $\Phi$-variation. When $X$ is moreover Gaussian, we also provide a bound of the…

Probability · Mathematics 2017-07-20 Andreas Basse-O'Connor , Michel Weber

We consider a pair of one-parameter (alpha) families of generalized two-qubit determinantal Hilbert-Schmidt probability distributions, p_{alpha}(|rho^{PT}|) and q_{alpha}(|rho|), where rho is a 4 x 4 density matrix, rho^{PT}, its partial…

Quantum Physics · Physics 2013-05-02 Paul B. Slater

The AMP Markov property is a recently proposed alternative Markov property for chain graphs. In the case of continuous variables with a joint multivariate Gaussian distribution, it is the AMP rather than the earlier introduced LWF Markov…

Statistics Theory · Mathematics 2010-03-04 Mathias Drton , Michael Eichler

We introduce local expectation gradients which is a general purpose stochastic variational inference algorithm for constructing stochastic gradients through sampling from the variational distribution. This algorithm divides the problem of…

Machine Learning · Statistics 2015-03-06 Michalis K. Titsias

We demonstrate that centered likelihood ratio estimators for the sensitivity indices of complex stochastic dynamics are highly efficient with low, constant in time variance and consequently they are suitable for sensitivity analysis in…

Numerical Analysis · Mathematics 2016-03-23 Georgios Arampatzis , Markos A. Katsoulakis , Luc Rey-Bellet

Stochastic Gradient Descent with a constant learning rate (constant SGD) simulates a Markov chain with a stationary distribution. With this perspective, we derive several new results. (1) We show that constant SGD can be used as an…

Machine Learning · Statistics 2018-01-23 Stephan Mandt , Matthew D. Hoffman , David M. Blei

Several studies explore inferences based on stochastic volatility (SV) models, taking into account the stylized facts of return data. The common problem is that the latent parameters of many volatility models are high-dimensional and…

Statistical Finance · Quantitative Finance 2018-09-06 T. R. Santos

The paper addresses the problem of estimation of the model parameters of the logistic exponential distribution based on progressive type-I hybrid censored sample. The maximum likelihood estimates are obtained and computed numerically using…

Applications · Statistics 2023-02-13 Subhankar Dutta , Suchandan Kayal

We analyse the $\ell^2(\pi)$-convergence rate of irreducible and aperiodic Markov chains with $N$-band transition probability matrix $P$ and with invariant distribution $\pi$. This analysis is heavily based on: first the study of the…

Probability · Mathematics 2015-11-06 Loïc Hervé , James Ledoux

In this paper we are interested in multifractional stable processes where the self-similarity index $H$ is a function of time, in other words $H$ becomes time changing, and the stability index $\alpha$ is a constant. Using $\beta$- negative…

Statistics Theory · Mathematics 2017-11-23 Thi To Nhu Dang

We introduce $(\varepsilon, \delta)$-bisimulation, a novel type of approximate probabilistic bisimulation for continuous-time Markov chains. In contrast to related notions, $(\varepsilon, \delta)$-bisimulation allows the use of different…

Logic in Computer Science · Computer Science 2025-05-23 Timm Spork , Christel Baier , Joost-Pieter Katoen , Sascha Klüppelholz , Jakob Piribauer

A variety of estimators for the parameters of the Generalized Pareto distribution, the approximating distribution for excesses over a high threshold, have been proposed, always assuming the underlying data to be independent. We recently…

Applications · Statistics 2016-05-26 Lukas Martig , Jürg Hüsler

Likelihood ratios are used for a variety of applications in particle physics data analysis, including parameter estimation, unfolding, and anomaly detection. When the data are high-dimensional, neural networks provide an effective tools for…

High Energy Physics - Phenomenology · Physics 2025-03-27 Fernando Torales Acosta , Tanvi Wamorkar , Vinicius Mikuni , Benjamin Nachman

Brownian motion whose infinitesimal variance changes according to a three-state continuous time Markov Chain is studied. This Markov Chain can be viewed as a telegraph process with one on state and two off states. We first derive the…

Methodology · Statistics 2020-08-25 Vladimir Pozdnyakov , L. Mark Elbroch , Chaoran Hu , Thomas Meyer , Jun Yan

We propose a penalized pseudo-likelihood criterion to estimate the graph of conditional dependencies in a discrete Markov random field that can be partially observed. We prove the convergence of the estimator in the case of a finite or…

Methodology · Statistics 2022-09-05 Florencia Leonardi , Rodrigo R. S. Carvalho

Probing heavy new physics beyond the Standard Model (SM) increasingly relies on global effective field theory (EFT) likelihoods. We introduce differentiable, multi-scale EFT likelihoods that combine renormalization-group evolution,…

High Energy Physics - Phenomenology · Physics 2026-03-18 Aleks Smolkovič , Peter Stangl