English
Related papers

Related papers: Unbiased approximations of products of expectation…

200 papers

We consider the problem of static Bayesian inference for partially observed Levy-process models. We develop a methodology which allows one to infer static parameters and some states of the process, without a bias from the…

Computation · Statistics 2022-04-01 Hamza Ruzayqat , Ajay Jasra

A new empirical Bayes approach to variable selection in the context of generalized linear models is developed. The proposed algorithm scales to situations in which the number of putative explanatory variables is very large, possibly much…

Methodology · Statistics 2021-06-29 Haim Bar , James Booth , Martin T. Wells

Consider a process, stochastic or deterministic, obtained by using a numerical integration scheme, or from Monte-Carlo methods involving an approximation to an integral, or a Newton-Raphson iteration to approximate the root of an equation.…

Computational Finance · Quantitative Finance 2010-06-17 Don McLeish

This paper concerns the use of the expectation-maximisation (EM) algorithm for inference in partially observed diffusion processes. In this context, a well known problem is that all except a few diffusion processes lack closed-form…

Statistics Theory · Mathematics 2010-08-18 Jimmy Olsson , Jonas Ströjby

Latent variable models have been playing a central role in psychometrics and related fields. In many modern applications, the inference based on latent variable models involves one or several of the following features: (1) the presence of…

Methodology · Statistics 2025-01-08 Siliang Zhang , Yunxiao Chen

In this paper, an alternative approximation to the innovation method is introduced for the parameter estimation of diffusion processes from partial and noisy observations. This is based on a convergent approximation to the first two…

Optimization and Control · Mathematics 2013-12-19 J. C. Jimenez

In this article we consider the estimation of static parameters for partially observed diffusion process with discrete-time observations over a fixed time interval. In particular, we assume that one must time-discretize the partially…

Computation · Statistics 2023-09-20 Elsiddig Awadelkarim , Ajay Jasra , Hamza Ruzayqat

In linear regression we wish to estimate the optimum linear least squares predictor for a distribution over $d$-dimensional input points and real-valued responses, based on a small sample. Under standard random design analysis, where the…

Machine Learning · Statistics 2022-06-08 Michał Dereziński , Manfred K. Warmuth , Daniel Hsu

We develop new unbiased estimators of a number of quantities defined for functions of conditional moments, like conditional expectations and variances, of functions of two independent random variables given the first variable, including…

Computation · Statistics 2013-10-03 Tomasz Badowski

We develop a general framework for generating estimators of a given quantity which are unbiased to a given order in the difference between the true value of the underlying quantity and the fiducial position in theory space around which we…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-22 Mathew S. Madhavacheril , Patrick McDonald , Neelima Sehgal , Anže Slosar

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

Methodology · Statistics 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

The state estimation problem for nonlinear systems with stochastic uncertainties can be formulated in the Bayesian framework, where the objective is to replace the state completely by its probability density function. Without the…

Optimization and Control · Mathematics 2024-04-04 Lukas Ecker , Kurt Schlacher

Complex scientific models where the likelihood cannot be evaluated present a challenge for statistical inference. Over the past two decades, a wide range of algorithms have been proposed for learning parameters in computationally feasible…

Computation · Statistics 2021-12-16 Aden Forrow , Ruth E. Baker

Standard practice obtains an unbiased variance estimator by dividing by $N-1$ rather than $N$. Yet if only half the data are used to compute the mean, dividing by $N$ can still yield an unbiased estimator. We show that an alternative mean…

Statistics Theory · Mathematics 2025-04-10 Dai Akita

We present a new unbiased algorithm that estimates the expected value of f(U) via Monte Carlo simulation, where U is a vector of d independent random variables, and f is a function of d variables. We assume that f does not depend equally on…

Computation · Statistics 2020-06-02 Nabil Kahale

Partial differential equation is a powerful tool to characterize various physics systems. In practice, measurement errors are often present and probability models are employed to account for such uncertainties. In this paper, we present a…

Probability · Mathematics 2016-05-23 Xiaoou Li , Jingchen Liu

We provide a general methodology for unbiased estimation for intractable stochastic models. We consider situations where the target distribution can be written as an appropriate limit of distributions, and where conventional approaches…

Methodology · Statistics 2014-12-01 Sergios Agapiou , Gareth O. Roberts , Sebastian J. Vollmer

We study the problem of unbiased estimation of expectations with respect to (w.r.t.) $\pi$ a given, general probability measure on $(\mathbb{R}^d,\mathcal{B}(\mathbb{R}^d))$ that is absolutely continuous with respect to a standard Gaussian…

Computation · Statistics 2022-10-26 Hamza Ruzayqat , Alexandros Beskos , Dan Crisan , Ajay Jasra , Nikolas Kantas

Motivated by various computational applications, we investigate the problem of estimating nested expectations. Building upon recent work by the authors, we propose a novel Monte Carlo estimator for nested expectations, inspired by sparse…

Numerical Analysis · Mathematics 2023-06-08 Tomohiko Hironaka , Takashi Goda

Approximate Bayesian Computation is a family of likelihood-free inference techniques that are well-suited to models defined in terms of a stochastic generating mechanism. In a nutshell, Approximate Bayesian Computation proceeds by computing…

Computation · Statistics 2010-07-28 Michael Blum