English
Related papers

Related papers: Integral estimation based on Markovian design

200 papers

In Bayesian inference, we seek to compute information about random variables such as moments or quantiles on the basis of {available data} and prior information. When the distribution of random variables is {intractable}, Monte Carlo (MC)…

Statistics Theory · Mathematics 2021-04-06 Alec Koppel , Amrit Singh Bedi , Brian M. Sadler , Victor Elvira

Adaptive Monte Carlo methods can be viewed as implementations of Markov chains with infinite memory. We derive a general condition for the convergence of a Monte Carlo method whose history dependence is contained within the simulated…

Computational Physics · Physics 2007-05-23 David J. Earl , Michael W. Deem

Entropy estimation is a fundamental problem in information theory that has applications in various fields, including physics, biology, and computer science. Estimating the entropy of discrete sequences can be challenging due to limited data…

Statistical Mechanics · Physics 2024-01-18 Juan De Gregorio , David Sanchez , Raul Toral

In this paper we study predictive mean matching mass imputation estimators to integrate data from probability and non-probability samples. We consider two approaches: matching predicted to predicted ($\hat{y}-\hat{y}$~matching; PMM A) and…

Methodology · Statistics 2024-06-18 Piotr Chlebicki , Łukasz Chrostowski , Maciej Beręsewicz

This report introduces general ideas and some basic methods of the Bayesian probability theory applied to physics measurements. Our aim is to make the reader familiar, through examples rather than rigorous formalism, with concepts such as:…

Data Analysis, Statistics and Probability · Physics 2009-11-10 G. D'Agostini

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

In Monte-Carlo methods the Markov processes used to sample a given target distribution usually satisfy detailed balance, i.e. they are time-reversible. However, relatively recent results have demonstrated that appropriate reversible and…

Probability · Mathematics 2016-06-29 Luc Rey-Bellet , Konstantinos Spiliopoulos

We show that a probabilistic version of the classical forward-stepwise variable inclusion procedure can serve as a general data-augmentation scheme for model space distributions in (generalized) linear models. This latent variable…

Methodology · Statistics 2014-10-23 Li Ma

Most high-dimensional estimation and prediction methods propose to minimize a cost function (empirical risk) that is written as a sum of losses associated to each data point. In this paper we focus on the case of non-convex losses, which is…

Machine Learning · Statistics 2017-01-17 Song Mei , Yu Bai , Andrea Montanari

The estimation of normalizing constants is a fundamental step in probabilistic model comparison. Sequential Monte Carlo methods may be used for this task and have the advantage of being inherently parallelizable. However, the standard…

Machine Learning · Statistics 2016-08-16 Marco Fraccaro , Ulrich Paquet , Ole Winther

Partial measurements of relative position are a relatively common event during the observation of visual binary stars. However, these observations are typically discarded when estimating the orbit of a visual pair. In this article we…

Instrumentation and Methods for Astrophysics · Physics 2019-07-10 Ruben M. Claveria , Rene A. Mendez , Jorge F. Silva , Marcos E. Orchard

We design and implement a novel algorithm for computing a multilevel Monte Carlo (MLMC) estimator of the cumulative distribution function of a quantity of interest in problems with random input parameters or initial conditions. Our approach…

Numerical Analysis · Mathematics 2020-08-26 Søren Taverniers , Daniel M. Tartakovsky

Monte Carlo computer simulations are virtually the only way to analyze the thermodynamic behavior of a system in a precise way. However, the various existing methods exhibit extreme differences in their efficiency, depending on model…

Statistical Mechanics · Physics 2011-07-05 Michael Bachmann

Continuous-time trajectory estimation is an attractive alternative to discrete-time batch estimation due to the ability to incorporate high-frequency measurements from asynchronous sensors while keeping the number of optimization parameters…

Robotics · Computer Science 2024-02-02 Jacob Johnson , Joshua Mangelson , Timothy Barfoot , Randal Beard

This paper addresses distributed parameter estimation in stochastic dynamic systems with quantized measurements, constrained by quantized communication and Markovian switching directed topologies. To enable accurate recovery of the original…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Ying Wang , Jian Guo , Yanlong Zhao , Ji-feng Zhang

The approximation of integral functionals with respect to a stationary Markov process by a Riemann-sum estimator is studied. Stationarity and the functional calculus of the infinitesimal generator of the process are used to get a better…

Probability · Mathematics 2016-10-18 Randolf Altmeyer , Jakub Chorowski

Incorporating information about the target distribution in proposal mechanisms generally produces efficient Markov chain Monte Carlo algorithms (or at least, algorithms that are more efficient than uninformed counterparts). For instance, it…

Computation · Statistics 2021-08-27 Philippe Gagnon

This paper introduces a new approach to solve sensor management problems. Classically sensor management problems can be well formalized as Partially-Observed Markov Decision Processes (POMPD). The original approach developped here consists…

Machine Learning · Computer Science 2009-03-20 Thomas Bréhard , Emmanuel Duflos , Philippe Vanheeghe , Pierre-Arnaud Coquelin

Markov Chain Monte Carlo (MCMC) methods have become a cornerstone of many modern scientific analyses by providing a straightforward approach to numerically estimate uncertainties in the parameters of a model using a sequence of random…

Other Statistics · Statistics 2020-03-10 Joshua S. Speagle

The naive importance sampling estimator, based on samples from a single importance density, can be numerically unstable. Instead, we consider generalized importance sampling estimators where samples from more than one probability…

Statistics Theory · Mathematics 2016-08-12 Vivekananda Roy , Aixin Tan , James M. Flegal