English
Related papers

Related papers: Error estimation and reduction with cross correlat…

200 papers

We propose a generic Markov Chain Monte Carlo (MCMC) algorithm to speed up computations for datasets with many observations. A key feature of our approach is the use of the highly efficient difference estimator from the survey sampling…

Methodology · Statistics 2017-08-03 Matias Quiroz , Mattias Villani , Robert Kohn

We give an analytical interpretation of how subsample-based internal covariance estimators lead to biased estimates of the covariance, due to underestimating the super-sample covariance (SSC). This includes the jackknife and bootstrap…

Cosmology and Nongalactic Astrophysics · Physics 2018-04-16 Fabien Lacasa , Martin Kunz

A brief introduction to the technique of Monte Carlo simulations in statistical physics is presented. The topics covered include statistical ensembles random and pseudo random numbers, random sampling techniques, importance sampling, Markov…

Statistical Mechanics · Physics 2016-08-31 K. P. N. Murthy

While the Quasi-Monte Carlo method of numerical integration achieves smaller integration error than standard Monte Carlo, its use in particle physics phenomenology has been hindered by the abscence of a reliable way to estimate that error.…

High Energy Physics - Phenomenology · Physics 2009-11-11 R. H. Kleiss , A. Lazopoulos

We introduce a new class of Monte Carlo methods, which we call exact estimation algorithms. Such algorithms provide unbiased estimators for equilibrium expectations associated with real- valued functionals defined on a Markov chain. We…

Computation · Statistics 2014-09-16 Peter W. Glynn , Chang-han Rhee

Monte Carlo methods -- such as Markov chain Monte Carlo (MCMC) and piecewise deterministic Markov process (PDMP) samplers -- provide asymptotically exact estimators of expectations under a target distribution. There is growing interest in…

Computation · Statistics 2024-09-09 Adrien Corenflos , Matthew Sutton , Nicolas Chopin

Machine learning models are commonly applied to human brain imaging datasets in an effort to associate function or structure with behaviour, health, or other individual phenotypes. Such models often rely on low-dimensional maps generated by…

Quantitative Methods · Quantitative Biology 2021-09-21 Gregory Kiar , Yohan Chatelain , Ali Salari , Alan C. Evans , Tristan Glatard

Boson sampling is a promising candidate for quantum supremacy. It requires to sample from a complicated distribution, and is trusted to be intractable on classical computers. Among the various classical sampling methods, the Markov chain…

Regression analysis based on many covariates is becoming increasingly common. However, when the number of covariates $p$ is of the same order as the number of observations $n$, maximum likelihood regression becomes unreliable due to…

Methodology · Statistics 2023-09-06 Emanuele Massa , Marianne Jonker , Kit Roes , Anthony Coolen

The use of improved covariance matrix estimators as an alternative to the sample estimator is considered an important approach for enhancing portfolio optimization. Here we empirically compare the performance of 9 improved covariance…

Portfolio Management · Quantitative Finance 2010-04-27 Ester Pantaleo , Michele Tumminello , Fabrizio Lillo , Rosario N. Mantegna

Due to the potential benefits of parallelization, designing unbiased Monte Carlo estimators, primarily in the setting of randomized multilevel Monte Carlo, has recently become very popular in operations research and computational…

Computation · Statistics 2024-04-03 Guanyang Wang , Jose Blanchet , Peter W. Glynn

A common problem in analysis of experiments or in lattice QCD simulations is fitting a parameterized model to the average over a number of samples of correlated data values. If the number of samples is not infinite, estimates of the…

High Energy Physics - Lattice · Physics 2008-08-27 D. Toussaint , W. Freeman

The importance-sampling Monte Carlo algorithm appears to be the universally optimal solution to the problem of sampling the state space of statistical mechanical systems according to the relative importance of configurations for the…

Statistical Mechanics · Physics 2010-06-22 Martin Weigel

Single-chain Markov chain Monte Carlo simulates realizations from a Markov chain to estimate expectations with the empirical average. The single-chain simulation is generally of considerable length and restricts many advantages of modern…

Statistics Theory · Mathematics 2024-02-01 Austin Brown

Markov chain Monte Carlo sampling methods often suffer from long correlation times. Consequently, these methods must be run for many steps to generate an independent sample. In this paper a method is proposed to overcome this difficulty.…

Numerical Analysis · Mathematics 2009-11-13 Jonathan Weare

Some classical uncertainty quantification problems require the estimation of multiple expectations. Estimating all of them accurately is crucial and can have a major impact on the analysis to perform, and standard existing Monte Carlo…

Methodology · Statistics 2022-12-02 Julien Demange-Chryst , François Bachoc , Jérôme Morio

Statisticians often use Monte Carlo methods to approximate probability distributions, primarily with Markov chain Monte Carlo and importance sampling. Sequential Monte Carlo samplers are a class of algorithms that combine both techniques to…

Computation · Statistics 2022-06-20 Chenguang Dai , Jeremy Heng , Pierre E. Jacob , Nick Whiteley

Simulations of strongly interacting lattice field theories are typically performed using Markov chain Monte Carlo algorithms. Therefore estimators of statistical errors must incorporate the effect of autocorrelations by integrating the…

High Energy Physics - Lattice · Physics 2026-05-11 Mattia Bruno , Gabriele Morandi

It is often necessary to make sampling-based statistical inference about many probability distributions in parallel. Given a finite computational resource, this article addresses how to optimally divide sampling effort between the samplers…

Methodology · Statistics 2015-02-18 Nicholas Heard , Melissa Turcotte

In this paper, we present the results of Monte Carlo simulations for two popular techniques of long-range correlations detection - classical and modified rescaled range analyses. A focus is put on an effect of different distributional…

Statistical Finance · Quantitative Finance 2012-05-24 Ladislav Kristoufek