English
Related papers

Related papers: Calculating the Expected Value of Sample Informati…

200 papers

Monte Carlo methods are widely used to estimate observables in many-body quantum systems. However, conventional sampling schemes often require a large number of samples to achieve sufficient accuracy. In this work we propose the…

Quantum Physics · Physics 2026-01-29 Wenxuan Zhang , Dingzu Wang , Dario Poletti

The concept of probabilistic values, such as Beta Shapley values and weighted Banzhaf values, has gained recent attention in applications like feature attribution and data valuation. However, exact computation of these values is often…

Machine Learning · Computer Science 2024-11-01 Weida Li , Yaoliang Yu

Importance sampling is a rare event simulation technique used in Monte Carlo simulations to bias the sampling distribution towards the rare event of interest. By assigning appropriate weights to sampled points, importance sampling allows…

Markov chain Monte Carlo methods are a powerful and commonly used family of numerical methods for sampling from complex probability distributions. As applications of these methods increase in size and complexity, the need for efficient…

Numerical Analysis · Mathematics 2019-01-31 Colin Cotter , Simon Cotter , Paul Russell

Data valuation has found various applications in machine learning, such as data filtering, efficient learning and incentives for data sharing. The most popular current approach to data valuation is the Shapley value. While popular for its…

Machine Learning · Computer Science 2023-11-10 Lauren Watson , Zeno Kujawa , Rayna Andreeva , Hao-Tsung Yang , Tariq Elahi , Rik Sarkar

Statisticians often use Monte Carlo methods to approximate probability distributions, primarily with Markov chain Monte Carlo and importance sampling. Sequential Monte Carlo samplers are a class of algorithms that combine both techniques to…

Computation · Statistics 2022-06-20 Chenguang Dai , Jeremy Heng , Pierre E. Jacob , Nick Whiteley

One way to investigate the precision of estimates likely to result from planned experiments and planned epidemiological studies is to simulate a large number of possible outcomes and analyse the sets of possible results. This appears to be…

Computation · Statistics 2013-06-28 G. K. Robinson , L. M. Ryan

Subsampling techniques can reduce the computational costs of processing big data. Practical subsampling plans typically involve initial uniform sampling and refined sampling. With a subsample, big data inferences are generally built on the…

Methodology · Statistics 2022-09-13 Yan Fan , Yang Liu , Yukun Liu , Jing Qin

Bayesian model selection provides a powerful framework for objectively comparing models directly from observed data, without reference to ground truth data. However, Bayesian model selection requires the computation of the marginal…

Methodology · Statistics 2024-01-17 Xiaohao Cai , Jason D. McEwen , Marcelo Pereyra

In the nano era in integrated circuit fabrication technologies, the performance variability due to statistical process and circuit parameter variations is becoming more and more significant. Considerable effort has been expended in the EDA…

Other Computer Science · Computer Science 2009-09-29 Alp Arslan Bayrakci , Alper Demir , Serdar Tasiran

Practitioners of Bayesian statistics have long depended on Markov chain Monte Carlo (MCMC) to obtain samples from intractable posterior distributions. Unfortunately, MCMC algorithms are typically serial, and do not scale to the large…

Machine Learning · Statistics 2015-06-11 Maxim Rabinovich , Elaine Angelino , Michael I. Jordan

External controls (ECs) from historical trials or real-world data have gained increasing attention as a way to augment hybrid and single-arm trials, especially when balanced randomization is infeasible. While most existing work has focused…

Methodology · Statistics 2025-12-15 Yujing Gao , Xiang Zhang , Shu Yang

One of the well-known challenges in optimal experimental design is how to efficiently estimate the nested integrations of the expected information gain. The Gaussian approximation and associated importance sampling have been shown to be…

Computation · Statistics 2021-08-17 Quan Long

Planning empirical experiments such as clinical trials or A/B tests requires sample size determination, which in many interesting cases has no closed-form solution (e.g. factorial or adaptive designs). adsasi is a new R package that enables…

Methodology · Statistics 2026-04-16 Skerdi Haviari

This article addresses online variational estimation in parametric state-space models. We propose a new procedure for efficiently computing the evidence lower bound and its gradient in a streaming-data setting, where observations arrive…

Methodology · Statistics 2026-02-09 Mathis Chagneux , Mathias Müller , Pierre Gloaguen , Sylvain Le Corff , Jimmy Olsson

Research often necessitates of samples, yet obtaining large enough samples is not always possible. When it is, the researcher may use one of two methods for deciding upon the required sample size: rules-of-thumb, quick yet uncertain, and…

Methodology · Statistics 2016-04-08 Jose D. Perezgonzalez

To improve the efficiency of Monte Carlo estimation, practitioners are turning to biased Markov chain Monte Carlo procedures that trade off asymptotic exactness for computational speed. The reasoning is sound: a reduction in variance due to…

Machine Learning · Statistics 2019-01-03 Jackson Gorham , Lester Mackey

This paper considers the challenging computational task of estimating nested expectations. Existing algorithms, such as nested Monte Carlo or multilevel Monte Carlo, are known to be consistent but require a large number of samples at both…

Machine Learning · Statistics 2025-06-05 Zonghao Chen , Masha Naslidnyk , François-Xavier Briol

We consider selecting the top-$m$ alternatives from a finite number of alternatives via Monte Carlo simulation. Under a Bayesian framework, we formulate the sampling decision as a stochastic dynamic programming problem, and develop a…

Optimization and Control · Mathematics 2023-08-22 Gongbo Zhang , Yijie Peng , Jianghua Zhang , Enlu Zhou

Effort estimation is a key factor for software project success, defined as delivering software of agreed quality and functionality within schedule and budget. Traditionally, effort estimation has been used for planning and tracking project…

Software Engineering · Computer Science 2014-01-24 Adam Trendowicz , Jürgen Münch , Ross Jeffery