English
Related papers

Related papers: Fast Compute via MC Boosting

200 papers

We propose a novel stochastic algorithm that randomly samples entire rows and columns of the matrix as a way to approximate an arbitrary matrix function using the power series expansion. This contrasts with existing Monte Carlo methods,…

Data Structures and Algorithms · Computer Science 2024-09-23 Nicolas L. Guidotti , Juan A. Acebrón , José Monteiro

This work presents self-rewarding sequential Monte Carlo (SMC), an inference-time scaling algorithm enabling effective sampling of masked diffusion language models (MDLMs). Our algorithm stems from the observation that most existing MDLMs…

Machine Learning · Computer Science 2026-02-03 Ziwei Luo , Ziqi Jin , Lei Wang , Lidong Bing , Thomas B. Schön

We propose sequential Monte Carlo (SMC) methods for sampling the posterior distribution of state-space models under highly informative observation regimes, a situation in which standard SMC methods can perform poorly. A special case is…

Computation · Statistics 2015-07-10 Pierre Del Moral , Lawrence M. Murray

This paper concerns the use of sequential Monte Carlo methods (SMC) for smoothing in general state space models. A well-known problem when applying the standard SMC technique in the smoothing mode is that the resampling mechanism introduces…

Statistics Theory · Mathematics 2008-03-06 Jimmy Olsson , Olivier Cappé , Randal Douc , Eric Moulines

Monte Carlo simulation is an unbiased numerical tool for studying classical and quantum many-body systems. One of its bottlenecks is the lack of general and efficient update algorithm for large size systems close to phase transition or with…

Strongly Correlated Electrons · Physics 2017-01-11 Junwei Liu , Yang Qi , Zi Yang Meng , Liang Fu

Based on the principles of importance sampling and resampling, sequential Monte Carlo (SMC) encompasses a large set of powerful techniques dealing with complex stochastic dynamic systems. Many of these systems possess strong memory, with…

Methodology · Statistics 2013-02-22 Ming Lin , Rong Chen , Jun S. Liu

Sequential Monte Carlo (SMC) methods are a widely used set of computational tools for inference in non-linear non-Gaussian state-space models. We propose a new SMC algorithm to compute the expectation of additive functionals recursively.…

Methodology · Statistics 2010-12-27 Pierre Del Moral , Arnaud Doucet , Sumeetpal Singh

Uncertainty estimation in deep models is essential in many real-world applications and has benefited from developments over the last several years. Recent evidence suggests that existing solutions dependent on simple Gaussian formulations…

Machine Learning · Computer Science 2022-05-11 Jurijs Nazarovs , Ronak R. Mehta , Vishnu Suresh Lokhande , Vikas Singh

Within ab initio Quantum Monte Carlo simulations, the leading numerical cost for large systems is the computation of the values of the Slater determinants in the trial wavefunction. Each Monte Carlo step requires finding the determinant of…

Computational Physics · Physics 2017-11-22 T. McDaniel , E. F. D'Azevedo , Y. W. Li , K. Wong , P. R. C. Kent

Monte Carlo sampling is a powerful toolbox of algorithmic techniques widely used for a number of applications wherein some noisy quantity, or summary statistic thereof, is sought to be estimated. In this paper, we survey the literature for…

A core problem in statistics and probabilistic machine learning is to compute probability distributions and expectations. This is the fundamental problem of Bayesian statistics and machine learning, which frames all inference as…

Machine Learning · Statistics 2024-12-06 Christian A. Naesseth , Fredrik Lindsten , Thomas B. Schön

Sequential Monte Carlo (SMC) is a class of algorithms that approximate high-dimensional expectations of a Markov chain. SMC algorithms typically include a resampling step. There are many possible ways to resample, but the relative…

Numerical Analysis · Mathematics 2019-04-01 Robert J. Webber

In this work we detail the application of a fast convolution algorithm computing high dimensional integrals to the context of multiplicative noise stochastic processes. The algorithm provides a numerical solution to the problem of…

Computational Finance · Quantitative Finance 2015-03-19 Giacomo Bormetti , Sofia Cazzaniga

For many complex simulation tasks spanning areas such as healthcare, engineering, and finance, Monte Carlo (MC) methods are invaluable due to their unbiased estimates and precise error quantification. Nevertheless, Monte Carlo simulations…

Sequential Monte Carlo (SMC) samplers are powerful tools for Bayesian inference but suffer from high computational costs due to their reliance on large particle ensembles for accurate estimates. We introduce persistent sampling (PS), an…

Machine Learning · Statistics 2025-06-24 Minas Karamanis , Uroš Seljak

This work introduces a new method designed for Bayesian deep learning called scalable Bayesian Monte Carlo (SBMC). The method is comprised of a model and an algorithm. The model interpolates between a point estimator and the posterior. The…

Due to the potential benefits of parallelization, designing unbiased Monte Carlo estimators, primarily in the setting of randomized multilevel Monte Carlo, has recently become very popular in operations research and computational…

Computation · Statistics 2024-04-03 Guanyang Wang , Jose Blanchet , Peter W. Glynn

The Monte Carlo dropout method has proved to be a scalable and easy-to-use approach for estimating the uncertainty of deep neural network predictions. This approach was recently applied to Fault Detection and Di-agnosis (FDD) applications…

Machine Learning · Computer Science 2019-09-11 Baihong Jin , Yingshui Tan , Yuxin Chen , Alberto Sangiovanni-Vincentelli

The Self-Learning Monte Carlo (SLMC) method is a Monte Carlo approach that has emerged in recent years by integrating concepts from machine learning with conventional Monte Carlo techniques. Designed to accelerate the numerical study of…

Strongly Correlated Electrons · Physics 2025-07-18 Gaopei Pan , Chuang Chen , Zi Yang Meng

We present a high-performance budgeted multi-level Monte Carlo method for estimates on the entire spatial domain of multi-PDE problems with random input data. The method is designed to operate optimally within memory and CPU-time…

Numerical Analysis · Mathematics 2025-06-10 Niklas Baumgarten , Robert Kutri , Robert Scheichl