English
Related papers

Related papers: Analysis of Adaptive Multilevel Splitting algorith…

200 papers

Complex computer codes or models can often be run in a hierarchy of different levels of complexity ranging from the very basic to the sophisticated. The top levels in this hierarchy are typically expensive to run, which limits the number of…

Methodology · Statistics 2023-07-19 Louise Kimpton , James Salter , Tim Dodwell , Hossein Mohammadi , Peter Challenor

Stochastic modeling of reaction networks is a framework used to describe the time evolution of many natural and artificial systems, including, biochemical reactive systems at the molecular level, viral kinetics, the spread of epidemic…

Numerical Analysis · Mathematics 2014-06-10 Alvaro Moraes , Raul Tempone , Pedro Vilanova

Particle filtering is used to compute good nonlinear estimates of complex systems. It samples trajectories from a chosen distribution and computes the estimate as a weighted average. Easy-to-sample distributions often lead to degenerate…

Machine Learning · Computer Science 2021-10-07 Fernando Gama , Nicolas Zilberstein , Richard G. Baraniuk , Santiago Segarra

Combining the increasing availability and abundance of healthcare data and the current advances in machine learning methods have created renewed opportunities to improve clinical decision support systems. However, in healthcare risk…

Machine Learning · Statistics 2021-06-17 Zidi Xiu , Chenyang Tao , Michael Gao , Connor Davis , Benjamin A. Goldstein , Ricardo Henao

We develop a stochastic algorithm for independent component analysis that incorporates multi-trial supervision, which is available in many scientific contexts. The method blends a proximal gradient-type algorithm in the space of invertible…

Machine Learning · Computer Science 2025-08-29 Ronak Mehta , Mateus Piovezan Otto , Noah Stanis , Azadeh Yazdan-Shahmorad , Zaid Harchaoui

Fitting probabilistic models to data is often difficult, due to the general intractability of the partition function and its derivatives. Here we propose a new parameter estimation technique that does not require computing an intractable…

Machine Learning · Computer Science 2015-03-13 Jascha Sohl-Dickstein , Peter Battaglino , Michael R. DeWeese

Stochastic optimization in learning and inference often relies on Markov chain Monte Carlo (MCMC) to approximate gradients when exact computation is intractable. However, finite-time MCMC estimators are biased, and reducing this bias…

Statistics Theory · Mathematics 2026-02-02 Antoine Godichon-Baggioni , Gabriel Lang , Sylvain Le Corff , Julien Stoehr , Sobihan Surendran

To tackle massive data, subsampling is a practical approach to select the more informative data points. However, when responses are expensive to measure, developing efficient subsampling schemes is challenging, and an optimal sampling…

Computation · Statistics 2022-10-11 Jing Wang , HaiYing Wang , Shifeng Xiong

We construct an adaptive independent Metropolis-Hastings sampler that uses a mixture of normals as a proposal distribution. To take full advantage of the potential of adaptive sampling our algorithm updates the mixture of normals…

Computation · Statistics 2008-01-15 P. Giordani , R. Kohn

This paper considers an opportunistic scheduling problem over a renewal system. A controller observes a random event at the beginning of each renewal frame and then chooses an action in response to the event, which affects the duration of…

Optimization and Control · Mathematics 2019-06-10 Xiaohan Wei , Michael J. Neely

Multilevel Splitting methods, also called Sequential Monte-Carlo or \emph{Subset Simulation}, are widely used methods for estimating extreme probabilities of the form $P[S(\mathbf{U}) > q]$ where $S$ is a deterministic real-valued function…

Computation · Statistics 2015-07-06 Clément Walter

In solving simulation-based stochastic root-finding or optimization problems that involve rare events, such as in extreme quantile estimation, running crude Monte Carlo can be prohibitively inefficient. To address this issue, importance…

Methodology · Statistics 2021-02-23 Shengyi He , Guangxin Jiang , Henry Lam , Michael C. Fu

This paper proposes a new randomized strategy for adaptive MCMC using Bayesian optimization. This approach applies to non-differentiable objective functions and trades off exploration and exploitation to reduce the number of potentially…

Computation · Statistics 2011-11-01 Nimalan Mahendran , Ziyu Wang , Firas Hamze , Nando de Freitas

Distributed model fitting refers to the process of fitting a mathematical or statistical model to the data using distributed computing resources, such that computing tasks are divided among multiple interconnected computers or nodes, often…

Computation · Statistics 2024-06-04 Xiaofei Wu , Rongmei Liang , Fabio Roli , Marcello Pelillo , Jing Yuan

The robust estimator presented in this paper processes each structure independently. The scales of the structures are estimated adaptively and no threshold is involved in spite of different objective functions. The user has to specify only…

Computer Vision and Pattern Recognition · Computer Science 2017-04-21 Xiang Yang , Peter Meer

Sparse methods are the standard approach to obtain interpretable models with high prediction accuracy. Alternatively, algorithmic ensemble methods can achieve higher prediction accuracy at the cost of loss of interpretability. However, the…

Methodology · Statistics 2022-01-11 Anthony Christidis , Stefan Van Aelst , Ruben Zamar

The implicit particle filter is a sequential Monte Carlo method for data assimilation that guides the particles to the high-probability regions via a sequence of steps that includes minimizations. We present a new and more general…

Data Analysis, Statistics and Probability · Physics 2017-02-01 Ethan Atkins , Matthias Morzfeld , Alexandre J. Chorin

We design and implement a novel algorithm for computing a multilevel Monte Carlo (MLMC) estimator of the cumulative distribution function of a quantity of interest in problems with random input parameters or initial conditions. Our approach…

Numerical Analysis · Mathematics 2020-08-26 Søren Taverniers , Daniel M. Tartakovsky

We develop a biased Monte Carlo algorithm to measure probabilities of rare events in cluster-cluster aggregation for arbitrary collision kernels. Given a trajectory with a fixed number of collisions, the algorithm modifies both the waiting…

Statistical Mechanics · Physics 2023-05-24 Rahul Dandekar , R. Rajesh , V. Subashri , Oleg Zaboronski

Improving Importance Sampling estimators for rare event probabilities requires sharp approximations of conditional densities. This is achieved for events E_{n}:=(f(X_{1})+...+f(X_{n}))\inA_{n} where the summands are i.i.d. and E_{n} is a…

Probability · Mathematics 2012-02-08 Michel Broniatowski , Virgile Caron