English
Related papers

Related papers: Relaxation-based importance sampling for structura…

200 papers

Importance weighting is a general way to adjust Monte Carlo integration to account for draws from the wrong distribution, but the resulting estimate can be highly variable when the importance ratios have a heavy right tail. This routinely…

Computation · Statistics 2024-04-12 Aki Vehtari , Daniel Simpson , Andrew Gelman , Yuling Yao , Jonah Gabry

Computational capability often falls short when confronted with massive data, posing a common challenge in establishing a statistical model or statistical inference method dealing with big data. While subsampling techniques have been…

Methodology · Statistics 2024-10-31 Yixiao Ruan , Zan Li , Zhaohui Li , Dennis K. J. Lin , Qingpei Hu , Dan Yu

High-dimensional count data poses significant challenges for statistical analysis, necessitating effective methods that also preserve explainability. We focus on a low rank constrained variant of the Poisson log-normal model, which relates…

Optimization and Control · Mathematics 2025-06-17 Bastien Batardière , Julien Chiquet , Joon Kwon , Julien Stoehr

Recent progress has been made with Adaptive Multiple Importance Sampling (AMIS) methods that show improvement in effective sample size. However, consistency for the AMIS estimator has only been established in very restricted cases.…

Optimization and Control · Mathematics 2018-03-22 Sep Thijssen , H. J. Kappen

Importance sampling is a Monte Carlo technique for efficiently estimating the likelihood of rare events by biasing the sampling distribution towards the rare event of interest. By drawing weighted samples from a learned proposal…

Machine Learning · Statistics 2025-05-20 Liam A. Kruse , Marc R. Schlichting , Mykel J. Kochenderfer

In this work, we propose to leverage the advantages of both the Artificial Neural Network (ANN) based Second Order Reliability Method (SORM) and Importance sampling to yield an Adaptive Importance Sampling based ANN, with specific…

Numerical Analysis · Mathematics 2020-09-25 Tittu Varghese Mathew , P Prajith , RO Ruiz , E Atroshchenko , S Natarajan

We consider Monte Carlo approximations to the maximum likelihood estimator in models with intractable norming constants. This paper deals with adaptive Monte Carlo algorithms, which adjust control parameters in the course of simulation. We…

Methodology · Statistics 2016-12-08 Blazej Miasojedow , Wojciech Niemiro , Jan Palczewski , Wojciech Rejchel

Simulation offers a simple and flexible way to estimate the power of a clinical trial when analytic formulae are not available. The computational burden of using simulation has, however, restricted its application to only the simplest of…

We propose a general framework to design posterior sampling methods for model-based RL. We show that the proposed algorithms can be analyzed by reducing regret to Hellinger distance in conditional probability estimation. We further show…

Machine Learning · Computer Science 2022-10-18 Alekh Agarwal , Tong Zhang

Minibatching is a very well studied and highly popular technique in supervised learning, used by practitioners due to its ability to accelerate training through better utilization of parallel processing power and reduction of stochastic…

Machine Learning · Computer Science 2016-02-09 Dominik Csiba , Peter Richtárik

Likelihood-free inference involves inferring parameter values given observed data and a simulator model. The simulator is computer code which takes parameters, performs stochastic calculations, and outputs simulated data. In this work, we…

Computation · Statistics 2023-01-30 Dennis Prangle , Cecilia Viscardi

We present an iterative framework to improve the amortized approximations of posterior distributions in the context of Bayesian inverse problems, which is inspired by loop-unrolled gradient descent methods and is theoretically grounded in…

Machine Learning · Computer Science 2023-05-16 Rafael Orozco , Ali Siahkoohi , Mathias Louboutin , Felix J. Herrmann

In the field of structural reliability, the Monte-Carlo estimator is considered as the reference probability estimator. However, it is still untractable for real engineering cases since it requires a high number of runs of the model. In…

Methodology · Statistics 2015-03-19 V. Dubourg , F. Deheeger , B. Sudret

We consider the problem of choosing design parameters to minimize the probability of an undesired rare event that is described through the average of $n$ iid random variables. Since the probability of interest for near optimal design…

Optimization and Control · Mathematics 2019-02-22 Amarjit Budhiraja , Shu Lu , Yang Yu , Quoc Tran-Dinh

Likelihood-based methods of statistical inference provide a useful general methodology that is appealing, as a straightforward asymptotic theory can be applied for their implementation. It is important to assess the relationships between…

Statistics Theory · Mathematics 2015-03-20 Thomas J. DiCiccio , Todd A. Kuffner , G. Alastair Young , Russell Zaretzki

The variance reduction established by importance sampling strongly depends on the choice of the importance sampling distribution. A good choice is often hard to achieve especially for high-dimensional integration problems. Nonparametric…

Methodology · Statistics 2010-06-10 Jan C. Neddermeyer

Recent success in Deep Reinforcement Learning (DRL) methods has shown that policy optimization with respect to an off-policy distribution via importance sampling is effective for sample reuse. In this paper, we show that the use of…

Machine Learning · Computer Science 2023-02-07 Zichuan Lin , Xiapeng Wu , Mingfei Sun , Deheng Ye , Qiang Fu , Wei Yang , Wei Liu

Importance sampling has been successfully used to accelerate stochastic optimization in many convex problems. However, the lack of an efficient way to calculate the importance still hinders its application to Deep Learning. In this paper,…

Machine Learning · Computer Science 2017-09-14 Angelos Katharopoulos , François Fleuret

This paper presents computationally feasible rank-one relaxation algorithms for the efficient simulation of a time-incremental damage model with nonconvex incremental stress potentials in multiple spatial dimensions. While the standard…

Computational Engineering, Finance, and Science · Computer Science 2023-02-10 Daniel Balzani , Maximilian Köhler , Timo Neumeier , Malte A. Peter , Daniel Peterseim

In the framework of generalized finite element methods for elliptic equations with rough coefficients, efficiency and accuracy of the numerical method depend critically on the use of appropriate basis functions. This work explores several…

Optimization and Control · Mathematics 2018-12-20 Ke Chen , Qin Li , Jianfeng Lu , Stephen J. Wright