English
Related papers

Related papers: On importance sampling with mixtures for random wa…

200 papers

This paper introduces a new Importance Sampling scheme, called Adaptive Twisted Importance Sampling, which is adequate for the improved estimation of rare event probabilities in he range of moderate deviations pertaining to the empirical…

Computation · Statistics 2009-10-13 Michel Broniatowski , Ya'Acov Ritov

Importance sampling is a popular method for efficient computation of various properties of a distribution such as probabilities, expectations, quantiles etc. The output of an importance sampling algorithm can be represented as a weighted…

Probability · Mathematics 2016-04-18 Henrik Hult , Pierre Nyquist

We present a comparative study of several algorithms for an in-plane random walk with a variable step. The goal is to check the efficiency of the algorithm in the case where the random walk terminates at some boundary. We recently found…

Statistical Mechanics · Physics 2019-04-17 Olga Klimenkova , Anton Yu. Menshutin , Lev N. Shchur

A hybrid evolutionary algorithm with importance sampling method is proposed for multi-dimensional optimization problems in this paper. In order to make use of the information provided in the search process, a set of visited solutions is…

Neural and Evolutionary Computing · Computer Science 2013-08-26 Guanghui Huang , Zhifeng Pan

In this paper a method based on a Markov chain Monte Carlo (MCMC) algorithm is proposed to compute the probability of a rare event. The conditional distribution of the underlying process given that the rare event occurs has the probability…

Probability · Mathematics 2012-11-12 Thorbjörn Gudmundsson , Henrik Hult

Large deviations for additive path functionals of stochastic processes have attracted significant research interest, in particular in the context of stochastic particle systems and statistical physics. Efficient numerical `cloning'…

Probability · Mathematics 2021-07-21 Letizia Angeli , Stefan Grosskinsky , Adam M. Johansen

In this study, we propose a robust mixture regression procedure based on the skew t distribution to model heavy-tailed and/or skewed errors in a mixture regression setting. Using the scale mixture representation of the skew t distribution,…

Statistics Theory · Mathematics 2017-06-12 Fatma Zehra Doğru , Olcay Arslan

Threshold selection plays a key role for various aspects of statistical inference of rare events. Most classical approaches tackling this problem for heavy-tailed distributions crucially depend on tuning parameters or critical values to be…

Methodology · Statistics 2019-03-07 Laura Fee Schneider , Andrea Krajina , Tatyana Krivobokova

Understanding the shape of a distribution of data is of interest to people in a great variety of fields, as it may affect the types of algorithms used for that data. We study one such problem in the framework of distribution property…

Machine Learning · Computer Science 2022-12-06 Maryam Aliakbarpour , Amartya Shankha Biswas , Kavya Ravichandran , Ronitt Rubinfeld

The key issue in importance sampling is the choice of the alternative sampling distribution, which is often chosen from the exponential tilt family of the underlying distribution. However, when the problem exhibits certain kind of…

Probability · Mathematics 2013-05-15 Hui Wang , Xiang Zhou

We present a Cross-Entropy based population Monte Carlo algorithm. This methods stands apart from previous work in that we are not optimizing a mixture distribution. Instead, we leverage deterministic mixture weights and optimize the…

Computation · Statistics 2022-02-09 Caleb Miller , Jem N. Corcoran , Michael D. Schneider

We discuss the quenched tail estimates for the random walk in random scenery. The random walk is the symmetric nearest neighbor walk and the random scenery is assumed to be independent and identically distributed, non-negative, and has a…

Probability · Mathematics 2018-11-27 Jean-Dominique Deuschel , Ryoki Fukushima

Randomized search algorithms for hard combinatorial problems exhibit a large variability of performances. We study the different types of rare events which occur in such out-of-equilibrium stochastic processes and we show how they cooperate…

Statistical Mechanics · Physics 2009-11-07 Andrea Montanari , Riccardo Zecchina

It is well-known that large deviations of random walks driven by independent and identically distributed heavy-tailed random variables are governed by the so-called principle of one large jump. We note that further subtleties hold for such…

Probability · Mathematics 2017-01-30 Harald Bernhard , Bikramjit Das

The era of huge data necessitates highly efficient machine learning algorithms. Many common machine learning algorithms, however, rely on computationally intensive subroutines that are prohibitively expensive on large datasets. Oftentimes,…

Machine Learning · Computer Science 2023-09-26 Mo Tiwari

Bayesian hierarchical Poisson models are an essential tool for analyzing count data. However, designing efficient algorithms to sample from the posterior distribution of the target parameters remains a challenging task for this class of…

Methodology · Statistics 2025-02-10 Aldo Gardini , Fedele Greco , Carlo Trivisano

Hit-and-Run is known to be one of the best random sampling algorithms, its mixing time is polynomial in dimension. Nevertheless, in practice the number of steps required to achieve uniformly distributed samples is rather high. We propose…

Optimization and Control · Mathematics 2014-02-13 Elena Gryazina , Boris Polyak

As the number of samples and dimensionality of optimization problems related to statistics an machine learning explode, block coordinate descent algorithms have gained popularity since they reduce the original problem to several smaller…

Machine Learning · Computer Science 2016-06-24 Rémi Flamary , Alain Rakotomamonjy , Gilles Gasso

Modern statistical analyses often encounter datasets with massive sizes and heavy-tailed distributions. For datasets with massive sizes, traditional estimation methods can hardly be used to estimate the extreme value index directly. To…

Methodology · Statistics 2022-07-26 Yongxin Li , Liujun Chen , Deyuan Li , Hansheng Wang

We consider the problem of efficient simulation estimation of the density function at the tails, and the probability of large deviations for a sum of independent, identically distributed, light-tailed and non-lattice random vectors. The…

Probability · Mathematics 2017-04-26 Santanu Dey , Sandeep Juneja , Ankush Agarwal