English
Related papers

Related papers: Selecting Reduced Models in the Cross-Entropy Meth…

200 papers

In this paper we develop a methodology that we call split sampling methods to estimate high dimensional expectations and rare event probabilities. Split sampling uses an auxiliary variable MCMC simulation and expresses the expectation of…

Computation · Statistics 2013-11-04 John R. Birge , Changgee Chang , Nicholas G. Polson

Estimating the probability of failures or accidents with aerospace systems is often necessary when new concepts or designs are introduced, as it is being done for Autonomous Aircraft. If the design is safe, as it is supposed to be, accident…

Applications · Statistics 2018-08-10 Ítalo Romani de Oliveira , Jeffery Musiak

Estimating the probability of rare failure events is an essential step in the reliability assessment of engineering systems. Computing this failure probability for complex non-linear systems is challenging, and has recently spurred the…

Machine Learning · Computer Science 2022-02-10 P. -R. Wagner , S. Marelli , I. Papaioannou , D. Straub , B. Sudret

Many real-world optimization problems involve uncertain parameters with probability distributions that can be estimated using contextual feature information. In contrast to the standard approach of first estimating the distribution of…

Machine Learning · Statistics 2023-08-03 Meng Qi , Paul Grigas , Zuo-Jun Max Shen

Importance sampling has been known as a powerful tool to reduce the variance of Monte Carlo estimator for rare event simulation. Based on the criterion of minimizing the variance of Monte Carlo estimator within a parametric family, we…

Methodology · Statistics 2013-02-11 Cheng-Der Fuh , Huei-Wen Teng , Ren-Her Wang

The inefficiency of using an unbiased estimator in a Monte Carlo procedure can be quantified using an inefficiency constant, equal to the product of the variance of the estimator and its mean computational cost. We develop methods for…

Computation · Statistics 2016-01-08 Tomasz Badowski

Traditional empirical risk minimization (ERM) for semantic segmentation can disproportionately advantage or disadvantage certain target classes in favor of an (unfair but) improved overall performance. Inspired by the recently introduced…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Attila Szabo , Hadi Jamali-Rad , Siva-Datta Mannava

Flexibility in shape and scale of Burr XII distribution can make close approximation of numerous well-known probability density functions. Due to these capabilities, the usages of Burr XII distribution are applied in risk analysis, lifetime…

Applications · Statistics 2019-01-29 Saviz Saei , Mohsen Mohammadi , Mahsa Fekriseri , Kouroush Jenab

In Part I (arXiv:1911.00619) of this article, we proposed an importance sampling algorithm to compute rare-event probabilities in forward uncertainty quantification problems. The algorithm, which we termed the "Bayesian Inverse Monte Carlo…

Computation · Statistics 2019-11-06 Siddhant Wahal , George Biros

Importance sampling has been reported to produce algorithms with excellent empirical performance in counting problems. However, the theoretical support for its efficiency in these applications has been very limited. In this paper, we…

Probability · Mathematics 2009-08-10 Jose H. Blanchet

We study the cross-entropy method (CEM) for the non-convex optimization of a continuous and parameterized objective function and introduce a differentiable variant that enables us to differentiate the output of CEM with respect to the…

Machine Learning · Computer Science 2020-08-18 Brandon Amos , Denis Yarats

The paper presents a new efficient and robust method for rare event probability estimation for computational models of an engineering product or a process returning categorical information only, for example, either success or failure. For…

Computational Engineering, Finance, and Science · Computer Science 2022-10-11 Miroslav Vořechovský

Cross-entropy method model predictive control (CEM--MPC) is a powerful gradient-free technique for nonlinear optimal control, but its performance is often limited by the reliance on random sampling. This conventional approach can lead to…

Systems and Control · Electrical Eng. & Systems 2026-05-12 Markus Walker , Daniel Frisch , Uwe D. Hanebeck

We propose a novel tree-based ensemble method named Selective Cascade of Residual ExtraTrees (SCORE). SCORE draws inspiration from representation learning, incorporates regularized regression with variable selection features, and utilizes…

Machine Learning · Computer Science 2020-09-30 Qimin Liu , Fang Liu

The naive importance sampling (IS) estimator generally does not work well in examples involving simultaneous inference on several targets, as the importance weights can take arbitrarily large values, making the estimator highly unstable. In…

Methodology · Statistics 2022-04-20 Vivekananda Roy , Evangelos Evangelou

Importance Sampling (IS) is a method for approximating expectations under a target distribution using independent samples from a proposal distribution and the associated importance weights. In many applications, the target distribution is…

Machine Learning · Statistics 2022-09-14 Gabriel Cardoso , Sergey Samsonov , Achille Thin , Eric Moulines , Jimmy Olsson

Rare event simulation and estimation for systems in equilibrium are among the most challenging topics in molecular dynamics. As was shown by Jarzynski and others, nonequilibrium forcing can theoretically be used to obtain equilibrium rare…

Optimization and Control · Mathematics 2015-06-11 Carsten Hartmann , Christof Schütte

Estimating rare events in complex systems is a key challenge in reliability analysis. The challenge grows in multimodal problems, where traditional methods often rely on a small set of design points and risk overlooking critical failure…

Computation · Statistics 2025-08-04 Sara Helal , Victor Elvira

Identifying future congestion points in electricity distribution networks is an important challenge distribution system operators face. A proven approach for addressing this challenge is to assess distribution grid adequacy using…

Systems and Control · Electrical Eng. & Systems 2022-07-12 Julian N. Betge , Barbera Droste , Jacco Heres , Simon H. Tindemans

Cross entropy (XE) measure is a widely used benchmarking to demonstrate quantum computational advantage from sampling problems, such as random circuit sampling using superconducting qubits and boson sampling (BS). We present a heuristic…

Quantum Physics · Physics 2023-07-19 Changhun Oh , Liang Jiang , Bill Fefferman