English
Related papers

Related papers: Cross-Entropy method: convergence issues for exten…

200 papers

We propose a class of strongly efficient rare event simulation estimators for random walks and compound Poisson processes with a regularly varying increment/jump-size distribution in a general large deviations regime. Our estimator is based…

Probability · Mathematics 2017-06-14 Bohan Chen , Jose Blanchet , Chang-Han Rhee , Bert Zwart

In this paper, we propose a novel robust stochastic optimization approach with a distinctive consideration for rare events, in which divergence measures are used to bound the event-wise ambiguity sets. This is done by using the Poisson…

Optimization and Control · Mathematics 2021-09-14 Aakil M. Caunhye , Douglas Alem

Evaluating rare but high-stakes events is one of the main challenges in obtaining reliable reinforcement learning policies, especially in large or infinite state/action spaces where limited scalability dictates a prohibitively large number…

Machine Learning · Computer Science 2022-10-04 Mengdi Xu , Peide Huang , Fengpei Li , Jiacheng Zhu , Xuewei Qi , Kentaro Oguchi , Zhiyuan Huang , Henry Lam , Ding Zhao

The problem of assigning probability distributions which objectively reflect the prior information available about experiments is one of the major stumbling blocks in the use of Bayesian methods of data analysis. In this paper the method of…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Ariel Caticha , Roland Preuss

Time series forecasting is an important task that involves analyzing temporal dependencies and underlying patterns (such as trends, cyclicality, and seasonality) in historical data to predict future values or trends. Current deep…

Machine Learning · Computer Science 2025-12-01 Jieting Wang , Huimei Shi , Feijiang Li , Xiaolei Shang

Climate science needs more efficient ways to study high-impact, low-probability extreme events, which are rare by definition and costly to simulate in large numbers. Rare event sampling (RES) and ensemble boosting use small perturbations to…

Atmospheric and Oceanic Physics · Physics 2025-10-21 Justin Finkel , Paul A. O'Gorman

Cross entropy (XE) measure is a widely used benchmarking to demonstrate quantum computational advantage from sampling problems, such as random circuit sampling using superconducting qubits and boson sampling (BS). We present a heuristic…

Quantum Physics · Physics 2023-07-19 Changhun Oh , Liang Jiang , Bill Fefferman

We consider a class of chance-constrained programs in which profit needs to be maximized while enforcing that a given adverse event remains rare. Using techniques from large deviations and extreme value theory, we show how the optimal value…

Optimization and Control · Mathematics 2025-11-12 Jose Blanchet , Joost Jorritsma , Bert Zwart

Approximate Bayesian computation (ABC) is a well-established family of Monte Carlo methods for performing approximate Bayesian inference in the case where an ``implicit'' model is used for the data: when the data model can be simulated, but…

Computation · Statistics 2022-11-07 Ivis Kerama , Thomas Thorne , Richard G. Everitt

Many real-world optimization problems involve uncertain parameters with probability distributions that can be estimated using contextual feature information. In contrast to the standard approach of first estimating the distribution of…

Machine Learning · Statistics 2023-08-03 Meng Qi , Paul Grigas , Zuo-Jun Max Shen

This article analyzes and compares two general techniques of rare event simulation for generating paths of Markov processes over fixed time horizons: exponential tilting and stochastic bridge. These two methods allow to accurately compute…

Statistical Mechanics · Physics 2025-08-27 Javier Aguilar , Riccardo Gatto

The conditional extremes (CE) framework has proven useful for analysing the joint tail behaviour of random vectors. However, when applied across many locations or variables, it can be difficult to interpret or compare the resulting extremal…

Methodology · Statistics 2025-10-24 Patrick O'Toole , Christian Rohrbeck , Jordan Richards

The EM (Expectation-Maximization) algorithm is regarded as an MM (Majorization-Minimization) algorithm for maximum likelihood estimation of statistical models. Expanding this view, this paper demonstrates that by choosing an appropriate…

Optimization and Control · Mathematics 2026-02-12 Kensuke Asai , Jun-ya Gotoh

In this paper, we consider an importance sampling problem for a certain rare-event simulations involving the behavior of a diffusion process pertaining to a chain of distributed systems with random perturbations. We also assume that the…

Optimization and Control · Mathematics 2020-08-26 Getachew K. Befekadu

Evaluating the reliability of intelligent physical systems against rare safety-critical events poses a huge testing burden for real-world applications. Simulation provides a useful platform to evaluate the extremal risks of these systems…

Machine Learning · Computer Science 2021-03-09 Mansur Arief , Zhiyuan Huang , Guru Koushik Senthil Kumar , Yuanlu Bai , Shengyi He , Wenhao Ding , Henry Lam , Ding Zhao

Deep neural networks have shown exceptional performance in various tasks, but their lack of robustness, reliability, and tendency to be overconfident pose challenges for their deployment in safety-critical applications like autonomous…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Steven Landgraf , Markus Hillemann , Kira Wursthorn , Markus Ulrich

Rare events are events that are expected to occur infrequently, or more technically, those that have low probabilities (say, order of $10^{-3}$ or less) of occurring according to a probability model. In the context of uncertainty…

Computation · Statistics 2015-08-21 James L. Beck , Konstantin M. Zuev

We present the Tamed Cross Entropy (TCE) loss function, a robust derivative of the standard Cross Entropy (CE) loss used in deep learning for classification tasks. However, unlike other robust losses, the TCE loss is designed to exhibit the…

Machine Learning · Computer Science 2018-10-12 Manuel Martinez , Rainer Stiefelhagen

The method of Maximum (relative) Entropy (ME) is used to translate the information contained in the known form of the likelihood into a prior distribution for Bayesian inference. The argument is guided by intuition gained from the…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Ariel Caticha , Roland Preuss

Process mining supports the analysis of the actual behavior and performance of business processes using event logs. % such as, e.g., sales transactions recorded by an ERP system. An essential requirement is that every event in the log must…

Databases · Computer Science 2022-06-22 Dina Bayomie , Claudio Di Ciccio , Jan Mendling
‹ Prev 1 3 4 5 6 7 10 Next ›