English
Related papers

Related papers: Multilevel branching splitting algorithm for estim…

200 papers

We consider systems of stochastic differential equations with multiple scales and small noise and assume that the coefficients of the equations are ergodic and stationary random fields. Our goal is to construct provably-efficient importance…

Probability · Mathematics 2015-09-29 Konstantinos Spiliopoulos

We develop a biased Monte Carlo algorithm to measure probabilities of rare events in cluster-cluster aggregation for arbitrary collision kernels. Given a trajectory with a fixed number of collisions, the algorithm modifies both the waiting…

Statistical Mechanics · Physics 2023-05-24 Rahul Dandekar , R. Rajesh , V. Subashri , Oleg Zaboronski

Variable selection comprises an important step in many modern statistical inference procedures. In the regression setting, when estimators cannot shrink irrelevant signals to zero, covariates without relationships to the response often…

Statistics Theory · Mathematics 2025-03-28 Ka Long Keith Ho , Hien Duy Nguyen

Accurate and efficient estimation of rare events probabilities is of significant importance, since often the occurrences of such events have widespread impacts. The focus in this work is on precisely quantifying these probabilities, often…

Methodology · Statistics 2023-05-23 Konstantinos G. Papakonstantinou , Hamed Nikbakht , Elsayed Eshra

State-of-the-art methods for rare event simulation of non-Markovian models face practical or theoretical limits if observing the event of interest requires prior knowledge or information on the timed behavior of the system. In this paper,…

Logic in Computer Science · Computer Science 2025-06-25 Gabriel Dengler , Carlos E. Budde , Laura Carnevali , Arnd Hartmanns

In a number of applications, particularly in financial and actuarial mathematics, it is of interest to characterize the tail distribution of a random variable $V$ satisfying the distributional equation $V\stackrel{\mathcal{D}}{=}f(V)$,…

Probability · Mathematics 2014-07-04 Jeffrey F. Collamore , Guoqing Diao , Anand N. Vidyashankar

Combining the increasing availability and abundance of healthcare data and the current advances in machine learning methods have created renewed opportunities to improve clinical decision support systems. However, in healthcare risk…

Machine Learning · Statistics 2021-06-17 Zidi Xiu , Chenyang Tao , Michael Gao , Connor Davis , Benjamin A. Goldstein , Ricardo Henao

The estimation of the probability of rare events is an important task in reliability and risk assessment. We consider failure events that are expressed in terms of a limit-state function, which depends on the solution of a partial…

Numerical Analysis · Mathematics 2021-06-21 Fabian Wagner , Jonas Latz , Iason Papaioannou , Elisabeth Ullmann

The development of enhanced sampling methods has greatly extended the scope of atomistic simulations, allowing long-time phenomena to be studied with accessible computational resources. Many such methods rely on the identification of an…

Computational Physics · Physics 2022-06-08 Luigi Bonati , GiovanniMaria Piccini , Michele Parrinello

(Neal and Hinton, 1998) recast maximum likelihood estimation of any given latent variable model as the minimization of a free energy functional $F$, and the EM algorithm as coordinate descent applied to $F$. Here, we explore alternative…

Computation · Statistics 2023-02-21 Juan Kuntz , Jen Ning Lim , Adam M. Johansen

We propose a deep importance sampling method that is suitable for estimating rare event probabilities in high-dimensional problems. We approximate the optimal importance distribution in a general importance sampling problem as the…

Machine Learning · Statistics 2023-05-26 Tiangang Cui , Sergey Dolgov , Robert Scheichl

Chance constrained program is computationally intractable due to the existence of chance constraints, which are randomly disturbed and should be satisfied with a probability. This paper proposes a two-layer randomized algorithm to address…

Optimization and Control · Mathematics 2019-11-11 Xun Shen , Jiancang Zhuang , Xingguo Zhang

For statistics of rare events in systems obeying a large-deviation principle, the rate function is a key quantity. When numerically estimating the rate function one is always restricted to finite system sizes. Thus, if the interest is in…

Data Analysis, Statistics and Probability · Physics 2024-12-06 Peter Werner , Alexander K. Hartmann

Deep neural networks, when optimized with sufficient data, provide accurate representations of high-dimensional functions; in contrast, function approximation techniques that have predominated in scientific computing do not scale well with…

Data Analysis, Statistics and Probability · Physics 2021-03-15 Grant M. Rotskoff , Andrew R. Mitchell , Eric Vanden-Eijnden

The goal of this paper is to develop provably efficient importance sampling Monte Carlo methods for the estimation of rare events within the class of linear stochastic partial differential equations (SPDEs). We find that if a spectral gap…

Probability · Mathematics 2017-05-05 Michael Salins , Konstantinos Spiliopoulos

Typical performance of approximation algorithms is studied for randomized minimum vertex cover problems. A wide class of random graph ensembles characterized by an arbitrary degree distribution is discussed with some theoretical frameworks.…

Disordered Systems and Neural Networks · Physics 2016-11-10 Satoshi Takabe , Koji Hukushima

In this paper, we propose an efficient importance sampling algorithm for rare event simulation under copula models. In the algorithm, the derived optimal probability measure is based on the criterion of minimizing the variance of the…

Computation · Statistics 2025-04-07 Siang Cheng , Cheng-Der Fuh , Tianxiao Pang

A novel algorithm is proposed for segmenting an image into multiple levels using its mean and variance. Starting from the extreme pixel values at both ends of the histogram plot, the algorithm is applied recursively on sub-ranges computed…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Siddharth Arora , Jayadev Acharya , Amit Verma , Prasanta K. Panigrahi

Algorithm selection is crucial in the field of optimization, as no single algorithm performs perfectly across all types of optimization problems. Finding the best algorithm among a given set of algorithms for a given problem requires a…

Neural and Evolutionary Computing · Computer Science 2025-01-27 Saba Sadeghi Ahouei , Denis Antipov , Aneta Neumann , Frank Neumann

We explore past and recent developments in rare-event probability estimation with a particular focus on a novel Monte Carlo technique Empirical Likelihood Maximization (ELM). This is a versatile method that involves sampling from a sequence…

Computation · Statistics 2013-12-12 A. Huang , Z. I. Botev