English
Related papers

Related papers: Rare-Event Simulation for Neural Network and Rando…

200 papers

Deep neural networks, when optimized with sufficient data, provide accurate representations of high-dimensional functions; in contrast, function approximation techniques that have predominated in scientific computing do not scale well with…

Data Analysis, Statistics and Probability · Physics 2021-03-15 Grant M. Rotskoff , Andrew R. Mitchell , Eric Vanden-Eijnden

Detecting rare events, those defined to give rise to high impact but have a low probability of occurring, is a challenge in a number of domains including meteorological, environmental, financial and economic. The use of machine learning to…

Applications · Statistics 2022-09-13 Santhosh Narayanan , Carsten Maple , Mark Hooper

We present Neural Random Forest Imitation - a novel approach for transforming random forests into neural networks. Existing methods propose a direct mapping and produce very inefficient architectures. In this work, we introduce an imitation…

Machine Learning · Computer Science 2024-04-05 Christoph Reinders , Bodo Rosenhahn

Rare events are events that are expected to occur infrequently, or more technically, those that have low probabilities (say, order of $10^{-3}$ or less) of occurring according to a probability model. In the context of uncertainty…

Computation · Statistics 2015-08-21 James L. Beck , Konstantin M. Zuev

Machine learning models play a vital role in the prediction task in several fields of study. In this work, we utilize the ability of machine learning algorithms to predict the occurrence of extreme events in a nonlinear mechanical system.…

Machine Learning · Computer Science 2021-12-03 J. Meiyazhagan , S. Sudharsan , A. Venkatasen , M. Senthilvelan

To predict rare extreme events using deep neural networks, one encounters the so-called small data problem because even long-term observations often contain few extreme events. Here, we investigate a model-assisted framework where the…

Machine Learning · Computer Science 2022-04-20 Anna Asch , Ethan Brady , Hugo Gallardo , John Hood , Bryan Chu , Mohammad Farazmand

Data analysis and machine learning have become an integrative part of the modern scientific methodology, offering automated procedures for the prediction of a phenomenon based on past observations, unraveling underlying patterns in data and…

Machine Learning · Statistics 2015-06-04 Gilles Louppe

Extreme weather events epitomize high cost: to society through their physical impacts, and to computer servers that simulate them to assess risk and advance physical understanding. It costs hundreds of simulation years to sample a few…

Atmospheric and Oceanic Physics · Physics 2026-04-14 Justin Finkel , Paul A. O'Gorman

Learning-based methodologies increasingly find applications in safety-critical domains like autonomous driving and medical robotics. Due to the rare nature of dangerous events, real-world testing is prohibitively expensive and unscalable.…

Machine Learning · Computer Science 2021-08-10 Aman Sinha , Matthew O'Kelly , Russ Tedrake , John Duchi

In this paper, we consider an importance sampling problem for a certain rare-event simulations involving the behavior of a diffusion process pertaining to a chain of distributed systems with random perturbations. We also assume that the…

Optimization and Control · Mathematics 2020-08-26 Getachew K. Befekadu

Extreme events are occurrences whose magnitude and potential cause extensive damage on people, infrastructure, and the environment. Motivated by the extreme nature of the current global health landscape, which is plagued by the coronavirus…

Machine Learning · Computer Science 2021-06-14 Nhuong V. Nguyen , Sybille Legitime

Random Forest is a machine learning method that offers many advantages, including the ability to easily measure variable importance. Class balancing technique is a well-known solution to deal with class imbalance problem. However, it has…

Machine Learning · Statistics 2023-12-19 Yunbi Nam , Sunwoo Han

Recent years have seen a substantial development of quantitative methods, mostly led by the computer science community with the goal of developing better machine learning applications, mainly focused on predictive modeling. However,…

Machine Learning · Computer Science 2021-03-02 Daniel Hain , Roman Jurowetzki

This paper provides a detailed introductory description of Subset Simulation, an advanced stochastic simulation method for estimation of small probabilities of rare failure events. A simple and intuitive derivation of the method is given…

Computation · Statistics 2015-05-14 Konstantin Zuev

We propose a class of strongly efficient rare event simulation estimators for random walks and compound Poisson processes with a regularly varying increment/jump-size distribution in a general large deviations regime. Our estimator is based…

Probability · Mathematics 2017-06-14 Bohan Chen , Jose Blanchet , Chang-Han Rhee , Bert Zwart

We study iterative methods for (two-stage) robust combinatorial optimization problems with discrete uncertainty. We propose a machine-learning-based heuristic to determine starting scenarios that provide strong lower bounds. To this end, we…

Optimization and Control · Mathematics 2022-12-26 Marc Goerigk , Jannis Kurtz

Rare event prediction involves identifying and forecasting events with a low probability using machine learning (ML) and data analysis. Due to the imbalanced data distributions, where the frequency of common events vastly outweighs that of…

Artificial Intelligence · Computer Science 2024-10-08 Chathurangi Shyalika , Ruwan Wickramarachchi , Amit Sheth

Rare event simulation and rare event probability estimation are important tasks within the analysis of systems subject to uncertainty and randomness. Simultaneously, accurately estimating rare event probabilities is an inherently difficult…

Methodology · Statistics 2024-07-18 Max Ehre , Iason Papaioannou , Daniel Straub

Article describes the results of the development and using of Rare-Event Monte-Carlo Simulation Algorithms for Dynamic Fault Trees Estimation. For Fault Trees estimation usually analytical methods are used (Minimal Cut sets, Markov Chains,…

Applications · Statistics 2016-01-28 Sergey Porotsky

In this work we propose an adaptive multilevel version of subset simulation to estimate the probability of rare events for complex physical systems. Given a sequence of nested failure domains of increasing size, the rare event probability…

Numerical Analysis · Mathematics 2023-12-13 Daniel Elfverson , Robert Scheichl , Simon Weissmann , F. Alejandro DiazDelaO
‹ Prev 1 2 3 10 Next ›