English
Related papers

Related papers: Rare-Event Simulation for Neural Network and Rando…

200 papers

Driven by applications in telecommunication networks, we explore the simulation task of estimating rare event probabilities for tandem queues in their steady state. Existing literature has recognized that importance sampling methods can be…

Machine Learning · Computer Science 2025-04-22 Ruoning Zhao , Xinyun Chen

Machine learning algorithms are effective in several applications, but they are not as much successful when applied to intrusion detection in cyber security. Due to the high sensitivity to their training data, cyber detectors based on…

Cryptography and Security · Computer Science 2021-06-15 Giovanni Apruzzese , Mauro Andreolini , Michele Colajanni , Mirco Marchetti

Evaluating the reliability of intelligent physical systems against rare safety-critical events poses a huge testing burden for real-world applications. Simulation provides a useful platform to evaluate the extremal risks of these systems…

Machine Learning · Computer Science 2021-03-09 Mansur Arief , Zhiyuan Huang , Guru Koushik Senthil Kumar , Yuanlu Bai , Shengyi He , Wenhao Ding , Henry Lam , Ding Zhao

The abundance of data affords researchers to pursue more powerful computational tools to learn the dynamics of complex system, such as neural networks, engineered systems and social networks. Traditional machine learning approaches capture…

Machine Learning · Computer Science 2024-05-16 Yan Shen , Fan Yang , Mingchen Gao , Wen Dong

We consider chance-constrained problems with discrete random distribution. We aim for problems with a large number of scenarios. We propose a novel method based on the stochastic gradient descent method which performs updates of the…

Optimization and Control · Mathematics 2019-05-28 Lukáš Adam , Martin Branda

Regression models for supervised learning problems with a continuous target are commonly understood as models for the conditional mean of the target given predictors. This notion is simple and therefore appealing for interpretation and…

Methodology · Statistics 2018-01-09 Torsten Hothorn , Achim Zeileis

As these attacks become more and more difficult to see, the need for the great hi-tech models that detect them is undeniable. This paper examines and compares various machine learning as well as deep learning models to choose the most…

Cryptography and Security · Computer Science 2024-07-09 Momen Hesham , Mohamed Essam , Mohamed Bahaa , Ahmed Mohamed , Mohamed Gomaa , Mena Hany , Wael Elsersy

A leading goal for climate science and weather risk management is to accurately model both the physics and statistics of extreme events. These two goals are fundamentally at odds: the higher a computational model's resolution, the more…

Atmospheric and Oceanic Physics · Physics 2024-02-06 Justin Finkel , Paul A. O'Gorman

This research proposes a machine learning-based attack detection model for power systems, specifically targeting smart grids. By utilizing data and logs collected from Phasor Measuring Devices (PMUs), the model aims to learn system…

Machine Learning · Computer Science 2023-07-10 Diane Tuyizere , Remy Ihabwikuzo

In rare-event simulation, an importance sampling (IS) estimator is regarded as efficient if its relative error, namely the ratio between its standard deviation and mean, is sufficiently controlled. It is widely known that when a rare-event…

Statistics Theory · Mathematics 2022-10-31 Yuanlu Bai , Zhiyuan Huang , Henry Lam , Ding Zhao

In this paper, we propose a novel robust stochastic optimization approach with a distinctive consideration for rare events, in which divergence measures are used to bound the event-wise ambiguity sets. This is done by using the Poisson…

Optimization and Control · Mathematics 2021-09-14 Aakil M. Caunhye , Douglas Alem

We introduce random survival forests, a random forests method for the analysis of right-censored survival data. New survival splitting rules for growing survival trees are introduced, as is a new missing data algorithm for imputing missing…

Applications · Statistics 2008-11-12 Hemant Ishwaran , Udaya B. Kogalur , Eugene H. Blackstone , Michael S. Lauer

To advance automated detection of extreme weather events, which are increasing in frequency and intensity with climate change, we explore modifications to a novel light-weight Context Guided convolutional neural network architecture trained…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Romain Lacombe , Hannah Grossman , Lucas Hendren , David Lüdeke

We develop rare-event simulation methodology for the analysis of loss events in a many-server loss system under quality-driven regime, focusing on the steady-state loss probability (i.e. fraction of lost customers over arrivals) and the…

Probability · Mathematics 2012-01-18 Jose Blanchet , Henry Lam

The probability of rare and extreme events is an important quantity for design purposes. However, computing the probability of rare events can be expensive because only a few events, if any, can be observed. To this end, it is necessary to…

Computational Physics · Physics 2020-01-08 Malik Hassanaly , Venkat Raman

The segmentation of individual trees from forest point clouds is a crucial task for downstream analyses such as carbon sequestration estimation. Recently, deep-learning-based methods have been proposed which show the potential of learning…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Jonathan Henrich , Jan van Delden

Selective attention is an essential mechanism to filter sensory input and to select only its most important components, allowing the capacity-limited cognitive structures of the brain to process them in detail. The saliency map model,…

Image and Video Processing · Electrical Eng. & Systems 2024-01-11 Camille Simon Chane , Ernst Niebur , Ryad Benosman , Sio-Hoi Ieng

The topic of deep learning has seen a surge of interest in recent years both within and outside of the field of Statistics. Deep models leverage both nonlinearity and interaction effects to provide superior predictions in many cases when…

Methodology · Statistics 2020-09-18 Paul A. Parker , Scott H. Holan

Very often when studying non-equilibrium systems one is interested in analysing dynamical behaviour that occurs with very low probability, so called rare events. In practice, since rare events are by definition atypical, they are often…

Statistical Mechanics · Physics 2021-01-06 Dominic C. Rose , Jamie F. Mair , Juan P. Garrahan

Many scientific and engineering problems require accurate models of dynamical systems with rare and extreme events. Such problems present a challenging task for data-driven modelling, with many naive machine learning methods failing to…

Machine Learning · Computer Science 2021-12-03 Samuel Rudy , Themistoklis Sapsis