English
Related papers

Related papers: A Comprehensive Survey on Rare Event Prediction

200 papers

Extreme value statistics provides accurate estimates for the small occurrence probabilities of rare events. While theory and statistical tools for univariate extremes are well-developed, methods for high-dimensional and complex data sets…

Methodology · Statistics 2021-01-06 Sebastian Engelke , Jevgenijs Ivanovs

Event log analysis is an important task that security professionals undertake. Event logs record key information on activities that occur on computing devices, and due to the substantial number of events generated, they consume a large…

Artificial Intelligence · Computer Science 2025-02-04 Siraaj Akhtar , Saad Khan , Simon Parkinson

Network meta-analysis (NMA) of rare events has attracted little attention in the literature. Until recently, networks of interventions with rare events were analyzed using the inverse-variance NMA approach. However, when events are rare the…

Methodology · Statistics 2021-09-22 Theodoros Evrenoglou , Ian White , Sivem Afach , Dimitris Mavridis , Anna Chaimani

A leading goal for climate science and weather risk management is to accurately model both the physics and statistics of extreme events. These two goals are fundamentally at odds: the higher a computational model's resolution, the more…

Atmospheric and Oceanic Physics · Physics 2024-02-06 Justin Finkel , Paul A. O'Gorman

Emergency response management (ERM) is a challenge faced by communities across the globe. First responders must respond to various incidents, such as fires, traffic accidents, and medical emergencies. They must respond quickly to incidents…

Computers and Society · Computer Science 2023-06-21 Ayan Mukhopadhyay

An important step in the design of autonomous systems is to evaluate the probability that a failure will occur. In safety-critical domains, the failure probability is extremely small so that the evaluation of a policy through Monte Carlo…

Machine Learning · Computer Science 2022-11-23 Anthony Corso , Kyu-Young Kim , Shubh Gupta , Grace Gao , Mykel J. Kochenderfer

In the realm of contemporary data analysis, the use of massive datasets has taken on heightened significance, albeit often entailing considerable demands on computational time and memory. While a multitude of existing works offer optimal…

Methodology · Statistics 2024-06-21 Tal Agassi , Nir Keret , Malka Gorfine

In order to allow machine learning algorithms to extract knowledge from raw data, these data must first be cleaned, transformed, and put into machine-appropriate form. These often very time-consuming phase is referred to as preprocessing.…

Machine Learning · Computer Science 2021-11-19 David Cemernek

Event detection (ED), which means identifying event trigger words and classifying event types, is the first and most fundamental step for extracting event knowledge from plain text. Most existing datasets exhibit the following issues that…

Computation and Language · Computer Science 2020-10-09 Xiaozhi Wang , Ziqi Wang , Xu Han , Wangyi Jiang , Rong Han , Zhiyuan Liu , Juanzi Li , Peng Li , Yankai Lin , Jie Zhou

In this paper we develop a methodology that we call split sampling methods to estimate high dimensional expectations and rare event probabilities. Split sampling uses an auxiliary variable MCMC simulation and expresses the expectation of…

Computation · Statistics 2013-11-04 John R. Birge , Changgee Chang , Nicholas G. Polson

Predictions and forecasts of machine learning models should take the form of probability distributions, aiming to increase the quantity of information communicated to end users. Although applications of probabilistic prediction and…

Machine Learning · Statistics 2024-03-19 Hristos Tyralis , Georgia Papacharalampous

Many scientific and engineering problems require accurate models of dynamical systems with rare and extreme events. Such problems present a challenging task for data-driven modelling, with many naive machine learning methods failing to…

Machine Learning · Computer Science 2021-12-03 Samuel Rudy , Themistoklis Sapsis

The classification of seismic events has been crucial for monitoring underground nuclear explosions and unnatural seismic events as well as natural earthquakes. This research is an attempt to apply different machine learning (ML) algorithms…

Geophysics · Physics 2025-02-11 Alemayehu Belay Kassa , Mulugeta Tuji Dugda

Decision support systems are essential for maintaining grid stability in low-carbon power systems, such as wind power plants, by providing real-time alerts to control room operators regarding potential events, including Wind Power Ramp…

Extreme events gain the attention of researchers due to their utmost importance in various contexts ranging from finance to climatology. This brings such recurrent events to the limelight of attention in interdisciplinary research. A…

Data Analysis, Statistics and Probability · Physics 2022-05-18 Sayantan Nag Chowdhury , Arnob Ray , Syamal K. Dana , Dibakar Ghosh

Many recent papers have studied the development of superforecaster-level event forecasting LLMs. While methodological problems with early studies cast doubt on the use of LLMs for event forecasting, recent studies with improved evaluation…

Machine Learning · Computer Science 2025-07-28 Sang-Woo Lee , Sohee Yang , Donghyun Kwak , Noah Y. Siegel

We analyse the splitting algorithm performance in the estimation of rare event probabilities and this in a discrete multidimensional framework. For this we assume that each threshold is partitioned into disjoint subsets and the probability…

Probability · Mathematics 2016-10-10 Agnès Lagnoux , Pascal Lezaud

For rare events described in terms of Markov processes, truly unbiased estimation of the rare event probability generally requires the avoidance of numerical approximations of the Markov process. Recent work in the exact and…

Statistics Theory · Mathematics 2021-11-08 James Hodgson , Adam M. Johansen , Murray Pollock

In the domain of time series analysis, particularly in event detection tasks, current methodologies predominantly rely on segmentation-based approaches, which predict the class label for each individual timesteps and use the changepoints of…

Artificial Intelligence · Computer Science 2024-08-26 Clark Peng , Tolga Dinçer

Event management in sensor networks is a multidisciplinary field involving several steps across the processing chain. In this paper, we discuss the major steps that should be performed in real- or near real-time event handling including…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-16 Vassilis Papataxiarhis , Stathes Hadjiefthymiades