English
Related papers

Related papers: A Comprehensive Survey on Rare Event Prediction

200 papers

Multi-modal Event Reasoning (MMER) endeavors to endow machines with the ability to comprehend intricate event relations across diverse data modalities. MMER is fundamental and underlies a wide broad of applications. Despite extensive…

Artificial Intelligence · Computer Science 2024-04-17 Zhengwei Tao , Zhi Jin , Junqiang Huang , Xiancai Chen , Xiaoying Bai , Haiyan Zhao , Yifan Zhang , Chongyang Tao

The increasing data rates in modern high-energy physics experiments such as ALICE at the LHC and the upcoming ePIC experiment at the Electron-Ion Collider (EIC) present significant challenges in real-time event selection and data storage.…

High Energy Physics - Experiment · Physics 2025-06-24 Simone Ragoni , Janet Seger , Christopher Anson , David Tlusty

Estimating the likelihood, timing, and nature of events is a major goal of modeling stochastic dynamical systems. When the event is rare in comparison with the timescales of simulation and/or measurement needed to resolve the elemental…

Computational Physics · Physics 2023-06-14 John Strahan , Justin Finkel , Aaron R. Dinner , Jonathan Weare

It is common in modern prediction problems for many predictor variables to be counts of rarely occurring events. This leads to design matrices in which many columns are highly sparse. The challenge posed by such "rare features" has received…

Methodology · Statistics 2023-02-03 Xiaohan Yan , Jacob Bien

This work introduces and compares approaches for estimating rare-event probabilities related to the number of edges in the random geometric graph on a Poisson point process. In the one-dimensional setting, we derive closed-form expressions…

Probability · Mathematics 2020-07-14 Christian Hirsch , Sarat B. Moka , Thomas Taimre , Dirk P. Kroese

Weather extremes pose major societal risks, especially in a changing climate, but due to their rarity, they are difficult to study using limited observations or complex climate models. We introduce AI+RES, a framework coupling fast AI…

Restricted maximum likelihood (REML) estimation is a widely accepted and frequently used method for fitting linear mixed models, with its principal advantage being that it produces less biased estimates of the variance components. However,…

Methodology · Statistics 2025-05-15 Luca Maestrini , Francis K. C. Hui , Alan H. Welsh

The collaborative efforts of large communities in science experiments, often comprising thousands of global members, reflect a monumental commitment to exploration and discovery. Recently, advanced and complex data processing has gained…

Floods are among the most destructive natural disasters, which are highly complex to model. The research on the advancement of flood prediction models contributed to risk reduction, policy suggestion, minimization of the loss of human life,…

Machine Learning · Computer Science 2020-08-10 Amir Mosavi , Pinar Ozturk , Kwok-wing Chau

This paper introduces a general approach to design a tailored solution to detect rare events in different industrial applications based on Internet of Things (IoT) networks and machine learning algorithms. We propose a general framework…

Timely and accurate forecasts of severe weather events are essential for early warning and for constraining downstream analysis and decision-making. Since severe weather events prediction still depends on subjective, time-consuming expert…

Artificial Intelligence · Computer Science 2025-11-25 Shuo Tang , Jian Xu , Jiadong Zhang , Yi Chen , Qizhao Jin , Lingdong Shen , Chenglin Liu , Shiming Xiang

With the expansion of data availability, machine learning (ML) has achieved remarkable breakthroughs in both academia and industry. However, imbalanced data distributions are prevalent in various types of raw data and severely hinder the…

Machine Learning · Computer Science 2025-09-15 Xinyi Gao , Dongting Xie , Yihang Zhang , Zhengren Wang , Chong Chen , Conghui He , Hongzhi Yin , Wentao Zhang

Modern applications of machine learning (ML) deal with increasingly heterogeneous datasets comprised of data collected from overlapping latent subpopulations. As a result, traditional models trained over large datasets may fail to recognize…

Machine Learning · Statistics 2019-10-16 Benjamin Lengerich , Bryon Aragam , Eric P. Xing

Large network logs, recording multivariate time series generated from heterogeneous devices and sensors in a network, can often reveal important information about abnormal activities, such as network intrusions and device malfunctions.…

Machine Learning · Computer Science 2025-06-19 Yijun Lin , Yao-Yi Chiang

The precise estimation of resource usage is a complex and challenging issue due to the high variability and dimensionality of heterogeneous service types and dynamic workloads. Over the last few years, the prediction of resource usage and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-07 Deepika Saxena , Jitendra Kumar , Ashutosh Kumar Singh , Stefan Schmid

In modern business processes, the amount of data collected has increased substantially in recent years. Because this data can potentially yield valuable insights, automated knowledge extraction based on process mining has been proposed,…

Machine Learning · Computer Science 2022-12-02 Riza Velioglu , Jan Philip Göpfert , André Artelt , Barbara Hammer

The detection and analysis of events within massive collections of time-series has become an extremely important task for time-domain astronomy. In particular, many scientific investigations (e.g. the analysis of microlensing and other…

Applications · Statistics 2013-01-22 Alexander W Blocker , Pavlos Protopapas

We consider systems of stochastic differential equations with multiple scales and small noise and assume that the coefficients of the equations are ergodic and stationary random fields. Our goal is to construct provably-efficient importance…

Probability · Mathematics 2015-09-29 Konstantinos Spiliopoulos

Background: Mental stress and its consequent mental disorders (MDs) are significant public health issues. With the advent of machine learning (ML), there's potential to harness computational techniques for better understanding and…

Predictive process monitoring is a subfield of process mining that aims to estimate case or event features for running process instances. Such predictions are of significant interest to the process stakeholders. However, most of the…