English
Related papers

Related papers: Minor probability events detection in big data: An…

200 papers

Message importance measure (MIM) is applicable to characterize the importance of information in the scenario of big data, similar to entropy in information theory. In fact, MIM with a variable parameter can make an effect on the…

Information Theory · Computer Science 2024-04-08 Rui She , Shanyun Liu , Yunquan Dong , Pingyi Fan

Widely used methods for analyzing missing data can be biased in small samples. To understand these biases, we evaluate in detail the situation where a small univariate normal sample, with values missing at random, is analyzed using either…

Statistics Theory · Mathematics 2017-03-27 Paul T. von Hippel

Current efforts to correctly categorize natural events from suspected explosion sources with data that is collected by ground- or space-based sensors presents historical challenges that remain unaddressed by the Event Categorization Matrix…

Geophysics · Physics 2025-01-20 Scott Koermer , Joshua D. Carmichael , Brian J. Williams

Rare events can potentially occur in many applications. When manifested as opportunities to be exploited, risks to be ameliorated, or certain features to be extracted, such events become of paramount significance. Due to their sporadic…

Information Theory · Computer Science 2012-10-10 Ali Tajer , H. Vincent Poor

Data-driven risk analysis involves the inference of probability distributions from measured or simulated data. In the case of a highly reliable system, such as the electricity grid, the amount of relevant data is often exceedingly limited,…

Methodology · Statistics 2017-07-11 Simon H. Tindemans , Goran Strbac

Statistical inference for extreme values of random events is difficult in practice due to low sample sizes and inaccurate models for the studied rare events. If prior knowledge for extreme values is available, Bayesian statistics can be…

Methodology · Statistics 2022-05-18 Tobias Kallehauge

Data driven modelling is vital to many analyses at collider experiments, however the derived inference of physical properties becomes subject to details of the model fitting procedure. This work brings a principled Bayesian picture, based…

Data Analysis, Statistics and Probability · Physics 2023-05-23 David Yallup , Will Handley

Message importance measure (MIM) is an important index to describe the message importance in the scenario of big data. Similar to the Shannon Entropy and Renyi Entropy, MIM is required to characterize the uncertainty of a random process and…

Information Theory · Computer Science 2016-07-07 Pingyi Fan , Yunquan Dong , Jiaxun Lu , Shanyun Liu

Event detection (ED) aims at detecting event trigger words in sentences and classifying them into specific event types. In real-world applications, ED typically does not have sufficient labelled data, thus can be formulated as a few-shot…

Computation and Language · Computer Science 2021-06-01 Shirong Shen , Tongtong Wu , Guilin Qi , Yuan-Fang Li , Gholamreza Haffari , Sheng Bi

The problem of sequentially detecting an abrupt change in a sequence of independent and identically distributed (IID) random variables is addressed. Whereas previous approaches assume a known probability density function (PDF) at the start…

Statistics Theory · Mathematics 2017-12-11 James Falt , Steven D. Blostein

The experimental problem of converting a measured binomial quantity, the fraction of events in a sample that pass a cut, into a physical binomial quantity, the fraction of events originating from a signal source, is described as a system of…

High Energy Physics - Experiment · Physics 2007-05-23 Michael L. Kelly

We consider the problem of event detection based upon a (typically multivariate) data stream characterizing some system. Most of the time the system is quiescent - nothing of interest is happening - but occasionally events of interest…

Methodology · Statistics 2010-03-16 Werner Stuetzle , Donald B. Percival , Caren Marzban

We deal with the analysis of on-off measurements designed for the confirmation of a weak source of events whose presence is hypothesized, based on former observations. The problem of a small number of source events that are masked by an…

Instrumentation and Methods for Astrophysics · Physics 2017-08-23 Dalibor Nosek , Jana Nosková

The measurement of the efficiency of an event selection is always an important part of the analysis of experimental data. The statistical techniques which are needed to determine the efficiency and its uncertainty are reviewed. Frequentist…

Data Analysis, Statistics and Probability · Physics 2012-08-28 Diego Casadei

This paper proposes a new minimum description length procedure to detect multiple changepoints in time series data when some times are a priori thought more likely to be changepoints. This scenario arises with temperature time series…

Methodology · Statistics 2019-05-14 Yingbo Li , Robert Lund , Anuradha Hewaarachchi

Wireless Sensor Networks (WSNs) consist of many low cost and light sensors dispersed in an area to monitor the physical environment. Event detection in WSN area, especially detection of multi-events at the same time, is an important…

Systems and Control · Computer Science 2016-10-14 Mina Moradi Kordmahalleh , Mohammad Gorji Sefidmazgi , Jafar Ghaisari , Javad Askari

Rapid detection of spatial events that propagate across a sensor network is of wide interest in many modern applications. In particular, in communications, radar, IoT, environmental monitoring, and biosurveillance, we may observe…

Statistics Theory · Mathematics 2023-01-18 Topi Halme , Eyal Nitzan , Visa Koivunen

The detection and analysis of events within massive collections of time-series has become an extremely important task for time-domain astronomy. In particular, many scientific investigations (e.g. the analysis of microlensing and other…

Applications · Statistics 2013-01-22 Alexander W Blocker , Pavlos Protopapas

We propose and analyze a generalized splitting method to sample approximately from a distribution conditional on the occurrence of a rare event. This has important applications in a variety of contexts in operations research, engineering,…

Methodology · Statistics 2019-09-10 Zdravko I. Botev , Pierre L'Ecuyer

Given the joint chances of a pair of random variables one can compute quantities of interest, like the mutual information. The Bayesian treatment of unknown chances involves computing, from a second order prior distribution and the data…

Machine Learning · Computer Science 2007-05-23 Marcus Hutter , Marco Zaffalon
‹ Prev 1 2 3 10 Next ›