English
Related papers

Related papers: Minor probability events detection in big data: An…

200 papers

We consider a collection of independent random variables that are identically distributed, except for a small subset which follows a different, anomalous distribution. We study the problem of detecting which random variables in the…

Information Theory · Computer Science 2018-06-21 Natalie Durgin , Rachel Grotheer , Chenxi Huang , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

When a predictive model is in production, it must be monitored in real-time to ensure that its performance does not suffer due to drift or abrupt changes to data. Ideally, this is done long before learning that the performance of the model…

Anomaly detection is a field of intense research. Identifying low probability events in data/images is a challenging problem given the high-dimensionality of the data, especially when no (or little) information about the anomaly is…

Machine Learning · Computer Science 2022-04-13 José A. Padrón-Hidalgo , Valero Laparra , Gustau Camps-Valls

Sequential change diagnosis is the joint problem of detection and identification of a sudden and unobservable change in the distribution of a random sequence. In this problem, the common probability law of a sequence of i.i.d. random…

Probability · Mathematics 2007-10-29 Savas Dayanik , Christian Goulding , H. Vincent Poor

Radial velocity (RV) planet searches are increasingly finding planets with small velocity amplitudes, with long orbital periods, or in multiple planet systems. Bayesian inference has the potential to improve the interpretation of existing…

Astrophysics · Physics 2007-05-23 Eric B. Ford , Philip C. Gregory

Pimentel et al. (2020) recently analysed probing from an information-theoretic perspective. They argue that probing should be seen as approximating a mutual information. This led to the rather unintuitive conclusion that representations…

Computation and Language · Computer Science 2021-09-10 Tiago Pimentel , Ryan Cotterell

This paper devises a fully Bayesian sample size determination method for hierarchical model-based small area estimation with a decision risk approach. A new loss function specified around a desired maximum posterior variance target…

Methodology · Statistics 2018-02-27 Peter Dutey-Magni

Ultrafast dynamical processes in photoexcited molecules can be observed with pump-probe measurements, in which information about the dynamics is obtained from the transient signal associated with the excited state. Background signals…

Atomic Physics · Physics 2018-06-11 M. Rumetshofer , P. Heim , B. Thaler , W. E. Ernst , M. Koch , W. von der Linden

While the Bayesian decision-theoretic framework offers an elegant solution to the problem of decision making under uncertainty, one question is how to appropriately select the prior distribution. One idea is to employ a worst-case prior.…

Machine Learning · Computer Science 2023-02-22 Thomas Kleine Buening , Christos Dimitrakakis , Hannes Eriksson , Divya Grover , Emilio Jorge

Bayesian predictive probabilities are commonly used for interim monitoring of clinical trials through efficacy and futility stopping rules. Despite their usefulness, calculation of predictive probabilities, particularly in pre-experiment…

Applications · Statistics 2024-06-18 Joe Marion , Liz Lorenzi , Cora Allen-Savietta , Scott Berry , Kert Viele

In recent years, Bayesian inference in large-scale inverse problems found in science, engineering and machine learning has gained significant attention. This paper examines the robustness of the Bayesian approach by analyzing the stability…

Machine Learning · Statistics 2023-03-06 Alfredo Garbuno-Inigo , Tapio Helin , Franca Hoffmann , Bamdad Hosseini

We study a variation of Bayesian M-ary hypothesis testing in which the test outputs a list of L candidates out of the M possible upon processing the observation. We study the minimum error probability of list hypothesis testing, where an…

Information Theory · Computer Science 2021-10-28 Ehsan Asadi Kangarshahi , Albert Guillen i Fabregas

Signal estimation in the presence of background noise is a common problem in several scientific disciplines. An 'On/Off' measurement is performed when the background itself is not known, being estimated from a background control sample. The…

Data Analysis, Statistics and Probability · Physics 2021-06-16 Giacomo D'Amico , Tomislav Terzić , Jelena Strišković , Michele Doro , Marcel Strzys , Juliane van Scherpenberg

In reliability engineering, data about failure events is often scarce. To arrive at meaningful estimates for the reliability of a system, it is therefore often necessary to also include expert information in the analysis, which is…

Methodology · Statistics 2016-10-25 Gero Walter , Frank P. A. Coolen

We generalize the approach of Liu and Lawrence (1999) for multiple changepoint problems where the number of changepoints is unknown. The approach is based on dynamic programming recursion for efficient calculation of the marginal…

Computation · Statistics 2009-09-29 Heng Lian

We propose a method for the accurate estimation of rare event or failure probabilities for expensive-to-evaluate numerical models in high dimensions. The proposed approach combines ideas from large deviation theory and adaptive importance…

Computation · Statistics 2023-03-28 Shanyin Tong , Georg Stadler

When performing Bayesian inference, we frequently need to work with conditional probability densities. For example, the posterior function is the conditional density of the parameters given the data. Some might worry that conditional…

Methodology · Statistics 2026-03-31 Alex Yan , Cathal Mills , Augustin Marignier , Younjung Kim , Ben Lambert

We study Bayesian inference methods for solving linear inverse problems, focusing on hierarchical formulations where the prior or the likelihood function depend on unspecified hyperparameters. In practice, these hyperparameters are often…

Numerical Analysis · Mathematics 2018-08-01 Qingping Zhou , Wenqing Liu , Jinglai Li , Youssef M. Marzouk

Bayesian change-point detection, together with latent variable models, allows to perform segmentation over high-dimensional time-series. We assume that change-points lie on a lower-dimensional manifold where we aim to infer subsets of…

Machine Learning · Statistics 2020-11-04 Lorena Romero-Medrano , Pablo Moreno-Muñoz , Antonio Artés-Rodríguez

We consider the problem of choosing design parameters to minimize the probability of an undesired rare event that is described through the average of $n$ iid random variables. Since the probability of interest for near optimal design…

Optimization and Control · Mathematics 2019-02-22 Amarjit Budhiraja , Shu Lu , Yang Yu , Quoc Tran-Dinh