English
Related papers

Related papers: Do more observations bring more information in rar…

200 papers

Refining one's hypotheses in the light of data is a common scientific practice; however, the dependency on the data introduces selection bias and can lead to specious statistical analysis. An approach for addressing this is via conditioning…

Machine Learning · Computer Science 2020-03-03 Jen Ning Lim , Makoto Yamada , Wittawat Jitkrittum , Yoshikazu Terada , Shigeyuki Matsui , Hidetoshi Shimodaira

Causal phenomena associated with rare events occur across a wide range of engineering problems, such as risk-sensitive safety analysis, accident analysis and prevention, and extreme value theory. However, current methods for causal…

Machine Learning · Statistics 2023-07-19 Chih-Yuan Chiu , Kshitij Kulkarni , Shankar Sastry

Having reliable estimates of the occurrence rates of extreme events is highly important for insurance companies, government agencies and the general public. The rarity of an extreme event is typically expressed through its return period,…

Methodology · Statistics 2019-10-08 Ross Towe , Jonathan Tawn , Emma Eastoe , Rob Lamb

Statistical inference for extreme values of random events is difficult in practice due to low sample sizes and inaccurate models for the studied rare events. If prior knowledge for extreme values is available, Bayesian statistics can be…

Methodology · Statistics 2022-05-18 Tobias Kallehauge

Power analyses are an important aspect of experimental design, because they help determine how experiments are implemented in practice. It is common to specify a desired level of power and compute the sample size necessary to obtain that…

Methodology · Statistics 2022-12-09 Zach Branson , Xinran Li , Peng Ding

While running any experiment, we often have to consider the statistical power to ensure an effective study. Statistical power or power ensures that we can observe an effect with high probability if such a true effect exists. However,…

Methodology · Statistics 2023-06-21 Ajinkya K Mulay , Sean Lane , Erin Hennes

Rare events can potentially occur in many applications. When manifested as opportunities to be exploited, risks to be ameliorated, or certain features to be extracted, such events become of paramount significance. Due to their sporadic…

Information Theory · Computer Science 2012-10-10 Ali Tajer , H. Vincent Poor

The plausibility of uncommon events and miracles based on testimony of such an event has been much discussed. When analyzing the probabilities involved, it has mostly been assumed that the common events can be taken as data in the…

Applications · Statistics 2016-03-01 V. Palonen

This paper studies binary logistic regression for rare events data, or imbalanced data, where the number of events (observations in one class, often called cases) is significantly smaller than the number of nonevents (observations in the…

Machine Learning · Statistics 2020-06-02 HaiYing Wang

We consider the problem of evaluating designs for a two-arm randomized experiment with the criterion being the power of the randomization test for the one-sided null hypothesis. Our evaluation assumes a response that is linear in one…

Methodology · Statistics 2020-08-14 Abba M. Krieger , David Azriel , Michael Sklar , Adam Kapelner

Randomized search algorithms for hard combinatorial problems exhibit a large variability of performances. We study the different types of rare events which occur in such out-of-equilibrium stochastic processes and we show how they cooperate…

Statistical Mechanics · Physics 2009-11-07 Andrea Montanari , Riccardo Zecchina

We consider the problem of model building for rare events prediction in longitudinal follow-up studies. In this paper, we compare several resampling methods to improve standard regression models on a real life example. We evaluate the…

Methodology · Statistics 2023-06-21 Pierre Druilhet , Mathieu Berthe , Stéphanie Léger

This paper investigates the theoretical foundation and develops analytical formulas for sample size and power calculations for causal inference with observational data. By analyzing the variance of an inverse probability weighting estimator…

Methodology · Statistics 2026-05-19 Bo Liu , Chengxin Yang , Fan Li

In causal inference, we can consider a situation in which treatment on one unit affects others, i.e., interference exists. In the presence of interference, we cannot perform a classical randomization test directly because a null hypothesis…

Methodology · Statistics 2022-03-22 Mizuho Yanagi , Tomonari Sei

The theocratical properties of the power of the conventional testing hypotheses and the selection bias are usually unknown under covariate-adaptive randomized clinical trials. In the literature, most studies are based on simulations. In…

Statistics Theory · Mathematics 2021-05-04 Li-Xin Zhang

What proportion of treated units actually benefited from an experimental intervention? What is the median or the largest individual treatment effect? This paper develops methods for answering such questions about the distribution of…

Methodology · Statistics 2026-05-11 David Kim , Yongchang Su , Jake Bowers , Xinran Li

We consider a hypothesis testing problem where a part of data cannot be observed. Our helper observes the missed data and can send us a limited amount of information about them. What kind of this limited information will allow us to make…

Information Theory · Computer Science 2020-09-08 Marat V. Burnashev

Rare events are occurrences that take place with a significantly lower frequency than more common regular events. In manufacturing, predicting such events is particularly important, as they lead to unplanned downtime, shortening equipment…

Machine Learning · Statistics 2024-07-03 Chathurangi Shyalika , Ruwan Wickramarachchi , Fadi El Kalach , Ramy Harik , Amit Sheth

External controls from historical trials or observational data can augment randomized controlled trials when large-scale randomization is impractical or unethical, such as in drug evaluation for rare diseases. However, non-randomized…

Methodology · Statistics 2025-05-08 Ke Zhu , Shu Yang , Xiaofei Wang

We develop inference procedures robust to general forms of weak dependence. The procedures utilize test statistics constructed by resampling in a manner that does not depend on the unknown correlation structure of the data. We prove that…

Econometrics · Economics 2021-08-26 Michael P. Leung
‹ Prev 1 2 3 10 Next ›