English
Related papers

Related papers: Exactly computing the tail of the Poisson-Binomial…

200 papers

An important question in health services research is the estimation of the proportion of medical expenditures that exceed a given threshold. Typically, medical expenditures present highly skewed, heavy tailed distributions, for which (a)…

Applications · Statistics 2008-07-30 Sergio Venturini , Francesca Dominici , Giovanni Parmigiani

In the analysis of binary disease classification, single biomarkers might not have significant discriminating power and multiple biomarkers from a large set of biomarkers should be selected. Numerous approaches exist, but they merely work…

Methodology · Statistics 2021-03-24 Michiel H. J. Paus , Edwin R. van den Heuvel , Marc J. M. Meddens

We propose a variational Bayesian (VB) procedure for high-dimensional linear model inferences with heavy tail shrinkage priors, such as student-t prior. Theoretically, we establish the consistency of the proposed VB method and prove that…

Machine Learning · Statistics 2020-10-27 Jincheng Bai , Qifan Song , Guang Cheng

Heavy-tailed distributions, prevalent in a lot of real-world applications such as finance, telecommunications, queuing theory, and natural language processing, are challenging to model accurately owing to their slow tail decay. Bernstein…

Performance · Computer Science 2025-10-31 Abdelhakim Ziani , András Horváth , Paolo Ballarini

In Bayesian probabilistic programming, a central problem is to estimate the normalised posterior distribution (NPD) of a probabilistic program with conditioning via score (a.k.a. observe) statements. Most previous approaches address this…

Programming Languages · Computer Science 2024-08-02 Peixin Wang , Tengshun Yang , Hongfei Fu , Guanyan Li , C. -H. Luke Ong

We demonstrate an approach for exact sampling of certain discrete combinatorial distributions, which is a hybrid of exact Boltzmann sampling and the recursive method, using probabilistic divide-and-conquer (PDC). The approach specializes to…

Combinatorics · Mathematics 2016-08-30 Stephen DeSalvo

We study density estimation for classes of shift-invariant distributions over $\mathbb{R}^d$. A multidimensional distribution is "shift-invariant" if, roughly speaking, it is close in total variation distance to a small shift of it in any…

Machine Learning · Computer Science 2018-11-12 Anindya De , Philip M. Long , Rocco A. Servedio

We give a algorithm for exact sampling from the Bingham distribution $p(x)\propto \exp(x^\top A x)$ on the sphere $\mathcal S^{d-1}$ with expected runtime of $\operatorname{poly}(d, \lambda_{\max}(A)-\lambda_{\min}(A))$. The algorithm is…

Machine Learning · Computer Science 2023-12-12 Rong Ge , Holden Lee , Jianfeng Lu , Andrej Risteski

This paper investigates the asymptotics of the number of prime values taken by a polynomial in several variables with integer coefficients. Based on probabilistic heuristics and the multidimensional Bateman Horn conjecture, the expected…

Number Theory · Mathematics 2026-04-30 Victor Volfson

Posterior predictive p-values are a common approach to Bayesian model-checking. This article analyses their frequency behaviour, that is, their distribution when the parameters and the data are drawn from the prior and the model…

Statistics Theory · Mathematics 2015-03-31 Patrick Rubin-Delanchy , Daniel John Lawson

In recent works on the theory of machine learning, it has been observed that heavy tail properties of Stochastic Gradient Descent (SGD) can be studied in the probabilistic framework of stochastic recursions. In particular,…

Machine Learning · Statistics 2024-03-22 Ewa Damek , Sebastian Mentemeier

High-dimensional covariance estimation is notoriously sensitive to outliers. While statistically optimal estimators exist for general heavy-tailed distributions, they often rely on computationally expensive techniques like semidefinite…

Machine Learning · Statistics 2026-01-06 Even He

We present a novel procedure for scaling relatively high frequency tail probability and quantile estimates for the conditional distribution of returns.

Risk Management · Quantitative Finance 2011-03-31 John Cotter

Probabilistic forecasts comprehensively describe the uncertainty in the unknown future outcome, making them essential for decision making and risk management. While several methods have been introduced to evaluate probabilistic forecasts,…

Methodology · Statistics 2025-05-23 Sam Allen , Jonathan Koh , Johan Segers , Johanna Ziegel

In this paper, we extend the functional approach for calculating the EFT likelihood by applying the saddle-point expansion. We demonstrate that, after suitable reformulation, the likelihood expression is consistent with the path integral…

High Energy Physics - Phenomenology · Physics 2025-04-24 Ji-Yuan Ke , Yun Wang , Ping He

The exact expression for the probability density $p_{_N}(x)$ for sums of a finite number $N$ of random independent terms is obtained. It is shown that the very tail of $p_{_N}(x)$ has a Gaussian form if and only if all the random terms are…

Probability · Mathematics 2013-05-29 Michael I. Tribelsky

A scan statistic is examined for the purpose of testing the existence of a global peak in a random process with dependent variables of any distribution. The scan statistic tail probability is obtained based on the covariance of the moving…

Computation · Statistics 2013-09-24 Anat Reiner-Benaim

Despite the successes of probabilistic models based on passing noise through neural networks, recent work has identified that such methods often fail to capture tail behavior accurately, unless the tails of the base distribution are…

Machine Learning · Statistics 2023-06-16 Feynman Liang , Liam Hodgkinson , Michael W. Mahoney

For a variant of the algorithm in [Pit19] (arXiv:1903.10816) to compute the approximate density or distribution function of a linear mixture of independent random variables known by a finite sample, it is presented a proof of the functional…

Statistics Theory · Mathematics 2019-06-19 Thomas Pitschel

The direct Gaussian copula model with discrete marginal distributions is an appealing data-analytic tool but poses difficult computational challenges due to its intractable likelihood. A number of approximations/surrogates for the…

Methodology · Statistics 2021-03-08 John Hughes