English
Related papers

Related papers: On discrimination between classes of distribution …

200 papers

The aim of the paper is to show that the presence of one possible type of outliers is not connected to that of heavy tails of the distribution. In contrary, typical situation for outliers appearance is the case of compact supported…

Statistics Theory · Mathematics 2018-07-25 Lev B. Klebanov , Irina Volchenkova

Hypothesis testing in high dimensional data is a notoriously difficult problem without direct access to competing models' likelihood functions. This paper argues that statistical divergences can be used to quantify the difference between…

Data Analysis, Statistics and Probability · Physics 2024-08-02 Jeremy J. H. Wilkinson , Christopher G. Lester

The imbalance (or long-tail) is the nature of many real-world data distributions, which often induces the undesirable bias of deep classification models toward frequent classes, resulting in poor performance for tail classes. In this paper,…

Machine Learning · Computer Science 2025-10-13 Fudong Lin , Xu Yuan

In this paper we develop a very general class of bivariate discrete distributions. The basic idea is very simple. The marginals are obtained by taking the random geometric sum of a baseline distribution function. The proposed class of…

Methodology · Statistics 2018-05-22 Debasis Kundu

Motivated by the growing interest in sound forecast evaluation techniques with an emphasis on distribution tails rather than average behaviour, we investigate a fundamental question arising in this context: Can statistical features of…

Statistics Theory · Mathematics 2019-10-08 Jonas Brehmer , Kirstin Strokorb

For each probability distribution on a countable alphabet, a sequence of positive functionals are developed as tail indices based on Turing's perspective. By and only by the asymptotic behavior of these indices, domains of attraction for…

Probability · Mathematics 2015-04-27 Zhiyi Zhang

Given a set of attributed subgraphs known to be from different classes, how can we discover their differences? There are many cases where collections of subgraphs may be contrasted against each other. For example, they may be assigned…

Social and Information Networks · Computer Science 2017-02-01 Aria Rezaei , Bryan Perozzi , Leman Akoglu

The purpose of this paper is to show that the use of heavy-tailed distributions in Financial problems is theoretically baseless and can lead to significant misunderstandings. The reason for this the authors see in an incorrect…

Probability · Mathematics 2015-07-29 Lev B Klebanov , Irina V Volchenkova

Object frequency in the real world often follows a power law, leading to a mismatch between datasets with long-tailed class distributions seen by a machine learning model and our expectation of the model to perform well on all classes. We…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Muhammad Abdullah Jamal , Matthew Brown , Ming-Hsuan Yang , Liqiang Wang , Boqing Gong

The tail of the distribution of a sum of a random number of independent and identically distributed nonnegative random variables depends on the tails of the number of terms and of the terms themselves. This situation is of interest in the…

Probability · Mathematics 2008-12-10 Christian Y. Robert , Johan Segers

Real-world data is often unbalanced and long-tailed, but deep models struggle to recognize rare classes in the presence of frequent classes. To address unbalanced data, most studies try balancing the data, the loss, or the classifier to…

Machine Learning · Computer Science 2021-11-02 Dvir Samuel , Gal Chechik

Let F be a distribution function with negative mean and regularly varying right tail. Under a mild smoothness condition we derive higher order asymptotic expansions for the tail distribution of the maxima of the random walk generated by F.…

Probability · Mathematics 2007-05-23 Ph . Barbe , W. P. McCormick , C. Zhang

There are two kinds of Tsallis-probability distributions: heavy tail ones and compact support distributions. We show here, appealing to functional analysis' tools, that for lower bound Hamiltonians only the first type guarantees a maximum…

Statistical Mechanics · Physics 2015-11-16 A. Plastino , M. C. Rocca

For distributions $\mathbb{P}$ and $\mathbb{Q}$ with different supports or undefined densities, the divergence $\textrm{D}(\mathbb{P}||\mathbb{Q})$ may not exist. We define a Spread Divergence $\tilde{\textrm{D}}(\mathbb{P}||\mathbb{Q})$ on…

Machine Learning · Statistics 2022-12-06 Mingtian Zhang , Peter Hayes , Tom Bird , Raza Habib , David Barber

By introducing a weight function into the density power divergence, we develop a new class of robust and smooth estimators for the tail index of Pareto-type distributions, offering improved efficiency in the presence of outliers. These…

Statistics Theory · Mathematics 2025-07-25 Saida Mancer , Abdelhakim Necir , Djamel Meraghni

We consider training probabilistic classifiers in the case of a large number of classes. The number of classes is assumed too large to perform exact normalisation over all classes. To account for this we consider a simple approach that…

Machine Learning · Statistics 2016-07-08 David Barber , Aleksandar Botev

Beck et al. (2013) introduced a new distribution class J which contains many heavy-tailed and light-tailed distributions obeying the principle of a single big jump. Using a simple transformation which maps heavy-tailed distributions to…

Probability · Mathematics 2014-11-07 Hui Xu , Michael Scheutzow , Yuebao Wang

The task for a general and useful classification of the tail behaviors of probability distributions still has no satisfactory solution. Due to lack of information outside the range of the data the tails of the distribution should be…

Probability · Mathematics 2019-07-23 Pavlina Jordanova

Many complex networks in natural and social phenomena have often been characterized by heavy-tailed degree distributions. However, due to rapidly growing size of network data and concerns on privacy issues about using these data, it becomes…

Physics and Society · Physics 2015-05-19 Young-Ho Eom , Hang-Hyun Jo

The upper tail of a claim size distribution of a property line of business is frequently modelled by Pareto distribution. However, the upper tail does not need to be Pareto distributed, extraordinary shapes are possible. Here, the…

Methodology · Statistics 2020-02-19 Mathias Raschke