English
Related papers

Related papers: On discrimination between classes of distribution …

200 papers

Consider a probability distribution subordinate to a subexponential distribution with finite mean. In this paper, we discuss the second order tail behavior of the subordinated distribution within a rather general framework in which we do…

Probability · Mathematics 2010-11-17 Jianxi Lin

This paper considers learning deep features from long-tailed data. We observe that in the deep feature space, the head classes and the tail classes present different distribution patterns. The head classes have a relatively large spatial…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Jialun Liu , Yifan Sun , Chuchu Han , Zhaopeng Dou , Wenhui Li

We study the empirical version of halfspace depths with the objective of establishing a connection between the rates of convergence and the tail behaviour of the corresponding underlying distributions. The intricate interplay between the…

Statistics Theory · Mathematics 2025-06-03 Sibsankar Singha , Marie Kratz , Sreekar Vadlamani

We investigate the relaxation of long-tailed distributions under stochastic dynamics that do not support such tails. Linear relaxation is found to be a borderline case in which long tails are exponentially suppressed in time but not…

Statistical Mechanics · Physics 2015-06-22 Christian Van den Broeck , Upendra Harbola , Raul Toral , Katja Lindenberg

Despite recent advancements in out-of-distribution (OOD) detection, most current studies assume a class-balanced in-distribution training dataset, which is rarely the case in real-world scenarios. This paper addresses the challenging task…

Machine Learning · Computer Science 2023-12-15 Tong Wei , Bo-Lin Wang , Min-Ling Zhang

The study of loss function distributions is critical to characterize a model's behaviour on a given machine learning problem. For example, while the quality of a model is commonly determined by the average loss assessed on a testing set,…

Machine Learning · Computer Science 2023-06-06 Etrit Haxholli , Marco Lorenzi

We study a new estimator for the tail index of a distribution in the Frechet domain of attraction that arises naturally by computing subsample maxima. This estimator is equivalent to taking a U-statistic over a Hill estimator with two order…

Methodology · Statistics 2015-03-20 Stefan Wager

Many data distributions in the real world are hardly uniform. Instead, skewed and long-tailed distributions of various kinds are commonly observed. This poses an interesting problem for machine learning, where most algorithms assume or work…

Machine Learning · Computer Science 2024-04-25 Charika de Alvis , Suranga Seneviratne

The field of property testing of probability distributions, or distribution testing, aims to provide fast and (most likely) correct answers to questions pertaining to specific aspects of very large datasets. In this work, we consider a…

Data Structures and Algorithms · Computer Science 2015-04-27 Clément L. Canonne

Real-world data are long-tailed, the lack of tail samples leads to a significant limitation in the generalization ability of the model. Although numerous approaches of class re-balancing perform well for moderate class imbalance problems,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yanbiao Ma , Licheng Jiao , Fang Liu , Shuyuan Yang , Xu Liu , Puhua Chen

Over the last few decades power law distributions have been suggested as forming generative mechanisms in a variety of disparate fields, such as, astrophysics, criminology and database curation. However, fitting these heavy tailed…

Computation · Statistics 2014-08-26 Colin S. Gillespie

This paper proposes a scoring-rule-based method for ranking predictive distributions in the Fr\'echet domain that is able to distinguish between different tail indices. The approach is built on normalized order statistics and exploits…

Methodology · Statistics 2026-03-26 Martin Bladt , Christoffer Øhlenschlæger

In risk management, tail risks are of crucial importance. The quality of a tail model, which is determined by data from an unknown distribution, depends critically on the subset of data used to model the tail. Based on a suitably weighted…

Methodology · Statistics 2021-01-19 Ingo Hoffmann , Christoph J. Börner

Diffusion models have made significant advances recently in high-quality image synthesis and related tasks. However, diffusion models trained on real-world datasets, which often follow long-tailed distributions, yield inferior fidelity for…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Divin Yan , Lu Qi , Vincent Tao Hu , Ming-Hsuan Yang , Meng Tang

A class of probability distributions is characterized via equalities in law between two order statistics shifted by independent exponential variables. An explicit formula for the quintile function of the identified family of distributions…

Probability · Mathematics 2011-07-26 M. Ahsanullah , V. B. Nevzorov , George P. Yanev

We propose a mean functional which exists for any probability distributions, and which characterizes the Pareto distribution within the set of distributions with finite left endpoint. This is in sharp contrast to the mean excess plot which…

Methodology · Statistics 2024-04-05 Bernhard Klar

Given samples from an unknown distribution $p$, is it possible to distinguish whether $p$ belongs to some class of distributions $\mathcal{C}$ versus $p$ being far from every distribution in $\mathcal{C}$? This fundamental question has…

Data Structures and Algorithms · Computer Science 2015-12-09 Jayadev Acharya , Constantinos Daskalakis , Gautam Kamath

In this paper, we present several heavy-tailed distributions belonging to the new class J of distributions obeying the principle of a single big jump introduced by Beck et al. [1]. We describe the structure of this class from different…

Probability · Mathematics 2015-05-19 Hui Xu , Michael Scheutzow , Yuebao Wang , Zhaolei Cui

Existing out-of-distribution (OOD) detection methods are typically benchmarked on training sets with balanced class distributions. However, in real-world applications, it is common for the training sets to have long-tailed distributions. In…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Haotao Wang , Aston Zhang , Yi Zhu , Shuai Zheng , Mu Li , Alex Smola , Zhangyang Wang

In the real world, long-tailed data distributions are prevalent, making it challenging for models to effectively learn and classify tail classes. However, we discover that in the field of drug chemistry, certain tail classes exhibit higher…

Machine Learning · Computer Science 2025-04-08 Yujia Su , Xinjie Li , Lionel Z. Wang