English
Related papers

Related papers: Head/tail Breaks: A New Classification Scheme for …

200 papers

Class imbalance, which is also called long-tailed distribution, is a common problem in classification tasks based on machine learning. If it happens, the minority data will be overwhelmed by the majority, which presents quite a challenge…

Machine Learning · Computer Science 2023-03-29 Jia-Chen Zhao

Standard statistical analysis is unable to provide reliable confidence intervals on expectation values of probability distributions that do not satisfy the conditions of the central limit theorem. We present a regression-based estimator of…

Data Analysis, Statistics and Probability · Physics 2019-06-24 Pablo Lopez Rios , Gareth J. Conduit

Learning the tail behavior of a distribution is a notoriously difficult problem. By definition, the number of samples from the tail is small, and deep generative models, such as normalizing flows, tend to concentrate on learning the body of…

Machine Learning · Computer Science 2022-06-28 Mike Laszkiewicz , Johannes Lederer , Asja Fischer

In the context of long-tail classification on graphs, the vast majority of existing work primarily revolves around the development of model debiasing strategies, intending to mitigate class imbalances and enhance the overall performance.…

Machine Learning · Computer Science 2024-06-03 Haohui Wang , Baoyu Jing , Kaize Ding , Yada Zhu , Wei Cheng , Si Zhang , Yonghui Fan , Liqing Zhang , Dawei Zhou

In this paper we introduce and study several multivariate, heavy-tailed distribution classes, and we explore their closure properties and their applications. We consider the class of multivariate, positively decreasing distributions, and…

Probability · Mathematics 2026-04-28 Dimitrios G. Konstantinides , Charalampos D. Passalidis

As the data scale grows, deep recognition models often suffer from long-tailed data distributions due to the heavy imbalanced sample number across categories. Indeed, real-world data usually exhibit some similarity relation among different…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Lei Liu , Li Liu

Power laws and distributions with heavy tails are common features of many experimentally studied complex systems, like the distribution of the sizes of earthquakes and solar flares, or the duration of neuronal avalanches in the brain.…

Adaptation and Self-Organizing Systems · Physics 2014-03-05 Dimitrije Markovic , Claudius Gros

The heavy reliance on data is one of the major reasons that currently limit the development of deep learning. Data quality directly dominates the effect of deep learning models, and the long-tailed distribution is one of the factors…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Lu Yang , He Jiang , Qing Song , Jun Guo

The study of loss function distributions is critical to characterize a model's behaviour on a given machine learning problem. For example, while the quality of a model is commonly determined by the average loss assessed on a testing set,…

Machine Learning · Computer Science 2023-06-06 Etrit Haxholli , Marco Lorenzi

Graph models provide efficient tools to capture the underlying structure of data defined over networks. Many real-world network topologies are subject to change over time. Learning to model the dynamic interactions between entities in such…

Machine Learning · Computer Science 2025-01-03 Amirhossein Javaheri , Jiaxi Ying , Daniel P. Palomar , Farokh Marvasti

This paper introduces a flexible framework for the estimation of the conditional tail index of heavy tailed distributions. In this framework, the tail index is computed from an auxiliary linear regression model that facilitates estimation…

Econometrics · Economics 2024-09-23 João Nicolau , Paulo M. M. Rodrigues

Both parametric distribution functions appearing in extreme value theory - the generalized extreme value distribution and the generalized Pareto distribution - have log-concave densities if the extreme value index gamma is in [-1,0].…

Statistics Theory · Mathematics 2023-04-17 Samuel Müller , Kaspar Rufibach

Some new survival distributions are introduced based on a generalised exponential function. This class of distributions includes heavy-tailed generalisations of exponential, Weibull and gamma distributions. Properties of the distributions…

Methodology · Statistics 2014-12-03 Rose Baker

The normal distribution and its perturbation has left an immense mark on the statistical literature. Hence, several generalized forms were developed to model different skewness, kurtosis, and body shapes. However, it is not easy to…

Methodology · Statistics 2019-12-10 Matthias Wagener , Mohammad Arashi

Long-tailed data distributions pose challenges for a variety of domains like e-commerce, finance, biomedical science, and cyber security, where the performance of machine learning models is often dominated by head categories while tail…

Machine Learning · Computer Science 2024-10-31 Haohui Wang , Weijie Guan , Jianpeng Chen , Zi Wang , Dawei Zhou

The size that an epidemic can reach, measured in terms of the number of fatalities, is an extremely relevant quantity. It has been recently claimed [Cirillo & Taleb, Nature Physics 2020] that the size distribution of major epidemics in…

Physics and Society · Physics 2021-03-18 Alvaro Corral

Graph classification, aiming at learning the graph-level representations for effective class assignments, has received outstanding achievements, which heavily relies on high-quality datasets that have balanced class distribution. In fact,…

Machine Learning · Computer Science 2023-09-06 Siyu Yi , Zhengyang Mao , Wei Ju , Yongdao Zhou , Luchen Liu , Xiao Luo , Ming Zhang

We introduce a new statistical tool (the TP-statistic and TE-statistic) designed specifically to compare the behavior of the sample tail of distributions with power-law and exponential tails as a function of the lower threshold u. One…

Computational Physics · Physics 2009-11-10 V. F. Pisarenko , D. Sornette

Unraveling the reasons behind the remarkable success and exceptional generalization capabilities of deep neural networks presents a formidable challenge. Recent insights from random matrix theory, specifically those concerning the spectral…

Machine Learning · Statistics 2023-04-10 Xuanzhe Xiao , Zeng Li , Chuanlong Xie , Fengwei Zhou

We study the critical behavior of the component sizes for the configuration model when the tail of the degree distribution of a randomly chosen vertex is a regularly-varying function with exponent $\tau-1$, where $\tau\in (3,4)$. The…

Probability · Mathematics 2020-12-22 Souvik Dhara , Remco van der Hofstad , Johan S. H. van Leeuwaarden , Sanchayan Sen
‹ Prev 1 3 4 5 6 7 10 Next ›