English
Related papers

Related papers: Head/tail Breaks: A New Classification Scheme for …

200 papers

The degree distribution is one of the most fundamental graph properties of interest for real-world graphs. It has been widely observed in numerous domains that graphs typically have a tailed or scale-free degree distribution. While the…

Data Structures and Algorithms · Computer Science 2015-11-30 Olivia Simpson , C. Seshadhri , Andrew McGregor

Understanding the shape of a distribution of data is of interest to people in a great variety of fields, as it may affect the types of algorithms used for that data. We study one such problem in the framework of distribution property…

Machine Learning · Computer Science 2022-12-06 Maryam Aliakbarpour , Amartya Shankha Biswas , Kavya Ravichandran , Ronitt Rubinfeld

Real-world data often follows a long-tailed distribution, which makes the performance of existing classification algorithms degrade heavily. A key issue is that samples in tail categories fail to depict their intra-class diversity. Humans…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Xiaohua Chen , Yucan Zhou , Dayan Wu , Wanqian Zhang , Yu Zhou , Bo Li , Weiping Wang

Despite the successes of probabilistic models based on passing noise through neural networks, recent work has identified that such methods often fail to capture tail behavior accurately, unless the tails of the base distribution are…

Machine Learning · Statistics 2023-06-16 Feynman Liang , Liam Hodgkinson , Michael W. Mahoney

The dominant approaches to text representation in natural language rely on learning embeddings on massive corpora which have convenient properties such as compositionality and distance preservation. In this paper, we develop a novel method…

Statistical distributions with heavy tails are ubiquitous in natural and social phenomena. Since the entries in heavy tail have disproportional significance, the knowledge of its exact shape is very important. Citations of scientific papers…

Physics and Society · Physics 2015-06-05 Michael Golosovsky , Sorin Solomon

Real world data often have a long-tailed and open-ended distribution. A practical recognition system must classify among majority and minority classes, generalize from a few known instances, and acknowledge novelty upon a never seen…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Ziwei Liu , Zhongqi Miao , Xiaohang Zhan , Jiayun Wang , Boqing Gong , Stella X. Yu

Score-based generative models (SGMs) have achieved remarkable empirical success, motivating their application to a broad range of data distributions. However, extending them to heavy-tailed targets remains a largely open problem. Although…

Machine Learning · Statistics 2026-05-15 Tiziano Fassina , Gabriel Cardoso , Sylvan Le Corff , Thomas Romary

The study of heavy-tailed distributions in economic and financial systems has been widely addressed since financial time series has become a research subject.After the eighties, several "highly improbable" market drops were observed (e.g.…

Computational Finance · Quantitative Finance 2012-02-02 João P. da Cruz , Pedro G. Lind

The imbalance (or long-tail) is the nature of many real-world data distributions, which often induces the undesirable bias of deep classification models toward frequent classes, resulting in poor performance for tail classes. In this paper,…

Machine Learning · Computer Science 2025-10-13 Fudong Lin , Xu Yuan

We characterise the learning of a mixture of two clouds of data points with generic centroids via empirical risk minimisation in the high dimensional regime, under the assumptions of generic convex loss and convex regularisation. Each cloud…

Machine Learning · Statistics 2024-03-19 Urte Adomaityte , Gabriele Sicuro , Pierpaolo Vivo

In the real world, long-tailed data distributions are prevalent, making it challenging for models to effectively learn and classify tail classes. However, we discover that in the field of drug chemistry, certain tail classes exhibit higher…

Machine Learning · Computer Science 2025-04-08 Yujia Su , Xinjie Li , Lionel Z. Wang

The purpose of this paper is to show that the use of heavy-tailed distributions in Financial problems is theoretically baseless and can lead to significant misunderstandings. The reason for this the authors see in an incorrect…

Probability · Mathematics 2015-07-29 Lev B Klebanov , Irina V Volchenkova

Machine learning models fail to perform well on real-world applications when 1) the category distribution P(Y) of the training dataset suffers from long-tailed distribution and 2) the test data is drawn from different conditional…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Xiao Gu , Yao Guo , Zeju Li , Jianing Qiu , Qi Dou , Yuxuan Liu , Benny Lo , Guang-Zhong Yang

We study high-dimensional signal recovery from non-linear measurements with design vectors having elliptically symmetric distribution. Special attention is devoted to the situation when the unknown signal belongs to a set of low statistical…

Statistics Theory · Mathematics 2016-11-14 Larry Goldstein , Stanislav Minsker , Xiaohan Wei

Real world data often exhibits a long-tailed and open-ended (with unseen classes) distribution. A practical recognition system must balance between majority (head) and minority (tail) classes, generalize across the distribution, and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Ziwei Liu , Zhongqi Miao , Xiaohang Zhan , Jiayun Wang , Boqing Gong , Stella X. Yu

Science in the 21st century seems to be governed by novel approaches involving interdisciplinary work, systemic perspectives and complexity theory concepts. These new paradigms force us to leave aside our elder mechanistic approaches and…

Physics and Society · Physics 2020-02-24 Oscar Fontanelli , Pedro Miramontes , Ricardo Mansilla

Different questions related with analysis of extreme values and outliers arise frequently in practice. To exclude extremal observations and outliers is not a good decision because they contain important information about the observed…

Methodology · Statistics 2018-01-17 Pavlina K. Jordanova , Monika P. Petkova

We propose a stochastic process driven by memory effect with novel distributions including both exponential and leptokurtic heavy-tailed distributions. A class of distribution is analytically derived from the continuum limit of the discrete…

Statistical Finance · Quantitative Finance 2013-05-14 Jongwook Kim , Gabjin Oh

Heavy tailed distributions present a tough setting for inference. They are also common in industrial applications, particularly with Internet transaction datasets, and machine learners often analyze such data without considering the biases…

Applications · Statistics 2016-10-14 Matt Taddy , Hedibert Freitas Lopes , Matt Gardner