English
Related papers

Related papers: On a minimum distance procedure for threshold sele…

200 papers

Modelling multivariate tail dependence is one of the key challenges in extreme-value theory. Multivariate extremes are usually characterized using parametric models, some of which have simpler submodels at the boundary of their parameter…

Methodology · Statistics 2018-12-17 Anna Kiriliouk

Even though practitioners often estimate Pareto exponents running OLS rank-size regressions, the usual recommendation is to use the Hill MLE with a small-sample correction instead, due to its unbiasedness and efficiency. In this paper, we…

Methodology · Statistics 2024-09-18 Thiago Trafane Oliveira Santos , Daniel Oliveira Cajueiro

The imbalance (or long-tail) is the nature of many real-world data distributions, which often induces the undesirable bias of deep classification models toward frequent classes, resulting in poor performance for tail classes. In this paper,…

Machine Learning · Computer Science 2025-10-13 Fudong Lin , Xu Yuan

Understanding the properties of response time distributions is a long-standing problem in cognitive science. We provide a tutorial overview of several contemporary models that assume power law scaling is a plausible description of the…

Neurons and Cognition · Quantitative Biology 2015-10-15 Z. Liu , O. Pavlov Garcia , J. G. Holden , R. A. Serota

The theory of Extreme Physical Information (EPI) is used to deduce a probability density function (PDF) of a system that exhibits a power law tail. The computed PDF is useful to study and fit several observed distributions in complex…

Data Analysis, Statistics and Probability · Physics 2011-03-21 Ricardo Bonilla , Roberto Zarama , Juan Alejandro Valdivia

We propose a distance supervised relation extraction approach for long-tailed, imbalanced data which is prevalent in real-world settings. Here, the challenge is to learn accurate "few-shot" models for classes existing at the tail of the…

Information Retrieval · Computer Science 2023-01-26 Ningyu Zhang , Shumin Deng , Zhanlin Sun , Guanying Wang , Xi Chen , Wei Zhang , Huajun Chen

We propose a new unsupervised anomaly detection method based on the sliced-Wasserstein distance for training data selection in machine learning approaches. Our filtering technique is interesting for decision-making pipelines deploying…

Machine Learning · Computer Science 2025-04-18 Julien Pallage , Antoine Lesage-Landry

This paper proposes a scoring-rule-based method for ranking predictive distributions in the Fr\'echet domain that is able to distinguish between different tail indices. The approach is built on normalized order statistics and exploits…

Methodology · Statistics 2026-03-26 Martin Bladt , Christoffer Øhlenschlæger

We develop a probabilistic method for assessing the tail behavior and geometric stability of one-dimensional n i.i.d. samples by tracking how their span contracts when the most extreme points are trimmed. Central to our approach is the…

Machine Learning · Statistics 2025-09-03 Erwan Dereure , Emmanuel Akame Mfoumou , David Holcman

Power law scaling is observed in many physical, biological and socio-economical complex systems and is now considered as an important property of these systems. In general, power law exists in the central part of the distribution. It has…

Statistical Mechanics · Physics 2009-11-13 Hari M. Gupta , Jose R. Campanha , Sidney J. Schinaider

Estimating characteristics of large graphs via sampling is a vital part of the study of complex networks. Current sampling methods such as (independent) random vertex and random walks are useful but have drawbacks. Random vertex sampling…

Data Structures and Algorithms · Computer Science 2010-09-08 Bruno Ribeiro , Don Towsley

Inference over tails is usually performed by fitting an appropriate limiting distribution over observations that exceed a fixed threshold. However, the choice of such threshold is critical and can affect the inferential results. Extreme…

Statistical Finance · Quantitative Finance 2019-02-26 Chiara Lattanzi , Manuele Leonelli

This paper investigates pooling strategies for tail index and extreme quantile estimation from heavy-tailed data. To fully exploit the information contained in several samples, we present general weighted pooled Hill estimators of the tail…

Statistics Theory · Mathematics 2021-11-08 Abdelaati Daouia , Simone A. Padoan , Gilles Stupfler

Stochastic gradients closely relate to both optimization and generalization of deep neural networks (DNNs). Some works attempted to explain the success of stochastic optimization for deep learning by the arguably heavy-tail properties of…

Machine Learning · Computer Science 2023-10-23 Zeke Xie , Qian-Yuan Tang , Mingming Sun , Ping Li

We present exact analytical results for the distribution of shortest path lengths (DSPL) in a directed network model that grows by node duplication. Such models are useful in the study of the structure and growth dynamics of gene regulatory…

Physics and Society · Physics 2019-08-21 Chanania Steinbock , Ofer Biham , Eytan Katzav

In recent years several attempts have been made to extend tail modelling towards the modal part of the data. Frigessi et al. (2002) introduced dynamic mixtures of two components with a weight function {\pi} = {\pi}(x) smoothly connecting…

Methodology · Statistics 2018-10-03 Jan Beirlant , Gaonyalelwe Maribe , Philippe Naveau , Andrehette Verster

In this paper, a novel approach to the problem of estimating the heavy-tail exponent alpha>0 of a distribution is proposed. It is based on the fact that block-maxima of size m of the independent and identically distributed data scale at a…

Statistics Theory · Mathematics 2007-06-13 Stilian A. Stoev , George Michailidis , Murad S. Taqqu

This work considers the sample complexity of obtaining an $\varepsilon$-optimal policy in an average reward Markov Decision Process (AMDP), given access to a generative model (simulator). When the ground-truth MDP is weakly communicating,…

Machine Learning · Computer Science 2022-12-02 Jinghan Wang , Mengdi Wang , Lin F. Yang

We investigate the problem of best policy identification in discounted linear Markov Decision Processes in the fixed confidence setting under a generative model. We first derive an instance-specific lower bound on the expected number of…

Machine Learning · Computer Science 2022-08-12 Jerome Taupin , Yassir Jedra , Alexandre Proutiere

In several applications, ultimately at the largest data, truncation effects can be observed when analysing tail characteristics of statistical distributions. In some cases truncation effects are forecasted through physical models such as…

Methodology · Statistics 2017-05-17 Jan Beirlant , Isabel Fraga Alves , Tom Reynkens