English
Related papers

Related papers: Classification of Heavy-tailed Features in High Di…

200 papers

Real space condensation is known to occur in stochastic models of mass transport in the regime in which the globally conserved mass density is greater than a critical value. It has been shown within models with factorised stationary states…

Statistical Mechanics · Physics 2014-11-04 Juraj Szavits-Nossan , Martin R. Evans , Satya N. Majumdar

Recent studies have shown that heavy tails can emerge in stochastic optimization and that the heaviness of the tails have links to the generalization error. While these studies have shed light on interesting aspects of the generalization…

Machine Learning · Statistics 2023-02-14 Anant Raj , Melih Barsbey , Mert Gürbüzbalaban , Lingjiong Zhu , Umut Şimşekli

The main challenge that sets transfer learning apart from traditional supervised learning is the distribution shift, reflected as the shift between the source and target models and that between the marginal covariate distributions. In this…

Machine Learning · Statistics 2024-04-02 Zelin He , Ying Sun , Jingyuan Liu , Runze Li

Heavy tailed distributions present a tough setting for inference. They are also common in industrial applications, particularly with Internet transaction datasets, and machine learners often analyze such data without considering the biases…

Applications · Statistics 2016-10-14 Matt Taddy , Hedibert Freitas Lopes , Matt Gardner

Flexible spatial models that allow transitions between tail dependence classes have recently appeared in the literature. However, inference for these models is computationally prohibitive, even in moderate dimensions, due to the necessity…

Statistics Theory · Mathematics 2020-12-03 Likun Zhang , Benjamin A. Shaby , Jennifer L. Wadsworth

Long-tailed distributions in image recognition pose a considerable challenge due to the severe imbalance between a few dominant classes with numerous examples and many minority classes with few samples. Recently, the use of large generative…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Guangxi Li , Yinsheng Song , Mingkai Zheng

In this survey we present an extensive research of the vast literature about the Generalized Lambda Distribution (GLD) and propose a hurdle, or two-way, model whose associated distribution is the GLD in order to meet the demand for a highly…

Applications · Statistics 2019-01-04 Diego Marcondes , Cláudia Peixoto , Ana Carolina Maia

Recently, long-tailed image classification harvests lots of research attention, since the data distribution is long-tailed in many real-world situations. Piles of algorithms are devised to address the data imbalance problem by biasing the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Chaowei Fang , Dingwen Zhang , Wen Zheng , Xue Li , Le Yang , Lechao Cheng , Junwei Han

High-dimensional linear regression under heavy-tailed noise or outlier corruption is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs,…

Statistics Theory · Mathematics 2023-05-11 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

Modern regression problems often involve high-dimensional data and a careful tuning of the regularization hyperparameters is crucial to avoid overly complex models that may overfit the training data while guaranteeing desirable properties…

Machine Learning · Computer Science 2026-04-08 Maria-Florina Balcan , Saumya Goyal , Dravyansh Sharma

The paper introduces structured machine learning regressions for heavy-tailed dependent panel data potentially sampled at different frequencies. We focus on the sparse-group LASSO regularization. This type of regularization can take…

Econometrics · Economics 2021-11-23 Andrii Babii , Ryan T. Ball , Eric Ghysels , Jonas Striaukas

The empirical evidence indicates that stochastic optimization with heavy-tailed gradient noise is more appropriate to characterize the training of machine learning models than that with standard bounded gradient variance noise. Most…

Machine Learning · Computer Science 2026-01-28 Hongxu Chen , Ke Wei , Xiaoming Yuan , Luo Luo

We develop a probabilistic method for assessing the tail behavior and geometric stability of one-dimensional n i.i.d. samples by tracking how their span contracts when the most extreme points are trimmed. Central to our approach is the…

Machine Learning · Statistics 2025-09-03 Erwan Dereure , Emmanuel Akame Mfoumou , David Holcman

In the context of long-tail classification on graphs, the vast majority of existing work primarily revolves around the development of model debiasing strategies, intending to mitigate class imbalances and enhance the overall performance.…

Machine Learning · Computer Science 2024-06-03 Haohui Wang , Baoyu Jing , Kaize Ding , Yada Zhu , Wei Cheng , Si Zhang , Yonghui Fan , Liqing Zhang , Dawei Zhou

Random matrices acting on structured sets play a fundamental role in high-dimensional geometry, compressed sensing, and randomized algorithms. Existing results primarily focus on subgaussian models, when random matrices act as…

Probability · Mathematics 2026-03-11 Tiankun Diao , Xuanang Hu , Vladimir V. Ulyanov , Hanchao Wang

Convolutional neural networks have achieved great improvement on face recognition in recent years because of its extraordinary ability in learning discriminative features of people with different identities. To train such a well-designed…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Xiao Zhang , Zhiyuan Fang , Yandong Wen , Zhifeng Li , Yu Qiao

Mixed membership models are an extension of finite mixture models, where each observation can partially belong to more than one mixture component. A probabilistic framework for mixed membership models of high-dimensional continuous data is…

For purposes of Value-at-Risk estimation, we consider several multivariate families of heavy-tailed distributions, which can be seen as multidimensional versions of Paretian stable and Student's t distributions allowing different marginals…

Risk Management · Quantitative Finance 2011-12-20 Carlo Marinelli , Stefano d'Addona , Svetlozar T. Rachev

It is of importance to develop statistical techniques to analyze high-dimensional data in the presence of both complex dependence and possible outliers in real-world applications such as imaging data analyses. We propose a new robust…

Methodology · Statistics 2021-10-01 Bingyuan Liu , Qi Zhang , Lingzhou Xue , Peter X. K. Song , Jian Kang

It is important to identify the discriminative features for high dimensional clustering. However, due to the lack of cluster labels, the regularization methods developed for supervised feature selection can not be directly applied. To learn…

Machine Learning · Statistics 2025-07-16 Zhaoyu Xing , Yang Wan , Juan Wen , Wei Zhong