English
Related papers

Related papers: The Spurious Factor Dilemma: Robust Inference in H…

200 papers

The accurate specification of the number of factors is critical to the validity of factor models and the topic almost occupies the central position in factor analysis. Plenty of estimators are available under the restrictive condition that…

Methodology · Statistics 2019-08-15 Long Yu , Yong He , Xinsheng Zhang

Determining the number of factors in high-dimensional factor modeling is essential but challenging, especially when the data are heavy-tailed. In this paper, we introduce a new estimator based on the spectral properties of Spearman sample…

Methodology · Statistics 2024-08-29 Jiaxin Qiu , Zeng Li , Jianfeng Yao

In high-dimensional statistics, the Lasso is a cornerstone method for simultaneous variable selection and parameter estimation. However, its reliance on the squared loss function renders it highly sensitive to outliers and heavy-tailed…

Machine Learning · Statistics 2025-11-20 The Tien Mai

Factor models are a very efficient way to describe high dimensional vectors of data in terms of a small number of common relevant factors. This problem, which is of fundamental importance in many disciplines, is usually reformulated in…

Optimization and Control · Mathematics 2018-06-13 Valentina Ciccone , Augusto Ferrante , Mattia Zorzi

Recent works have proposed incorporating heavy-tailed (HT) noise into diffusion- and flow-based generative models, with the goals of better recovering the tails of target distributions and improving generative diversity. This motivation is…

Machine Learning · Computer Science 2026-05-14 Hamza Cherkaoui , Hélène Halconruy , Antonio Ocello

Estimating eigenvectors and low-dimensional subspaces is of central importance for numerous problems in statistics, computer science, and applied mathematics. This paper characterizes the behavior of perturbed eigenvectors for a range of…

Statistics Theory · Mathematics 2018-09-14 Joshua Cape , Minh Tang , Carey E. Priebe

In this paper, we develop connections between two seemingly disparate, but central, models in robust statistics: Huber's epsilon-contamination model and the heavy-tailed noise model. We provide conditions under which this connection…

Machine Learning · Statistics 2019-07-03 Adarsh Prasad , Sivaraman Balakrishnan , Pradeep Ravikumar

In this paper, we investigate and develop a new approach to the numerical analysis and characterization of random fluctuations with heavy-tailed probability distribution function (PDF), such as turbulent heat flow and solar flare…

Statistical Mechanics · Physics 2017-03-22 Mohsen Ghasemi Nezhadhaghighi , Abbas Nakhlband

Though very popular, it is well known that the EM for GMM algorithm suffers from non-Gaussian distribution shapes, outliers and high-dimensionality. In this paper, we design a new robust clustering algorithm that can efficiently deal with…

Machine Learning · Statistics 2020-10-06 Violeta Roizman , Matthieu Jonckheere , Frédéric Pascal

Large-scale multiple testing with correlated and heavy-tailed data arises in a wide range of research areas from genomics, medical imaging to finance. Conventional methods for estimating the false discovery proportion (FDP) often ignore the…

Methodology · Statistics 2018-09-19 Jianqing Fan , Yuan Ke , Qiang Sun , Wen-Xin Zhou

Feature selection has remained a daunting challenge in machine learning and artificial intelligence, where increasingly complex, high-dimensional datasets demand principled strategies for isolating the most informative predictors. Despite…

Machine Learning · Statistics 2025-12-02 Mousam Sinha , Tirtha Sarathi Ghosh , Ridam Pal

Ecess-over-Threshold method is a crucial technique in extreme value analysis, which approximately models larger observations over a threshold using a Generalized Pareto Distribution. This paper presents a comprehensive framework for…

Methodology · Statistics 2025-06-03 Yifan Hu , Yanxi Hou

We study the problem of factor modelling vector- and tensor-valued time series in the presence of heavy tails in the data, which produce extreme observations with non-negligible probability. We propose to combine a two-step procedure for…

Methodology · Statistics 2025-09-08 Matteo Barigozzi , Haeran Cho , Hyeyoung Maeng

Factor analysis is over a century old, but it is still problematic to choose the number of factors for a given data set. The scree test is popular but subjective. The best performing objective methods are recommended on the basis of…

Methodology · Statistics 2015-11-12 A. B. Owen , J. Wang

We address a parametric joint detection-estimation problem for discrete signals of the form $x(t) = \sum_{n=1}^{N} \alpha_n e^{-i \lambda_n t } + \epsilon_t$, $t \in \mathbb{N}$, with an additive noise represented by independent centered…

Classical Analysis and ODEs · Mathematics 2018-08-14 Illya M. Karabash , Jürgen Prestin

Identifying the number of factors in a high-dimensional factor model has attracted much attention in recent years and a general solution to the problem is still lacking. A promising ratio estimator based on the singular values of the lagged…

Methodology · Statistics 2018-01-23 Zeng Li , Qinwen Wang , Jianfeng Yao

This paper proposes new estimators of the number of factors for a generalised factor model with more relaxed assumptions than the strict factor model. Under the framework of large cross-sections $N$ and large time dimensions $T$, we first…

Methodology · Statistics 2022-03-29 Rui Wang , Dandan Jiang

We study large deviation probabilities for a sum of dependent random variables from a heavy-tailed factor model, assuming that the components are regularly varying. We identify conditions where both the factor and the idiosyncratic terms…

Probability · Mathematics 2007-12-05 Boualem Djehiche , Jens Svensson

Despite the successes of probabilistic models based on passing noise through neural networks, recent work has identified that such methods often fail to capture tail behavior accurately, unless the tails of the base distribution are…

Machine Learning · Statistics 2023-06-16 Feynman Liang , Liam Hodgkinson , Michael W. Mahoney

We analyze quantitatively the effect of spurious multifractality induced by the presence of fat-tailed symmetric and asymmetric probability distributions of fluctuations in time series. In the presented approach different kinds of symmetric…

Computational Finance · Quantitative Finance 2018-05-31 Rafal Rak , Dariusz Grech
‹ Prev 1 2 3 10 Next ›