English
Related papers

Related papers: The Spurious Factor Dilemma: Robust Inference in H…

200 papers

The objective function of a matrix factorization model usually aims to minimize the average of a regression error contributed by each element. However, given the existence of stochastic noises, the implicit deviations of sample data from…

Machine Learning · Computer Science 2016-10-31 Guang-He Lee , Shao-Wen Yang , Shou-De Lin

Sample selection is an effective strategy to mitigate the effect of label noise in robust learning. Typical strategies commonly apply the small-loss criterion to identify clean samples. However, those samples lying around the decision…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Qi Wei , Haoliang Sun , Xiankai Lu , Yilong Yin

Although stochastic optimization is central to modern machine learning, the precise mechanisms underlying its success, and in particular, the precise role of the stochasticity, still remain unclear. Modelling stochastic optimization…

Machine Learning · Statistics 2020-06-12 Liam Hodgkinson , Michael W. Mahoney

Gravitational wave detectors will need optimal signal-processing algorithms to extract weak signals from the detector noise. Most algorithms designed to date are based on the unrealistic assumption that the detector noise may be modeled as…

General Relativity and Quantum Cosmology · Physics 2009-11-07 Bruce Allen , Jolien D. E. Creighton , Eanna E. Flanagan , Joseph D. Romano

Score-based model research in the last few years has produced state of the art generative models by employing Gaussian denoising score-matching (DSM). However, the Gaussian noise assumption has several high-dimensional limitations,…

Machine Learning · Computer Science 2022-04-13 Jacob Deasy , Nikola Simidjievski , Pietro Liò

Latent factor model estimation typically relies on either using domain knowledge to manually pick several observed covariates as factor proxies, or purely conducting multivariate analysis such as principal component analysis. However, the…

Methodology · Statistics 2023-01-04 Runzhe Wan , Yingying Li , Wenbin Lu , Rui Song

We present results of the numerical simulations and the scaling characteristics of one-dimensional random fluctuations with heavy tailed probability distribution functions. Assuming that the distribution function of the random fluctuations…

Statistical Mechanics · Physics 2017-08-16 Mohsen Ghasemi Nezhadhaghighi

In existing distributed stochastic optimization studies, it is usually assumed that the gradient noise has a bounded variance. However, recent research shows that the heavy-tailed noise, which allows an unbounded variance, is closer to…

Optimization and Control · Mathematics 2025-05-15 Jun Hu , Chao Sun , Bo Chen , Jianzheng Wang , Zheming Wang

Recently, several studies consider the stochastic optimization problem but in a heavy-tailed noise regime, i.e., the difference between the stochastic gradient and the true gradient is assumed to have a finite $p$-th moment (say being upper…

Optimization and Control · Mathematics 2023-05-23 Zijian Liu , Zhengyuan Zhou

Probabilistic approach to Boolean matrix factorization can provide solutions robustagainst noise and missing values with linear computational complexity. However,the assumption about latent factors can be problematic in real world…

Machine Learning · Statistics 2019-05-31 Lifan Liang , Songjian Lu

Deep classifiers are known to rely on spurious features $\unicode{x2013}$ patterns which are correlated with the target on the training data but not inherently relevant to the learning problem, such as the image backgrounds when classifying…

Machine Learning · Computer Science 2022-10-21 Pavel Izmailov , Polina Kirichenko , Nate Gruver , Andrew Gordon Wilson

Real-world measurements often comprise a dominant signal contaminated by a noisy background. Robustly estimating the dominant signal in practice has been a fundamental statistical problem. Classically, mixture models have been used to…

Computation · Statistics 2026-05-20 Ananyabrata Barua , Ayanendranath Basu

Factor analysis is a classical data reduction technique that seeks a potentially lower number of unobserved variables that can account for the correlations among the observed variables. This paper presents an extension of the factor…

Methodology · Statistics 2013-12-04 Tsung-I Lin , Pal H. Wu , Geoffrey J. McLachlan , Sharon X. Lee

Modern depth sensors can generate a huge number of 3D points in few seconds to be latter processed by Localization and Mapping algorithms. Ideally, these algorithms should handle efficiently large sizes of Point Clouds under the assumption…

Robotics · Computer Science 2025-02-04 Gonzalo Ferrer , Dmitrii Iarosh , Anastasiia Kornilova

We analyse the matrix factorization problem. Given a noisy measurement of a product of two matrices, the problem is to estimate back the original matrices. It arises in many applications such as dictionary learning, blind matrix…

Numerical Analysis · Computer Science 2016-07-19 Yoshiyuki Kabashima , Florent Krzakala , Marc Mézard , Ayaka Sakata , Lenka Zdeborová

In high-dimensional data, structured noise caused by observed and unobserved factors affecting multiple target variables simultaneously, imposes a serious challenge for modeling, by masking the often weak signal. Therefore, (1) explaining…

Ellipse and ellipsoid fitting has been extensively researched and widely applied. Although traditional fitting methods provide accurate estimation of ellipse parameters in the low-noise case, their performance is compromised when the noise…

Methodology · Statistics 2009-12-10 Jieqi Yu , Sanjeev R. Kulkarni , H. Vincent Poor

We study the problem of estimating the mean of a distribution in high dimensions when either the samples are adversarially corrupted or the distribution is heavy-tailed. Recent developments in robust statistics have established efficient…

Data Structures and Algorithms · Computer Science 2021-01-20 Samuel B. Hopkins , Jerry Li , Fred Zhang

In this paper we discuss the problem of the estimation of extreme event occurrence probability for data drawn from some multifractal process. We also study the heavy (power-law) tail behavior of probability density function associated with…

Statistical Mechanics · Physics 2009-11-11 Jean-Francois Muzy , Emmanuel Bacry , Alexey Kozhemyak

The estimation of the frequencies of multiple superimposed exponentials in noise is an important research problem due to its various applications from engineering to chemistry. In this paper, we propose an efficient and accurate algorithm…

Numerical Analysis · Mathematics 2016-05-05 Shanglin Ye , Elias Aboutanios