English
Related papers

Related papers: The Spurious Factor Dilemma: Robust Inference in H…

200 papers

Label noise widely exists in large-scale datasets and significantly degenerates the performances of deep learning algorithms. Due to the non-identifiability of the instance-dependent noise transition matrix, most existing algorithms address…

Machine Learning · Computer Science 2023-05-16 Hanwen Deng , Weijia Zhang , Min-Ling Zhang

We study estimation of large Dynamic Factor models implemented through the Expectation Maximization (EM) algorithm, jointly with the Kalman smoother. We prove that as both the cross-sectional dimension, $n$, and the sample size, $T$,…

Statistics Theory · Mathematics 2024-09-26 Matteo Barigozzi , Matteo Luciani

In partial multi-label learning (PML), each instance is associated with a set of candidate labels containing both ground-truth and noisy labels. The presence of noisy labels disrupts the correspondence between features and labels, degrading…

Machine Learning · Computer Science 2026-04-13 Yu Chen , Weijun Lv , Yue Huang , Xiaozhao Fang , Jie Wen , Yong Xu , Guanbin Li

We propose modeling raw functional data as a mixture of a smooth function and a highdimensional factor component. The conventional approach to retrieving the smooth function from the raw data is through various smoothing techniques.…

Methodology · Statistics 2021-02-05 Yuan Gao , Han Lin Shang , Yanrong Yang

Heavy-tailed distributions naturally occur in many real life problems. Unfortunately, it is typically not possible to compute inference in closed-form in graphical models which involve such heavy-tailed distributions. In this work, we…

Machine Learning · Computer Science 2011-03-22 Danny Bickson , Carlos Guestrin

Conventional de-noising methods rely on the assumption that all samples are independent and identically distributed, so the resultant classifier, though disturbed by noise, can still easily identify the noises as the outliers of training…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Xuanyu Yi , Kaihua Tang , Xian-Sheng Hua , Joo-Hwee Lim , Hanwang Zhang

A novel statistical method is proposed and investigated for estimating a heavy tailed density under mild smoothness assumptions. Statistical analyses of heavy-tailed distributions are susceptible to the problem of sparse information in the…

Methodology · Statistics 2022-11-18 Surya T Tokdar , Sheng Jiang , Erika L Cunningham

This work presents a novel and effective method for fitting multidimensional ellipsoids to scattered data in the contamination of noise and outliers. We approach the problem as a Bayesian parameter estimate process and maximize the…

Methodology · Statistics 2024-07-30 Zhao Mingyang , Jia Xiaohong , Ma Lei , Shi Yuke , Jiang Jingen , Li Qizhai , Yan Dong-Ming , Huang Tiejun

Over the past decades, there has been a surge of interest in studying low-dimensional structures within high-dimensional data. Statistical factor models $-$ i.e., low-rank plus diagonal covariance structures $-$ offer a powerful framework…

Machine Learning · Statistics 2025-05-20 Daniel Cederberg

The recently proposed statistical finite element (statFEM) approach synthesises measurement data with finite element models and allows for making predictions about the unknown true system response. We provide a probabilistic error analysis…

Statistics Theory · Mathematics 2025-06-17 Toni Karvonen , Fehmi Cirak , Mark Girolami

Real-world data is laden with outlying values. The challenge for machine learning is that the learner typically has no prior knowledge of whether the feedback it receives (losses, gradients, etc.) will be heavy-tailed or not. In this work,…

Machine Learning · Statistics 2020-12-16 Matthew J. Holland

We introduce a method to estimate simultaneously the tail and the threshold parameters of an extreme value regression model. This standard model finds its use in finance to assess the effect of market variables on extreme loss distributions…

Methodology · Statistics 2023-04-17 Julien Hambuckers , Marie Kratz , Antoine Usseglio-Carleve

Motivation: Many inference tools use the Perfect Phylogeny Model (PPM) to learn trees from noisy variant allele frequency (VAF) data. Learning in this setting is hard, and existing tools use approximate or heuristic algorithms. An…

Quantitative Methods · Quantitative Biology 2019-08-26 Surjyendu Ray , Bei Jia , Sam Safavi , Tim van Opijnen , Ralph Isberg , Jason Rosch , José Bento

We consider the problem of state estimation in dynamical systems and propose a different mechanism for handling unmodeled system uncertainties. Instead of injecting random process noise, we assign different weights to measurements so that…

Information Theory · Computer Science 2020-09-08 Yaron Shulami , Daniel Sigalov

Multiple rotation averaging plays a crucial role in computer vision and robotics domains. The conventional optimization-based methods optimize a nonlinear cost function based on certain noise assumptions, while most previous learning-based…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Shiqi Li , Jihua Zhu , Yifan Xie , Naiwen Hu , Mingchen Zhu , Zhongyu Li , Di Wang

We offer a survey of recent results on covariance estimation for heavy-tailed distributions. By unifying ideas scattered in the literature, we propose user-friendly methods that facilitate practical implementation. Specifically, we…

Methodology · Statistics 2019-03-12 Yuan Ke , Stanislav Minsker , Zhao Ren , Qiang Sun , Wen-Xin Zhou

Deep learning models are known to often learn features that spuriously correlate with the class label during training but are irrelevant to the prediction task. Existing methods typically address this issue by annotating potential spurious…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Weiwei Li , Junzhuo Liu , Yuanyuan Ren , Yuchen Zheng , Yahao Liu , Wen Li

Reliable state estimation depends on accurately modeled noise covariances, which are difficult to determine in practice. This paper formulates the noise covariance estimation as a bilevel optimization problem that factorizes the joint…

Systems and Control · Electrical Eng. & Systems 2025-12-08 Haoying Li , Yifan Peng , Yuchi Wu , Junfeng Wu

State filtering is a key problem in many signal processing applications. From a series of noisy measurement, one would like to estimate the state of some dynamic system. Existing techniques usually adopt a Gaussian noise assumption which…

Methodology · Statistics 2016-12-16 Bin Liu

The performances of a new data processing technique, namely the Empirical Mode Decomposition, are evaluated on a fully developed turbulent velocity signal perturbed by a numerical forcing which mimics a long-period flapping. First, we…

Fluid Dynamics · Physics 2015-05-20 Nicolas Mazellier , Fabrice Foucher