English
Related papers

Related papers: Robust covariance estimation and explainable outli…

200 papers

In recent years, pattern analysis plays an important role in data mining and recognition, and many variants have been proposed to handle complicated scenarios. In the literature, it has been quite familiar with high dimensionality of data…

Machine Learning · Computer Science 2018-11-09 Miao Cheng , Zunren Liu , Hongwei Zou , Ah Chung Tsoi

This paper develops a robust dynamic mode decomposition (RDMD) method endowed with statistical and numerical robustness. Statistical robustness ensures estimation efficiency at the Gaussian and non-Gaussian probability distributions,…

Methodology · Statistics 2022-07-08 Amir Hossein Abolmasoumi , Marcos Netto , Lamine Mili

Robust estimators of large covariance matrices are considered, comprising regularized (linear shrinkage) modifications of Maronna's classical M-estimators. These estimators provide robustness to outliers, while simultaneously being…

Statistics Theory · Mathematics 2018-07-04 Nicolas Auguin , David Morales-Jimenez , Matthew R. McKay , Romain Couillet

Quadratic and Linear Discriminant Analysis (QDA/LDA) are the most often applied classification rules under normality. In QDA, a separate covariance matrix is estimated for each group. If there are more variables than observations in the…

Methodology · Statistics 2016-12-26 Stéphanie Aerts , Ines Wilms

We provide a unified approach to MM-estimation with auxiliary scale for balanced linear models with structured covariance matrices. This approach leads to estimators that are highly robust against outliers and highly efficient for normal…

Statistics Theory · Mathematics 2025-11-10 Hendrik Paul Lopuhaa

The deployment of deep neural networks in safety-critical systems necessitates reliable and efficient uncertainty quantification (UQ). A practical and widespread strategy for UQ is repurposing stochastic regularizers as scalable approximate…

Machine Learning · Computer Science 2026-04-15 Adam T. Müller , Tobias Rögelein , Nicolaj C. Stache

The maximum correntropy criterion (MCC) has recently been successfully applied in robust regression, classification and adaptive filtering, where the correntropy is maximized instead of minimizing the well-known mean square error (MSE) to…

Machine Learning · Statistics 2017-11-27 Badong Chen , Lei Xing , Haiquan Zhao , Bin Xu , Jose C. Principe

A deep neural network (DNN) consists of a nonlinear transformation from an input to a feature representation, followed by a common softmax linear classifier. Though many efforts have been devoted to designing a proper architecture for…

Machine Learning · Computer Science 2018-06-20 Tianyu Pang , Chao Du , Jun Zhu

This paper deals with robust inference for parametric copula models. Estimation using Canonical Maximum Likelihood might be unstable, especially in the presence of outliers. We propose to use a procedure based on the Maximum Mean…

Reliable anomaly detection is essential for ensuring the safety of autonomous robots, particularly when conventional detection systems based on vision or LiDAR become unreliable in adverse or unpredictable conditions. In such scenarios,…

Robotics · Computer Science 2025-05-12 Yizhuo Yang , Jiulin Zhao , Xinhang Xu , Kun Cao , Shenghai Yuan , Lihua Xie

Classical multivariate statistics measures the outlyingness of a point by its Mahalanobis distance from the mean, which is based on the mean and the covariance matrix of the data. A multivariate depth function is a function which, given a…

Methodology · Statistics 2021-05-06 Karl Mosler , Pavlo Mozharovskyi

Outlier detection aims to identify unusual data instances that deviate from expected patterns. The outlier detection is particularly challenging when outliers are context dependent and when they are defined by unusual combinations of…

Artificial Intelligence · Computer Science 2015-05-18 Charmgil Hong , Milos Hauskrecht

Out-of-distribution (OOD) detection is a critical component for ensuring the reliability of deep neural networks in safety-critical applications. In this work, we present a key empirical observation: for in-distribution (ID) samples,…

Machine Learning · Computer Science 2026-05-15 Donghwan Kim , Hyunsoo Yoon

Mahalanobis distance (MD) is a simple and popular post-processing method for detecting out-of-distribution (OOD) inputs in neural networks. We analyze its failure modes for near-OOD detection and propose a simple fix called relative…

Machine Learning · Computer Science 2021-06-18 Jie Ren , Stanislav Fort , Jeremiah Liu , Abhijit Guha Roy , Shreyas Padhy , Balaji Lakshminarayanan

Reliable uncertainty estimation is crucial for machine learning models, especially in safety-critical domains. While exact Bayesian inference offers a principled approach, it is often computationally infeasible for deep neural networks.…

Machine Learning · Computer Science 2025-12-18 Aslak Djupskås , Alexander Johannes Stasik , Signe Riemer-Sørensen

We introduce a class of regularized M-estimators of multivariate scatter and show, analogous to the popular spatial sign covariance matrix (SSCM), that they possess high breakdown points. We also show that the SSCM can be viewed as an…

Methodology · Statistics 2023-08-01 David E. Tyler , Mengxi Yi , Klaus Nordhausen

The geometric median covariation matrix is a robust multivariate indicator of dispersion which can be extended without any difficulty to functional data. We define estimators, based on recursive algorithms, that can be simply updated at…

Statistics Theory · Mathematics 2016-07-12 Hervé Cardot , Antoine Godichon-Baggioni

The cellwise robust M regression estimator is introduced as the first estimator of its kind that intrinsically yields both a map of cellwise outliers consistent with the linear model, and a vector of regression coefficients that is robust…

Methodology · Statistics 2020-03-17 Peter Filzmoser , Sebastiaan Höppner , Irene Ortner , Sven Serneels , Tim Verdonck

The application of standard sufficient dimension reduction methods for reducing the dimension space of predictors without losing regression information requires inverting the covariance matrix of the predictors. This has posed a number of…

Methodology · Statistics 2019-10-01 Kabir Opeyemi Olorede , Waheed Babatunde Yahya

Estimation of large sparse covariance matrices is of great importance for statistical analysis, especially in the high-dimensional settings. The traditional approach such as the sample covariance matrix performs poorly due to the high…

Statistics Theory · Mathematics 2023-08-21 Xiaoning Kang , Xinwei Deng