English
Related papers

Related papers: Simultaneous Feature Selection and Outlier Detecti…

200 papers

This study deals with the problem of outliers in ordinal response model, which is a regression on ordered categorical data as the response variable. ``Outlier" means that the combination of ordered categorical data and its covariates is…

Methodology · Statistics 2022-12-29 Tomotaka Momozaki , Tomoyuki Nakagawa

We consider new formulations and methods for sparse quantile regression in the high-dimensional setting. Quantile regression plays an important role in many applications, including outlier-robust exploratory analysis in gene selection. In…

Machine Learning · Statistics 2014-02-20 Aleksandr Y. Aravkin , Anju Kambadur , Aurelie C. Lozano , Ronny Luss

The fashion industry has been identified as a major contributor to waste and emissions, leading to an increased interest in promoting the second-hand market. Machine learning methods play an important role in facilitating the creation and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Julio Hurtado , Haoran Ni , Duygu Sap , Connor Mattinson , Martin Lotz

Mixtures of multivariate contaminated shifted asymmetric Laplace distributions are developed for handling asymmetric clusters in the presence of outliers (also referred to as bad points herein). In addition to the parameters of the related…

Methodology · Statistics 2018-04-25 Katherine Morris , Antonio Punzo , Paul D. McNicholas , Ryan P. Browne

In a corpus of data, outliers are either errors: mistakes in the data that are counterproductive, or are unique: informative samples that improve model robustness. Identifying outliers can lead to better datasets by (1) removing noise in…

Most multivariate outlier detection procedures ignore the spatial dependency of observations, which is present in many real data sets from various application areas. This paper introduces a new outlier detection method that accounts for a…

Methodology · Statistics 2024-01-25 Patricia Puchhammer , Peter Filzmoser

Forecasting is an indispensable element of operational research (OR) and an important aid to planning. The accurate estimation of the forecast uncertainty facilitates several operations management activities, predominantly in supporting…

Methodology · Statistics 2020-11-18 Xiaoqian Wang , Yanfei Kang , Fotios Petropoulos , Feng Li

Learning in the presence of outliers is a fundamental problem in statistics. Until recently, all known efficient unsupervised learning algorithms were very sensitive to outliers in high dimensions. In particular, even for the task of robust…

Data Structures and Algorithms · Computer Science 2019-11-15 Ilias Diakonikolas , Daniel M. Kane

Hyperparameters tuning and model selection are important steps in machine learning. Unfortunately, classical hyperparameter calibration and model selection procedures are sensitive to outliers and heavy-tailed data. In this work, we…

Statistics Theory · Mathematics 2019-05-22 Joon Kwon , Guillaume Lecué , Matthieu Lerasle

We study the problem of outlier robust high-dimensional mean estimation under a finite covariance assumption, and more broadly under finite low-degree moment assumptions. We consider a standard stability condition from the recent robust…

Statistics Theory · Mathematics 2021-03-17 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia

Large datasets are often affected by cell-wise outliers in the form of missing or erroneous data. However, discarding any samples containing outliers may result in a dataset that is too small to accurately estimate the covariance matrix.…

Statistics Theory · Mathematics 2023-11-13 Karim Lounici , Grégoire Pacreau

Among semiparametric regression models, partially linear additive models provide a useful tool to include additive nonparametric components as well as a parametric component, when explaining the relationship between the response and a set…

Methodology · Statistics 2024-02-01 Graciela Boente , Alejandra Martínez

Robust training of machine learning models in the presence of outliers has garnered attention across various domains. The use of robust losses is a popular approach and is known to mitigate the impact of outliers. We bring to light two…

Machine Learning · Computer Science 2025-01-03 Rajat Talak , Charis Georgiou , Jingnan Shi , Luca Carlone

The problem of robust mean estimation in high dimensions is studied, in which a certain fraction (less than half) of the datapoints can be arbitrarily corrupted. Motivated by compressive sensing, the robust mean estimation problem is…

Applications · Statistics 2022-12-08 Aditya Deshmukh , Jing Liu , Venugopal V. Veeravalli

We consider Gaussian mixture models in high dimensions and concentrate on the twin tasks of detection and feature selection. Under sparsity assumptions on the difference in means, we derive information bounds and establish the performance…

Statistics Theory · Mathematics 2016-10-04 Nicolas Verzelen , Ery Arias-Castro

While model selection is a well-studied topic in parametric and nonparametric regression or density estimation, selection of possibly high-dimensional nuisance parameters in semiparametric problems is far less developed. In this paper, we…

Methodology · Statistics 2023-09-06 Yifan Cui , Eric Tchetgen Tchetgen

This paper presents an innovative approach to dimensionality reduction and feature extraction in high-dimensional datasets, with a specific application focus on wood surface defect detection. The proposed framework integrates sparse…

Machine Learning · Computer Science 2024-10-01 Harish Neelam , Koushik Sai Veerella , Souradip Biswas

In recent years, the usage of ensemble learning in applications has grown significantly due to increasing computational power allowing the training of large ensembles in reasonable time frames. Many applications, e.g., malware detection,…

Machine Learning · Computer Science 2021-11-18 Peter Domanski , Dirk Pflüger , Jochen Rivoir , Raphaël Latty

It is important to detect anomalous inputs when deploying machine learning systems. The use of larger and more complex inputs in deep learning magnifies the difficulty of distinguishing between anomalous and in-distribution examples. At the…

Machine Learning · Computer Science 2019-01-30 Dan Hendrycks , Mantas Mazeika , Thomas Dietterich

Robust statistical estimators offer resilience against outliers but are often computationally challenging, particularly in high-dimensional sparse settings. Modern optimization techniques are utilized for robust sparse association…

Computation · Statistics 2025-02-03 Pia Pfeiffer , Andreas Alfons , Peter Filzmoser