中文
相关论文

相关论文: Automatic Outlier Rectification via Optimal Transp…

200 篇论文

Outlier detection refers to the identification of data points that deviate from a general data distribution. Existing unsupervised approaches often suffer from high computational cost, complex hyperparameter tuning, and limited…

机器学习 · 计算机科学 2022-08-26 Zheng Li , Yue Zhao , Xiyang Hu , Nicola Botta , Cezar Ionescu , George H. Chen

Many traditional methods for identifying changepoints can struggle in the presence of outliers, or when the noise is heavy-tailed. Often they will infer additional changepoints in order to fit the outliers. To overcome this problem, data…

统计方法学 · 统计学 2017-07-12 Paul Fearnhead , Guillem Rigaill

Outlier detection aims to identify unusual data instances that deviate from expected patterns. The outlier detection is particularly challenging when outliers are context dependent and when they are defined by unusual combinations of…

人工智能 · 计算机科学 2015-05-18 Charmgil Hong , Milos Hauskrecht

We propose a general approach to handle data contaminations that might disrupt the performance of feature selection and estimation procedures for high-dimensional linear models. Specifically, we consider the co-occurrence of mean-shift and…

统计方法学 · 统计学 2021-06-23 Luca Insolia , Francesca Chiaromonte , Runze Li , Marco Riani

In many applications, when building linear regression models, it is important to account for the presence of outliers, i.e., corrupted input data points. Such problems can be formulated as mixed-integer optimization problems involving cubic…

最优化与控制 · 数学 2023-07-13 Andrés Gómez , José Neto

Outlier-robust estimation is a fundamental problem and has been extensively investigated by statisticians and practitioners. The last few years have seen a convergence across research fields towards "algorithmic robust statistics", which…

机器学习 · 统计学 2022-12-19 Luca Carlone

The presence of outliers is prevalent in machine learning applications and may produce misleading results. In this paper a new method for dealing with outliers and anomal samples is proposed. To overcome the outlier issue, the proposed…

机器学习 · 计算机科学 2016-07-05 Parsa Bagherzadeh , Hadi Sadoghi Yazdi

We explore the connection between outlier-robust high-dimensional statistics and non-convex optimization in the presence of sparsity constraints, with a focus on the fundamental tasks of robust sparse mean estimation and robust sparse PCA.…

机器学习 · 计算机科学 2022-11-15 Yu Cheng , Ilias Diakonikolas , Rong Ge , Shivam Gupta , Daniel M. Kane , Mahdi Soltanolkotabi

We present a flow-based approach to the optimal transport (OT) problem between two continuous distributions $\pi_0,\pi_1$ on $\mathbb{R}^d$, of minimizing a transport cost $\mathbb{E}[c(X_1-X_0)]$ in the set of couplings $(X_0,X_1)$ whose…

机器学习 · 统计学 2022-09-30 Qiang Liu

Outlier detection is a technique in data mining that aims to detect unusual or unexpected records in the dataset. Existing outlier detection algorithms have different pros and cons and exhibit different sensitivity to noisy data such as…

机器学习 · 计算机科学 2023-12-22 Yuanyuan Wei , Julian Jang-Jaccard , Fariza Sabrina , Timothy McIntosh

Outlier detection is the identification of points in a dataset that do not conform to the norm. Outlier detection is highly sensitive to the choice of the detection algorithm and the feature subspace used by the algorithm. Extracting…

人工智能 · 计算机科学 2017-05-18 Yanjie Fu , Charu Aggarwal , Srinivasan Parthasarathy , Deepak S. Turaga , Hui Xiong

Often the challenge associated with tasks like fraud and spam detection is the lack of all likely patterns needed to train suitable supervised learning models. This problem accentuates when the fraudulent patterns are not only scarce, they…

机器学习 · 计算机科学 2019-05-08 Utkarsh Porwal , Smruthi Mukund

Parameter estimation of mixture regression model using the expectation maximization (EM) algorithm is highly sensitive to outliers. Here we propose a fast and efficient robust mixture regression algorithm, called Component-wise Adaptive…

统计方法学 · 统计学 2021-04-20 Wennan Chang , Xinyu Zhou , Yong Zang , Chi Zhang , Sha Cao

In this paper we introduce a new method for detecting outliers in a set of proportions. It is based on the construction of a suitable two-way contingency table and on the application of an algorithm for the detection of outlying cells in…

统计方法学 · 统计学 2016-08-04 Flavio Mignone , Fabio Rapallo

We propose a novel Bayesian optimisation procedure for outlier detection in the Capital Asset Pricing Model. We use a parametric product partition model to robustly estimate the systematic risk of an asset. We assume that the returns follow…

应用统计 · 统计学 2011-11-18 Maria Elena De Giuli , Mario Alessandro Maggi , Claudia Tarantola

Inverse optimal transport (OT) refers to the problem of learning the cost function for OT from observed transport plan or its samples. In this paper, we derive an unconstrained convex optimization formulation of the inverse OT problem,…

机器学习 · 计算机科学 2021-07-06 Shaojun Ma , Haodong Sun , Xiaojing Ye , Hongyuan Zha , Haomin Zhou

State estimation of dynamical systems from noisy observations is a fundamental task in many applications. It is commonly addressed using the linear Kalman filter (KF), whose performance can significantly degrade in the presence of outliers…

信号处理 · 电气工程与系统科学 2024-08-27 Shunit Truzman , Guy Revach , Nir Shlezinger , Itzik Klein

This paper considers the problem of recovering signals modeled by generative models from linear measurements contaminated with sparse outliers. We propose an outlier detection approach for reconstructing the ground-truth signals modeled by…

机器学习 · 统计学 2023-10-17 Jirong Yi , Jingchao Gao , Tianming Wang , Xiaodong Wu , Weiyu Xu

Sparse estimation methods capable of tolerating outliers have been broadly investigated in the last decade. We contribute to this research considering high-dimensional regression problems contaminated by multiple mean-shift outliers which…

统计方法学 · 统计学 2025-10-21 Luca Insolia , Ana Kenney , Francesca Chiaromonte , Giovanni Felici

Outlier detection and cleaning are essential steps in data preprocessing to ensure the integrity and validity of data analyses. This paper focuses on outlier points within individual trajectories, i.e., points that deviate significantly…

数据库 · 计算机科学 2025-11-26 Mariana M Garcez Duarte , Mahmoud Sakr