English
Related papers

Related papers: L1-Optimal Splines for Outlier Rejection

200 papers

We derive a divergence formula for a group of regularization methods with an L2 constraint. The formula is useful for regularization parameter selection, because it provides an unbiased estimate for the number of degrees of freedom. We…

Other Statistics · Statistics 2012-03-19 Yixin Fang , Yuanjia Wang , Xin Huang

We propose an open loop methodology based on sample statistics to solve chance constrained stochastic optimal control problems with probabilistic safety guarantees for linear systems where the additive Gaussian noise has unknown mean and…

Systems and Control · Electrical Eng. & Systems 2023-03-24 Shawn Priore , Meeko Oishi

Bayesian methods have proven themselves to be successful across a wide range of scientific problems and have many well-documented advantages over competing methods. However, these methods run into difficulties for two major and prevalent…

Methodology · Statistics 2022-07-29 John R. Lewis , Steven N. MacEachern , Yoonkyung Lee

In the (special) smoothing spline problem one considers a variational problem with a quadratic data fidelity penalty and Laplacian regularisation. Higher order regularity can be obtained via replacing the Laplacian regulariser with a…

Machine Learning · Statistics 2022-09-07 Nicolás García Trillos , Ryan Murray , Matthew Thorpe

In areas such as kernel smoothing and non-parametric regression there is emphasis on smooth interpolation and smooth statistical models. Splines are known to have optimal smoothness properties in one and higher dimensions. It is shown, with…

Computation · Statistics 2008-09-29 Ron A. Bates , Hugo Maruri-Aguilar , Henry P. Wynn

A skipped correlation has the advantage of dealing with outliers in a manner that takes into account the overall structure of the data cloud. For p-variate data, $p \ge 2$, there is an extant method for testing the hypothesis of a zero…

Computation · Statistics 2018-07-16 Rand Wilcox , Guillaume Rousselet , Cyril Pernet

A set of introductory notes on the subject of data classification using a linear classifier and least-squares cost function, and the negative effect of the presence of outliers on the decision boundary of the linear discriminant. We also…

Data Analysis, Statistics and Probability · Physics 2022-01-10 Babatunde M. Ayeni

In this paper, we propose a novel conceptual framework to detect outliers using optimal transport with a concave cost function. Conventional outlier detection approaches typically use a two-stage procedure: first, outliers are detected and…

Machine Learning · Statistics 2024-07-12 Jose Blanchet , Jiajin Li , Markus Pelger , Greg Zanotti

As one of the most popular linear subspace learning methods, the Linear Discriminant Analysis (LDA) method has been widely studied in machine learning community and applied to many scientific applications. Traditional LDA minimizes the…

Machine Learning · Computer Science 2019-07-02 Feiping Nie , Hua Wang , Zheng Wang , Heng Huang

Conformal prediction is a flexible framework for calibrating machine learning predictions, providing distribution-free statistical guarantees. In outlier detection, this calibration relies on a reference set of labeled inlier data to…

Machine Learning · Statistics 2025-06-17 Meshi Bashari , Matteo Sesia , Yaniv Romano

Classical linear discriminant analysis (LDA) is based on squared Frobenious norm and hence is sensitive to outliers and noise. To improve the robustness of LDA, in this paper, we introduce capped l_{2,1}-norm of a matrix, which employs…

Machine Learning · Statistics 2020-11-05 Jiakou Liu , Xiong Xiong , Pei-Wei Ren , Da Zhao , Chun-Na Li , Yuan-Hai Shao

This paper focuses on efficient computational approaches to compute approximate solutions of a linear inverse problem that is contaminated with mixed Poisson--Gaussian noise, and when there are additional outliers in the measured data. The…

Numerical Analysis · Mathematics 2018-01-22 Marie Kubínová , James G. Nagy

A new technique for the detection of outliers in contingency tables is introduced. Outliers thereby are unexpected cell counts with respect to classical loglinear Poisson models. Subsets of cell counts called minimal patterns are defined,…

Computation · Statistics 2012-11-15 Sonja Kuhnt , Fabio Rapallo , André Rehage

Unsupervised outlier detection constitutes a crucial phase within data analysis and remains a dynamic realm of research. A good outlier detection algorithm should be computationally efficient, robust to tuning parameter selection, and…

Machine Learning · Statistics 2024-09-23 Sheikh Arafat , Na Sun , Maria L. Weese , Waldyn G. Martinez

It is well-known in practice, that L^1 data fitting leads to improved robustness compared to standard L^2 data fitting. However, it is unclear whether resulting algorithms will perform as well in case of regular data without outliers. In…

Numerical Analysis · Mathematics 2026-01-16 Kristina Bätz , Frank Werner

This paper focuses on optimal control problem for a class of discrete-time nonlinear systems. In practical applications, computation time is a crucial consideration when solving nonlinear optimal control problems, especially under real-time…

Optimization and Control · Mathematics 2025-04-01 Chuanzhi Lv , Xunmin Yin , Hongdan Li , Huanshui Zhang

We investigate symmetry reduction of optimal control problems for left-invariant control systems on Lie groups, with partial symmetry breaking cost functions. Our approach emphasizes the role of variational principles and considers a…

Optimization and Control · Mathematics 2017-01-25 Anthony Bloch , Leonardo Colombo , Rohit Gupta , Tomoki Ohsawa

Large outliers break down linear and nonlinear regression models. Robust regression methods allow one to filter out the outliers when building a model. By replacing the traditional least squares criterion with the least trimmed squares…

Optimization and Control · Mathematics 2012-06-07 Gleb Beliakov , Andrei Kelarev , John Yearwood

Linear inverse problems are ubiquitous. Often the measurements do not follow a Gaussian distribution. Additionally, a model matrix with a large condition number can complicate the problem further by making it ill-posed. In this case, the…

In this paper, we propose an outlier-robust regularized kernel-based method for linear system identification. The unknown impulse response is modeled as a zero-mean Gaussian process whose covariance (kernel) is given by the recently…

Machine Learning · Statistics 2013-12-25 Giulio Bottegal , Aleksandr Y. Aravkin , Hakan Hjalmarsson , Gianluigi Pillonetto