English
Related papers

Related papers: A Robust t-process Regression Model with Independe…

200 papers

Gaussian Process Regression (GPR) is a popular regression method, which unlike most Machine Learning techniques, provides estimates of uncertainty for its predictions. These uncertainty estimates however, are based on the assumption that…

Machine Learning · Computer Science 2024-08-29 Harris Papadopoulos

Heavy-tailed distributions are frequently used to enhance the robustness of regression and classification methods to outliers in output space. Often, however, we are confronted with "outliers" in input space, which are isolated observations…

Machine Learning · Statistics 2010-06-24 Fabian L. Wauthier , Michael I. Jordan

Principal component regression uses principal components as regressors. It is particularly useful in prediction settings with high-dimensional covariates. The existing literature treating of Bayesian approaches is relatively sparse. We…

Methodology · Statistics 2020-01-28 Philippe Gagnon , Mylène Bédard , Alain Desgagné

Cellwise outliers are likely to occur together with casewise outliers in modern data sets with relatively large dimension. Recent work has shown that traditional robust regression methods may fail for data sets in this paradigm. The…

Statistics Theory · Mathematics 2016-12-28 Andy Leung , Hongyang Zhang , Ruben H. Zamar

We consider outlier-robust and sparse estimation of linear regression coefficients, when the covariates and the noises are contaminated by adversarial outliers and noises are sampled from a heavy-tailed distribution. Our results present…

Statistics Theory · Mathematics 2024-05-27 Takeyuki Sasai , Hironori Fujisawa

Gaussian Process (GP) regression is a flexible modeling technique used to predict outputs and to capture uncertainty in the predictions. However, the GP regression process becomes computationally intensive when the training spatial dataset…

Computation · Statistics 2024-09-19 Juliette Mukangango , Amanda Muyskens , Benjamin W. Priest

We introduce a novel adaptive Gaussian Process Regression (GPR) methodology for efficient construction of surrogate models for Bayesian inverse problems with expensive forward model evaluations. An adaptive design strategy focuses on…

Numerical Analysis · Mathematics 2024-05-01 Paolo Villani , Jörg Unger , Martin Weiser

This tutorial aims to provide an intuitive introduction to Gaussian process regression (GPR). GPR models have been widely used in machine learning applications due to their representation flexibility and inherent capability to quantify…

Machine Learning · Statistics 2024-01-30 Jie Wang

Understanding the dynamic behavior of tires and their interactions with road plays an important role in designing integrated vehicle control strategies. Accordingly, having access to reliable information about the tire-road interactions…

Signal Processing · Electrical Eng. & Systems 2020-09-29 Bruno Henrique Groenner Barbosa , Nan Xu , Hassan Askari , Amir Khajepour

Big data can easily be contaminated by outliers or contain variables with heavy-tailed distributions, which makes many conventional methods inadequate. To address this challenge, we propose the adaptive Huber regression for robust…

Statistics Theory · Mathematics 2018-10-11 Qiang Sun , Wenxin Zhou , Jianqing Fan

In this paper, we address the problem of how to robustly train a ConvNet for regression, or deep robust regression. Traditionally, deep regression employs the L2 loss function, known to be sensitive to outliers, i.e. samples that either lie…

Computer Vision and Pattern Recognition · Computer Science 2018-08-29 Stéphane Lathuilière , Pablo Mesejo , Xavier Alameda-Pineda , Radu Horaud

Generalized linear models (GLMs) form one of the most popular classes of models in statistics. The gamma variant is used, for instance, in actuarial science for the modelling of claim amounts in insurance. A flaw of GLMs is that they are…

Methodology · Statistics 2024-02-12 Philippe Gagnon , Yuxi Wang

Robust estimation and variable selection procedure are developed for the extended t-process regression model with functional data. Statistical properties such as consistency of estimators and predictions are obtained. Numerical studies show…

Applications · Statistics 2018-12-20 Zhanfeng Wang , Kai Li , Jian Qing Shi

Gaussian Process Regression (GPR) is a Bayesian method for inferring profiles based on input data. The technique is increasing in popularity in the fusion community due to its many advantages over traditional fitting techniques including…

Methodology · Statistics 2022-09-07 Jarrod Leddy , Sandeep Madireddy , Eric Howell , Scott Kruger

Functional linear regression is a widely used approach to model functional responses with respect to functional inputs. However, classical functional linear regression models can be severely affected by outliers. We therefore introduce a…

Methodology · Statistics 2019-09-02 Harjit Hullait , David S. Leslie , Nicos G. Pavlidis , Steve King

Forecasting multivariate time series is a computationally intensive task challenged by extreme or redundant samples. Recent resampling methods aim to increase training efficiency by reweighting samples based on their running losses.…

Machine Learning · Computer Science 2024-06-21 Jiang You , Arben Cela , René Natowicz , Jacob Ouanounou , Patrick Siarry

We introduce a new regression framework, Gaussian process regression networks (GPRN), which combines the structural properties of Bayesian neural networks with the non-parametric flexibility of Gaussian processes. This model accommodates…

Machine Learning · Statistics 2011-10-21 Andrew Gordon Wilson , David A. Knowles , Zoubin Ghahramani

A large body of work in the statistics and computer science communities dating back to Huber (Huber, 1960) has led to statistically and computationally efficient outlier-robust estimators. Two particular outlier models have received…

Statistics Theory · Mathematics 2024-11-26 Yeshwanth Cherapanamjeri , Daniel Lee

This paper proposes an adaptive penalized weighted mean regression for outlier detection of high-dimensional data. In comparison to existing approaches based on the mean shift model, the proposed estimators demonstrate robustness against…

Statistics Theory · Mathematics 2023-06-27 Jiaqi Li , Linglong Kong , Bei Jiang , Wei Tu

Within the past two decades, Gaussian process regression has been increasingly used for modeling dynamical systems due to some beneficial properties such as the bias variance trade-off and the strong connection to Bayesian mathematics. As…

Systems and Control · Electrical Eng. & Systems 2021-02-11 Thomas Beckers