English
Related papers

Related papers: Improving predictions by nonlinear regression mode…

200 papers

Dimensionality reduction is an effective method for learning high-dimensional data, which can provide better understanding of decision boundaries in human-readable low-dimensional subspace. Linear methods, such as principal component…

Machine Learning · Computer Science 2020-07-09 Koji Maruhashi , Heewon Park , Rui Yamaguchi , Satoru Miyano

Impulsed noise outliers are data points that differs significantly from other observations.They are generally removed from the data set through local regression or Kalman filter algorithm.However, these methods, or their generalizations,…

Methodology · Statistics 2022-08-02 Bertrand Cloez , Bénédicte Fontez , Eliel González García , Isabelle Sanchez

Image outlier detection (OD) is an essential tool to ensure the quality of images used in computer vision tasks. Existing algorithms often involve training a model to represent the inlier distribution, and outliers are determined by some…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Chen-Han Tsai , Yu-Shao Peng

This study deals with the problem of outliers in ordinal response model, which is a regression on ordered categorical data as the response variable. ``Outlier" means that the combination of ordered categorical data and its covariates is…

Methodology · Statistics 2022-12-29 Tomotaka Momozaki , Tomoyuki Nakagawa

Robustness to outliers is often a desirable property of statistical estimators. Indeed many well known estimators offer very good optimal performance in theory but are unusable in applied contexts because of their sensitivity to outliers.…

Statistics Theory · Mathematics 2016-12-01 Christophe Culan , Claude Adnet

Classifiers used in the wild, in particular for safety-critical systems, should not only have good generalization properties but also should know when they don't know, in particular make low confidence predictions far away from the training…

Machine Learning · Computer Science 2019-05-08 Matthias Hein , Maksym Andriushchenko , Julian Bitterwolf

National statistical institutes in many countries are now mandated to produce reliable statistics for important variables such as population, income, unemployment, health outcomes, etc. for small areas, defined by geography and/or…

Methodology · Statistics 2018-10-29 Adrijo Chakraborty , Gauri Sankar Datta , Abhyuday Mandal

In statistics and machine learning, the traditional meaning of the terms `outlier' and `anomaly' is a case in the dataset that behaves differently from the bulk of the data. This raises suspicion that it may belong to a different…

Methodology · Statistics 2026-04-17 Mia Hubert , Jakob Raymaekers , Peter J. Rousseeuw

Mendelian Randomisation (MR) uses genetic variants as instrumental variables to infer causal effects of exposures on an outcome. One key assumption of MR is that the genetic variants used as instrumental variables are independent of the…

Methodology · Statistics 2025-02-21 Maximilian M Mandl , Anne-Laure Boulesteix , Stephen Burgess , Verena Zuber

Deep convolutional models often produce inadequate predictions for inputs foreign to the training distribution. Consequently, the problem of detecting outlier images has recently been receiving a lot of attention. Unlike most previous work,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Petra Bevandić , Ivan Krešo , Marin Oršić , Siniša Šegvić

In a linear regression model with random design, we consider a family of candidate models from which we want to select a `good' model for prediction out-of-sample. We fit the models using block shrinkage estimators, and we focus on the…

Statistics Theory · Mathematics 2018-09-13 Hannes Leeb , Nina Senitschnig

Firms typically cannot observe key consumer actions: whether customers buy from a competitor, choose not to buy, or even fully consider the firm's offer. This missing outside-option information makes market-size and preference estimation…

Machine Learning · Computer Science 2026-02-16 Jiangkai Xiong , Kalyan Talluri , Hanzhao Wang

In a low-dimensional linear regression setup, considering linear transformations/combinations of predictors does not alter predictions. However, when the forecasting technology either uses shrinkage or is nonlinear, it does. This is…

We address the problem of prediction for extreme observations by proposing an extremal linear prediction method. We construct an inner product space of nonnegative random variables derived from transformed-linear combinations of independent…

Methodology · Statistics 2026-01-21 Jeongjin Lee , Daniel Cooley

Many model-based reinforcement learning (RL) methods follow a similar template: fit a model to previously observed data, and then use data from that model for RL or planning. However, models that achieve better training performance (e.g.,…

Machine Learning · Computer Science 2023-02-21 Benjamin Eysenbach , Alexander Khazatsky , Sergey Levine , Ruslan Salakhutdinov

This paper adds to the growing literature of reinforcement learning (RL) for healthcare by proposing a novel paradigm: augmenting any predictor with Rule-based RL Layer (RRLL) that corrects the model's physiologically impossible…

Machine Learning · Computer Science 2025-02-03 Lingwei Zhu , Zheng Chen , Yukie Nagai , Jimeng Sun

The unsupervised outlier detection (UOD) problem refers to a task to identify inliers given training data which contain outliers as well as inliers, without any labeled information about inliers and outliers. It has been widely recognized…

Machine Learning · Statistics 2024-07-17 Dongha Kim , Jaesung Hwang , Jongjin Lee , Kunwoong Kim , Yongdai Kim

Using unlabeled data to regularize the machine learning models has demonstrated promise for improving safety and reliability in detecting out-of-distribution (OOD) data. Harnessing the power of unlabeled in-the-wild data is non-trivial due…

Machine Learning · Computer Science 2024-02-07 Xuefeng Du , Zhen Fang , Ilias Diakonikolas , Yixuan Li

Nowadays, Deep Learning (DL) methods often overcome the limitations of traditional signal processing approaches. Nevertheless, DL methods are barely applied in real-life applications. This is mainly due to limited robustness and…

Machine Learning · Computer Science 2022-10-27 Julius Ott , Lorenzo Servadei , Gianfranco Mauro , Thomas Stadelmayer , Avik Santra , Robert Wille

Revenue management strongly relies on accurate forecasts. Thus, when extraordinary events cause outlier demand, revenue management systems need to recognise this and adapt both forecast and controls. Many passenger transport service…

Methodology · Statistics 2021-02-10 Nicola Rennie , Catherine Cleophas , Adam M. Sykulski , Florian Dost