English
Related papers

Related papers: Improving predictions by nonlinear regression mode…

200 papers

For supervised classification problems, this paper considers estimating the query's label probability through local regression using observed covariates. Well-known nonparametric kernel smoother and $k$-nearest neighbor ($k$-NN) estimator,…

Machine Learning · Statistics 2022-07-25 Ruixing Cao , Akifumi Okuno , Kei Nakagawa , Hidetoshi Shimodaira

Spatial perception is the backbone of many robotics applications, and spans a broad range of research problems, including localization and mapping, point cloud alignment, and relative pose estimation from camera images. Robust spatial…

Machine Learning · Statistics 2019-07-31 Vasileios Tzoumas , Pasquale Antonante , Luca Carlone

Internet traffic in the real world is susceptible to various external and internal factors which may abruptly change the normal traffic flow. Those unexpected changes are considered outliers in traffic. However, deep sequence models have…

Machine Learning · Computer Science 2022-05-05 Sajal Saha , Anwar Haque , Greg Sidebottom

Nonlinear estimation in robotics and vision is typically plagued with outliers due to wrong data association, or to incorrect detections from signal processing and machine learning methods. This paper introduces two unifying formulations…

Computer Vision and Pattern Recognition · Computer Science 2021-07-05 Pasquale Antonante , Vasileios Tzoumas , Heng Yang , Luca Carlone

We consider the frequency estimation of periodic signals using noisy time-of-arrival (TOA) information with missing (sparse) data contaminated with outliers. We tackle the problem from a mathematical optimization standpoint, formulating it…

Optimization and Control · Mathematics 2024-09-04 Romain Puech , Vincent Gouldieff

Successful detection of Out-of-Distribution (OoD) data is becoming increasingly important to ensure safe deployment of neural networks. One of the main challenges in OoD detection is that neural networks output overconfident predictions on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Sangha Park , Jisoo Mok , Dahuin Jung , Saehyung Lee , Sungroh Yoon

Channel state information (CSI) rapidly becomes outdated in high mobility scenarios, degrading the performance of wireless communication systems. In these cases, time series prediction techniques can be applied to combat the effects of…

Signal Processing · Electrical Eng. & Systems 2021-03-11 Joseph Kibugi , Lucas N. Ribeiro , Martin Haardt

It is important to detect anomalous inputs when deploying machine learning systems. The use of larger and more complex inputs in deep learning magnifies the difficulty of distinguishing between anomalous and in-distribution examples. At the…

Machine Learning · Computer Science 2019-01-30 Dan Hendrycks , Mantas Mazeika , Thomas Dietterich

Outlier detection is a significant area in data mining. It can be either used to pre-process the data prior to an analysis or post the processing phase (before visualization) depending on the effectiveness of the outlier and its importance.…

Machine Learning · Statistics 2021-06-22 Jacob John

Machine Learning explainability techniques have been proposed as a means of `explaining' or interrogating a model in order to understand why a particular decision or prediction has been made. Such an ability is especially important at a…

Machine Learning · Statistics 2022-02-28 Matthew J. Vowels

Across scientific domains, a fundamental challenge is to characterize and compute the mappings from underlying physical processes to observed signals and measurements. While nonlinear neural networks have achieved considerable success, they…

Machine Learning · Computer Science 2025-08-11 Alexander DeLise , Kyle Loh , Krish Patel , Meredith Teague , Andrea Arnold , Matthias Chung

We benchmark the robustness of maximum likelihood based uncertainty estimation methods to outliers in training data for regression tasks. Outliers or noisy labels in training data results in degraded performances as well as incorrect…

Machine Learning · Computer Science 2022-02-09 Deebul S. Nair , Nico Hochgeschwender , Miguel A. Olivares-Mendez

While reinforcement learning (RL) algorithms have been successfully applied across numerous sequential decision-making problems, their generalization to unforeseen testing environments remains a significant concern. In this paper, we study…

Machine Learning · Computer Science 2024-04-11 Linas Nasvytis , Kai Sandbrink , Jakob Foerster , Tim Franzmeyer , Christian Schroeder de Witt

Reservoir computing is a very promising approach for the prediction of complex nonlinear dynamical systems. Besides capturing the exact short-term trajectories of nonlinear systems, it has also proved to reproduce its characteristic…

Data Analysis, Statistics and Probability · Physics 2020-06-19 Alexander Haluszczynski , Jonas Aumeier , Joschka Herteux , Christoph Räth

This paper fortifies the recently introduced hierarchical-optimization recursive least squares (HO-RLS) against outliers which contaminate infrequently linear-regression models. Outliers are modeled as nuisance variables and are estimated…

Machine Learning · Computer Science 2019-10-15 Konstantinos Slavakis , Sinjini Banerjee

Outlying observations, which significantly deviate from other measurements, may distort the conclusions of data analysis. Therefore, identifying outliers is one of the important problems that should be solved to obtain reliable results.…

Computation · Statistics 2014-05-01 Soo-Heang Eo , Seung-Mo Hong , HyungJun Cho

AfterLearnER (After Learning Evolutionary Retrofitting) consists in applying evolutionary optimization to refine fully trained machine learning models by optimizing a set of carefully chosen parameters or hyperparameters of the model, with…

Machine Learning · Computer Science 2025-11-17 Mathurin Videau , Mariia Zameshina , Alessandro Leite , Laurent Najman , Marc Schoenauer , Olivier Teytaud

The accuracy of machine learning interatomic potentials suffers from reference data that contains numerical noise. Often originating from unconverged or inconsistent electronic-structure calculations, this noise is challenging to identify.…

Machine Learning · Statistics 2026-02-10 Terry C. W. Lam , Niamh O'Neill , Christoph Schran , Lars L. Schaaf

Invariant Causal Prediction (Peters et al., 2016) is a technique for out-of-distribution generalization which assumes that some aspects of the data distribution vary across the training set but that the underlying causal mechanisms remain…

Machine Learning · Computer Science 2021-03-30 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

This paper considers the problem of inference in a linear regression model with outliers where the number of outliers can grow with sample size but their proportion goes to 0. We apply the square-root lasso estimator penalizing the l1-norm…

Statistics Theory · Mathematics 2019-06-05 Jad Beyhum