English
Related papers

Related papers: Comparing methods addressing multi-collinearity wh…

200 papers

In particle-based algorithms, the effect of binary collisions is commonly described in a statistical way, using Monte Carlo techniques. It is shown that, in the relativistic regime, stringent constraints should be considered on the sampling…

Plasma Physics · Physics 2009-11-13 F. Peano , M. Marti , L. O. Silva , G. Coppa

Comparison data arises in many important contexts, e.g. shopping, web clicks, or sports competitions. Typically we are given a dataset of comparisons and wish to train a model to make predictions about the outcome of unseen comparisons. In…

Machine Learning · Statistics 2018-07-25 Stephen Ragain , Alexander Peysakhovich , Johan Ugander

The research area of algorithms with predictions has seen recent success showing how to incorporate machine learning into algorithm design to improve performance when the predictions are correct, while retaining worst-case guarantees when…

Machine Learning · Computer Science 2022-12-06 Michael Dinitz , Sungjin Im , Thomas Lavastida , Benjamin Moseley , Sergei Vassilvitskii

Clinical trials often evaluate multiple outcome variables to form a comprehensive picture of the effects of a new treatment. The resulting multidimensional insight contributes to clinically relevant and efficient decision-making about…

Methodology · Statistics 2023-08-14 X. M. Kavelaars , J. Mulder , M. C. Kaptein

Challenging research in various fields has driven a wide range of methodological advances in variable selection for regression models with high-dimensional predictors. In comparison, selection of nonlinear functions in models with additive…

Methodology · Statistics 2013-03-05 Fabian Scheipl , Thomas Kneib , Ludwig Fahrmeir

In many applied fields incomplete covariate vectors are commonly encountered. It is well known that this can be problematic when making inference on model parameters, but its impact on prediction performance is less understood. We develop a…

Methodology · Statistics 2020-07-14 Garritt L. Page , Fernando A. Quintana , Peter Müller

Recent attempts to achieve fairness in predictive models focus on the balance between fairness and accuracy. In sensitive applications such as healthcare or criminal justice, this trade-off is often undesirable as any increase in prediction…

Machine Learning · Statistics 2018-12-12 Irene Chen , Fredrik D. Johansson , David Sontag

Beta regression model is useful in the analysis of bounded continuous outcomes such as proportions. It is well known that for any regression model, the presence of multicollinearity leads to poor performance of the maximum likelihood…

Methodology · Statistics 2021-11-30 Ejaz Ahmed , Reza Arabi Belaghi , Yasin Asar , Abdulkhadir Hussein

Horizon length and model accuracy are defining factors when designing a Model Predictive Controller. While long horizons and detailed models have a positive effect on control performance, computational complexity increases. As predictions…

Systems and Control · Electrical Eng. & Systems 2021-08-19 Tim Brüdigam , Daniel Prader , Dirk Wollherr , Marion Leibold

Mathematical models of the real world are simplified representations of complex systems. A caveat to using mathematical models is that predicted causal effects and conditional independences may not be robust under model extensions, limiting…

Methodology · Statistics 2022-08-30 Tineke Blom , Joris M. Mooij

The literature shows the possible existence of a problem called collinearity in both Nelson-Siegel and Nelson-Siegel-Svensson models due to the relationship between the slope and curvature components. The presence of this problem and the…

Applications · Statistics 2024-06-11 Ainara Rodríguez-Sánchez

In this paper, we apply shrinkage strategies to estimate regression coefficients efficiently for the high-dimensional multiple regression model, where the number of samples is smaller than the number of predictors. We assume in the sparse…

Methodology · Statistics 2017-04-19 B. Yuzbasi , M. Arashi , S. E. Ahmed

Successful predictions are among the most compelling validations of any model. Extracting falsifiable predictions from nonlinear multiparameter models is complicated by the fact that such models are commonly sloppy, possessing sensitivities…

Quantitative Methods · Quantitative Biology 2007-11-24 Ryan N. Gutenkunst , Fergal P. Casey , Joshua J. Waterfall , Christopher R. Myers , James P. Sethna

Should prediction models always deliver a prediction? In the pursuit of maximum predictive performance, critical considerations of reliability and fairness are often overshadowed, particularly when it comes to the role of uncertainty.…

Machine Learning · Computer Science 2024-10-29 Anna Sokol , Nuno Moniz , Nitesh Chawla

Functional quadratic regression models postulate a polynomial relationship between a scalar response rather than a linear one. As in functional linear regression, vertical and specially high-leverage outliers may affect the classical…

Methodology · Statistics 2023-05-30 Graciela Boente , Daniela Parada

Prediction models need reliable predictive performance as they inform clinical decisions, aiding in diagnosis, prognosis, and treatment planning. The predictive performance of these models is typically assessed through discrimination and…

Methodology · Statistics 2025-04-25 Wouter A. C. van Amsterdam

Dimensionality reduction is an effective method for learning high-dimensional data, which can provide better understanding of decision boundaries in human-readable low-dimensional subspace. Linear methods, such as principal component…

Machine Learning · Computer Science 2020-07-09 Koji Maruhashi , Heewon Park , Rui Yamaguchi , Satoru Miyano

High-dimensional data pose challenges in statistical learning and modeling. Sometimes the predictors can be naturally grouped where pursuing the between-group sparsity is desired. Collinearity may occur in real-world high-dimensional…

Machine Learning · Statistics 2011-11-11 Yiyuan She

Model multiplicity refers to the existence of multiple machine learning models that describe the data equally well but may produce different predictions on individual samples. In medicine, these models can admit conflicting predictions for…

In the last two decades, considerable research has been devoted to a phenomenon known as spatial confounding. Spatial confounding is thought to occur when there is multicollinearity between a covariate and the random effect in a spatial…

Methodology · Statistics 2024-06-25 Kori Khan , Candace Berrett