English
Related papers

Related papers: Extensions of linear regression models based on se…

200 papers

This paper introduces a new type of regression methodology named as Convex-Area-Wise Linear Regression(CALR), which separates given datasets by disjoint convex areas and fits different linear regression models for different areas. This…

Databases · Computer Science 2024-06-11 Bohan Lyu , Jianzhong Li

We propose an approach for fitting linear regression models that splits the set of covariates into groups. The optimal split of the variables into groups and the regularized estimation of the regression coefficients are performed by…

Methodology · Statistics 2019-12-13 Anthony Christidis , Ruben Zamar , Laks V. S. Lakshmanan , Ezequiel Smucler

Logistic regression is an important statistical tool for assessing the probability of an outcome based upon some predictive variables. Standard methods can only deal with precisely known data, however many datasets have uncertainties which…

Methodology · Statistics 2022-06-09 Nicholas Gray , Scott Ferson

Linear approximations to the decision boundary of a complex model have become one of the most popular tools for interpreting predictions. In this paper, we study such linear explanations produced either post-hoc by a few recent methods or…

Machine Learning · Computer Science 2018-01-31 Maruan Al-Shedivat , Avinava Dubey , Eric P. Xing

We present a robust framework to perform linear regression with missing entries in the features. By considering an elliptical data distribution, and specifically a multivariate normal model, we are able to conditionally formulate a…

Machine Learning · Computer Science 2022-11-10 Alireza Aghasi , MohammadJavad Feizollahi , Saeed Ghadimi

We study estimation and prediction in linear models where the response and the regressor variable both take values in some Hilbert space. Our main objective is to obtain consistency of a principal components based estimator for the…

Statistics Theory · Mathematics 2014-04-17 Siegfried Hörmann , Łukasz Kidziński

Forecasting with longitudinal data has been rarely studied. Most of the available studies are for continuous response and all of them are for univariate response. In this study, we consider forecasting multivariate longitudinal binary data.…

Applications · Statistics 2014-03-13 Ozgur Asar , Ozlem Ilk

The paper proposes to analyze epidemiological data using regression models which enable subject-matter (epidemiological) interpretation of such data whether with uncorrelated or correlated predictors. To this end, response functions should…

Applications · Statistics 2020-02-20 Anatoly N. Varaksin , Vladimir G. Panov

We study the problem of regression with interval targets, where only upper and lower bounds on target values are available in the form of intervals. This problem arises when the exact target label is expensive or impossible to obtain, due…

Machine Learning · Computer Science 2025-10-27 Rattana Pukdee , Ziqi Ke , Chirag Gupta

We propose a framework combining detrended fluctuation analysis with standard regression methodology. The method is built on detrended variances and covariances and it is designed to estimate regression parameters at different scales and…

Statistical Finance · Quantitative Finance 2018-10-30 Ladislav Kristoufek

This paper develops a methodology for approximating the posterior first two moments of the posterior distribution in Bayesian inference. Partially specified probability models, which are defined only by specifying means and variances, are…

Methodology · Statistics 2009-01-27 K. Triantafyllopoulos , P. J. Harrison

Multicriteria decision analysis aims at supporting a person facing a decision problem involving conflicting criteria. We consider an additive utility model which provides robust conclusions based on preferences elicited from the decision…

Artificial Intelligence · Computer Science 2015-02-17 K. Belahcene , C. Labreuche , N. Maudet , V. Mousseau , W. Ouerdane

This paper introduces a multiscale analysis based on optimal piecewise linear approximations of time series. An optimality criterion is formulated and on its base a computationally effective algorithm is constructed for decomposition of a…

Data Analysis, Statistics and Probability · Physics 2007-05-23 I. Zaliapin , A. Gabrielov , V. Keilis-Borok

We propose a new prediction method for multivariate linear regression problems where the number of features is less than the sample size but the number of outcomes is extremely large. Many popular procedures, such as penalized regression…

Methodology · Statistics 2021-04-20 Yihe Wang , Sihai Dave Zhao

Inference methods are often formulated as variational approximations: these approximations allow easy evaluation of statistics by marginalization or linear response, but these estimates can be inconsistent. We show that by introducing…

Machine Learning · Statistics 2017-04-27 Jack Raymond , Federico Ricci-Tersenghi

It is clear that conventional statistical inference protocols need to be revised to deal correctly with the high-dimensional data that are now common. Most recent studies aimed at achieving this revision rely on powerful approximation…

Statistics Theory · Mathematics 2021-05-05 Alexander Mozeika , Mansoor Sheikh , Fabian Aguirre-Lopez , Fabrizio Antenucci , Anthony CC Coolen

We introduce an adaptive scattered data fitting scheme as extension of local least squares approximations to hierarchical spline spaces. To efficiently deal with non-trivial data configurations, the local solutions are described in terms of…

Numerical Analysis · Mathematics 2017-04-28 Cesare Bracco , Carlotta Giannelli , Alessandra Sestini

Best linear unbiased prediction is well known for its wide range of applications including small area estimation. While the theory is well established for mixed linear models and under normality of the error and mixing distributions, the…

Statistics Theory · Mathematics 2007-06-13 Soumendra N. Lahiri , Tapabrata Maiti , Myron Katzoff , Van Parsons

Transfer learning refers to the promising idea of initializing model fits based on pre-training on other data. We particularly consider regression modeling settings where parameter estimates from previous data can be used as anchoring…

Methodology · Statistics 2020-07-07 Wessel N. van Wieringen , Harald Binder

We introduce a framework for performing regression between two Hilbert spaces. This is done based on Kirszbraun's extension theorem, to the best of our knowledge, the first application of this technique to supervised learning. We analyze…

Machine Learning · Computer Science 2022-03-10 Hanan Zaichyk , Armin Biess , Aryeh Kontorovich , Yury Makarychev