English
Related papers

Related papers: Shrinkage Estimators for Beta Regression Models

200 papers

In this paper, we consider simultaneous estimation of Poisson parameters in situations where we can use side information in aggregated data. We use standardized squared error and entropy loss functions. Bayesian shrinkage estimators are…

Statistics Theory · Mathematics 2023-11-06 Yasuyuki Hamura

Re-scale boosting (RBoosting) is a variant of boosting which can essentially improve the generalization performance of boosting learning. The key feature of RBoosting lies in introducing a shrinkage degree to re-scale the ensemble estimate…

Machine Learning · Computer Science 2015-05-19 Lin Xu , Shaobo Lin , Yao Wang , Zongben Xu

This paper explores the estimation of a panel data model with cross-sectional interaction that is flexible both in its approach to specifying the network of connections between cross-sectional units, and in controlling for unobserved…

Econometrics · Economics 2021-11-23 Ayden Higgins , Federico Martellosio

This article is concerned with the Bridge Regression, which is a special family in penalized regression with penalty function $\sum_{j=1}^{p}|\beta_j|^q$ with $q>0$, in a linear model with linear restrictions. The proposed restricted bridge…

Statistics Theory · Mathematics 2021-05-06 Bahadır Yüzbaşı , Mohammad Arashi , Fikri Akdeniz

This paper studies sparse linear regression analysis with outliers in the responses. A parameter vector for modeling outliers is added to the standard linear regression model and then the sparse estimation problem for both coefficients and…

Statistics Theory · Mathematics 2015-05-21 Shota Katayama , Hironori Fujisawa

For finite samples with binary outcomes penalized logistic regression such as ridge logistic regression (RR) has the potential of achieving smaller mean squared errors (MSE) of coefficients and predictions than maximum likelihood…

Methodology · Statistics 2021-01-28 Hana Šinkovec , Georg Heinze , Rok Blagus , Angelika Geroldinger

We study ridge estimation of the precision matrix in the high-dimensional setting where the number of variables is large relative to the sample size. We first review two archetypal ridge estimators and note that their utilized penalties do…

Methodology · Statistics 2016-06-17 Wessel N. van Wieringen , Carel F. W. Peeters

Constrained approaches to maximum likelihood estimation in the context of finite mixtures of normals have been presented in the literature. A fully data-dependent constrained method for maximum likelihood estimation of clusterwise linear…

Methodology · Statistics 2016-11-11 Roberto Di Mari , Roberto Rocci , Stefano Antonio Gattone

Shrinkage estimates of small domain parameters typically utilize a combination of a noisy "direct" estimate that only uses data from a specific small domain and a more stable regression estimate. When the regression model is misspecified,…

Methodology · Statistics 2022-01-11 Nicholas C. Henderson , Ravi Varadhan , Thomas A. Louis

Rescaled spike and slab models are a new Bayesian variable selection method for linear regression models. In high dimensional orthogonal settings such models have been shown to possess optimal model selection properties. We review…

Applications · Statistics 2008-12-18 Hemant Ishwaran , Ariadni Papana

In this paper, we consider the multicollinearity problem in the gamma regression model when model parameters are linearly restricted. The linear restrictions are available from prior information to ensure the validity of scientific theories…

Methodology · Statistics 2023-03-10 Solmaz Seifollahi , Hossein Bevrani , Kaniav Kamary

A frequent challenge encountered with ecological data is how to interpret, analyze, or model data having a high proportion of zeros. Much attention has been given to zero-inflated count data, whereas models for non-negative continuous data…

Methodology · Statistics 2022-05-23 Becky Tang , Henry A Frye , Alan E. Gelfand , John A Silander

To achieve a greater general flexibility for modeling heavy-tailed bounded responses, a beta scale mixture model is proposed. Each member of the family is obtained by multiplying the scale parameter of the conditional beta distribution by a…

Methodology · Statistics 2026-02-11 Arno Otto , Andriëtte Bekker , Johan Ferreira , Lebogang Rathebe

Sparse regression is frequently employed in diverse scientific settings as a feature selection method. A pervasive aspect of scientific data that hampers both feature selection and estimation is the presence of strong correlations between…

Methodology · Statistics 2021-03-25 Ankit Kumar , Sharmodeep Bhattacharyya , Kristofer Bouchard

We present a formula for the shrinkage factors of the Partial Least Squares regression estimator and deduce some of their properties, in particular the known fact that some of the factors are >1. We investigate the effect of shrinkage…

Statistics Theory · Mathematics 2007-06-13 Nicole Kraemer

Sparse linear regression is a vast field and there are many different algorithms available to build models. Two new papers published in Statistical Science study the comparative performance of several sparse regression methodologies,…

Machine Learning · Computer Science 2021-02-10 Owais Sarwar , Benjamin Sauk , Nikolaos V. Sahinidis

The estimation of the mean matrix of the multivariate normal distribution is addressed in the high dimensional setting. Efron-Morris-type linear shrinkage estimators based on ridge estimators for the precision matrix instead of the…

Statistics Theory · Mathematics 2020-07-07 Ryota Yuasa , Tatsuya Kubokawa

Beta coefficients for linear regression models represent the ideal form of an interpretable feature effect. However, for non-linear models and especially generalized linear models, the estimated coefficients cannot be interpreted as a…

Machine Learning · Computer Science 2022-01-24 Christian A. Scholbeck , Giuseppe Casalicchio , Christoph Molnar , Bernd Bischl , Christian Heumann

This paper introduces a novel Bayesian approach for variable selection in high-dimensional and potentially sparse regression settings. Our method replaces the indicator variables in the traditional spike and slab prior with continuous,…

Methodology · Statistics 2025-02-07 Linduni M. Rodrigo , Robert Kohn , Hadi M. Afshar , Sally Cripps

In "Li, L. and Yin, X. (2008). Sliced Inverse Regression with Regularizations. Biometrics, 64(1):124--131" a ridge SIR estimator is introduced as the solution of a minimization problem and computed thanks to an alternating least-squares…

Statistics Theory · Mathematics 2011-04-04 Caroline Bernard-Michel , Laurent Gardes , Stéphane Girard