English
Related papers

Related papers: Confidence ellipsoids for regression coefficients …

200 papers

Estimating linear regression using least squares and reporting robust standard errors is very common in financial economics, and indeed, much of the social sciences and elsewhere. For thick tailed predictors under heteroskedasticity this…

Methodology · Statistics 2020-08-17 Neil Shephard

This paper develops a two-part finite mixture quantile regression model for semi-continuous longitudinal data. The proposed methodology allows heterogeneity sources that influence the model for the binary response variable, to influence…

Methodology · Statistics 2021-07-19 Antonello Maruotti , Luca Merlo , Lea Petrella

We study mixture of linear regression (random coefficient) models, which capture population heterogeneity by allowing the regression coefficients to follow an unknown distribution $G^*$. In contrast to common parametric methods that fix the…

Methodology · Statistics 2025-07-01 Hansheng Jiang , Adityanand Guntuboyina

We give convergence guarantees for estimating the coefficients of a symmetric mixture of two linear regressions by expectation maximization (EM). In particular, we show that the empirical EM iterates converge to the target parameter vector…

Machine Learning · Statistics 2018-10-17 Jason M. Klusowski , Dana Yang , W. D. Brinda

This work presents a novel posterior inference method for models with intractable evidence and likelihood functions. Error-guided likelihood-free MCMC, or EG-LF-MCMC in short, has been developed for scientific applications, where a…

Machine Learning · Statistics 2021-04-27 Volodimir Begy , Erich Schikuta

For linear models with spatial errors, the empirical likelihood ratio statistics are constructed for the parameters of the models. It is shown that the limiting distributions of the empirical likelihood ratio statistics are chi-squared…

Methodology · Statistics 2018-08-28 Yongsong Qin

Nonparametric regression with random design is considered. Estimates are defined by minimzing a penalized empirical $L_2$ risk over a suitably chosen class of neural networks with one hidden layer via gradient descent. Here, the gradient…

Statistics Theory · Mathematics 2019-12-10 Alina Braun , Michael Kohler , Harro Walk

Best linear unbiased prediction is well known for its wide range of applications including small area estimation. While the theory is well established for mixed linear models and under normality of the error and mixing distributions, the…

Statistics Theory · Mathematics 2007-06-13 Soumendra N. Lahiri , Tapabrata Maiti , Myron Katzoff , Van Parsons

We suggest how to construct joint confidence distributions for several parameters and apply these ideas to an autoregressive process of general order. The implied non informative prior for the parameters, i.e. the ratio between the…

Methodology · Statistics 2025-03-11 Rolf Larsson

While substantial advances are observed in probabilistic forecasting for power system operation and electricity market applications, most approaches are still developed in a univariate framework. This prevents from informing about the…

Applications · Statistics 2017-08-10 Faranak Golestaneh , Pierre Pinson , Rasoul Azizipanah-Abarghooee , Hoay Beng Gooi

This paper introduces a first implementation of a novel likelihood-ratio-based approach for constructing confidence intervals for neural networks. Our method, called DeepLR, offers several qualitative advantages: most notably, the ability…

Machine Learning · Statistics 2023-08-07 Laurens Sluijterman , Eric Cator , Tom Heskes

We address the inference problem concerning regression coefficients in a classical linear regression model using least squares estimates. The analysis is conducted under circumstances where network dependency exists across units in the…

Methodology · Statistics 2024-04-03 Jing Lei , Kehui Chen , Haeun Moon

Latent class model (LCM), which is a finite mixture of different categorical distributions, is one of the most widely used models in statistics and machine learning fields. Because of its non-continuous nature and the flexibility in shape,…

Machine Learning · Statistics 2021-03-23 Hao Chen , Lanshan Han , Alvin Lim

In this paper we consider the problem of constructing confidence intervals for coefficients of martingale regression models (in particular, time series models) after variable selection. Although constructing confidence intervals are common…

Statistics Theory · Mathematics 2020-05-19 Ka Wai Tsang , Wei Dai

Due to their accuracies, methods based on ensembles of regression trees are a popular approach for making predictions. Some common examples include Bayesian additive regression trees, boosting and random forests. This paper focuses on…

Methodology · Statistics 2019-11-15 Suofei Wu , Jan Hannig , Thomas C. M. Lee

Logistic regression is a standard method in multivariate analysis for binary outcome data in epidemiological and clinical studies; however, the resultant odds-ratio estimates fail to provide directly interpretable effect measures. The…

Methodology · Statistics 2024-11-26 Takahiro Kitano , Hisashi Noma

We develop an empirical likelihood (EL) framework for random forests and related ensemble methods, providing a likelihood-based approach to quantify their statistical uncertainty. Exploiting the incomplete $U$-statistic structure inherent…

Machine Learning · Statistics 2025-11-19 Harold D. Chiang , Yukitoshi Matsushita , Taisuke Otsu

We consider the problem of constructing confidence intervals for nonparametric functional data analysis using empirical likelihood. In this doubly infinite-dimensional context, we demonstrate the Wilks's phenomenon and propose a…

Methodology · Statistics 2009-04-07 Heng Lian

We consider fitting a bivariate spline regression model to data using a weighted least-squares cost function, with weights that sum to one to form a discrete probability distribution. By applying the principle of maximum entropy, the weight…

Methodology · Statistics 2025-08-05 Pierluigi Amodio , Luigi Brugnano , Felice Iavernaro

This paper studies the problem of estimation from relative measurements in a graph, in which a vector indexed over the nodes has to be reconstructed from pairwise measurements of differences between its components associated to nodes…

Systems and Control · Computer Science 2018-07-27 Chiara Ravazzi , Nelson P. K. Chan , Paolo Frasca