English
Related papers

Related papers: Mixture Quantiles Estimated by Constrained Linear …

200 papers

We investigate different methods for regularizing quantile regression when predicting either a subset of quantiles or the full inverse CDF. We show that minimizing an expected pinball loss over a continuous distribution of quantiles is a…

Machine Learning · Statistics 2021-02-11 Taman Narayan , Serena Wang , Kevin Canini , Maya Gupta

Reduced-rank regression is a dimensionality reduction method with many applications. The asymptotic theory for reduced rank estimators of parameter matrices in multivariate linear models has been studied extensively. In contrast, few…

Statistics Theory · Mathematics 2017-10-13 Efstathia Bura , Sabrina Duarte , Liliana Forzani , Ezequiel Smucler , Mariela Sued

Censored quantile regression (CQR) has become a valuable tool to study the heterogeneous association between a possibly censored outcome and a set of covariates, yet computation and statistical inference for CQR have remained a challenge…

Statistics Theory · Mathematics 2022-10-25 Xuming He , Xiaoou Pan , Kean Ming Tan , Wen-Xin Zhou

Motivated by the prevalence of environments in which data is abundant while resources for storage and/or transmission might be scarce, we study linear regression when predictors, their squares, and responses are subject to single-bit…

Statistics Theory · Mathematics 2026-04-01 Daniel Hill , Martin Slawski

Quantile regression is the task of estimating a specified percentile response, such as the median, from a collection of known covariates. We study quantile regression with rectified linear unit (ReLU) neural networks as the chosen model…

Statistics Theory · Mathematics 2020-12-21 Oscar Hernan Madrid Padilla , Wesley Tansey , Yanzhen Chen

We construct a family of estimators for a regression function based on a sample following a qdistribution. Our approach is nonparametric, using kernel methods built from operations that leverage the properties of q-calculus. Furthermore,…

Statistics Theory · Mathematics 2025-03-11 Emmanuel De Dieu Nkou , Fridolin Melong

We consider a semiparametric generalized linear model and study estimation of both marginal and quantile effects in this model. We propose an approximate maximum likelihood estimator, and rigorously establish the consistency, the asymptotic…

Methodology · Statistics 2022-04-06 Seong-ho Lee , Yanyuan Ma , Elvezio Ronchetti

A robust estimator for a wide family of mixtures of linear regression is presented. Robustness is based on the joint adoption of the Cluster Weighted Model and of an estimator based on trimming and restrictions. The selected model provides…

Methodology · Statistics 2015-02-05 L. A. Garcia-Escudero , A. Gordaliza , F. Greselin , S. Ingrassia , A. Mayo-Iscar

We propose to smooth the entire objective function, rather than only the check function, in a linear quantile regression context. Not only does the resulting smoothed quantile regression estimator yield a lower mean squared error and a more…

Econometrics · Economics 2019-08-16 Marcelo Fernandes , Emmanuel Guerre , Eduardo Horta

This paper introduces a new framework for multivariate quantile regression based on the multivariate distribution function, termed multivariate quantile regression (MQR). In contrast to existing approaches--such as directional quantiles,…

Econometrics · Economics 2026-01-01 Antonio F. Galvao , Gabriel Montes-Rojas

Constructing valid prediction intervals rather than point estimates is a well-established approach for uncertainty quantification in the regression setting. Models equipped with this capacity output an interval of values in which the ground…

Machine Learning · Statistics 2025-02-07 Thomas Pouplin , Alan Jeffares , Nabeel Seedat , Mihaela van der Schaar

We observe a $n$-sample, the distribution of which is assumed to belong, or at least to be close enough, to a given mixture model. We propose an estimator of this distribution that belongs to our model and possesses some robustness…

Statistics Theory · Mathematics 2025-02-06 Alexandre Lecestre

As a competitive alternative to least squares regression, quantile regression is popular in analyzing heterogenous data. For quantile regression model specified for one single quantile level $\tau$, major difficulties of semiparametric…

Methodology · Statistics 2017-05-29 Kani Chen , Yuanyuan Lin , Zhanfeng Wang , Zhiliang Ying

A novel approach to quantile estimation in multivariate linear regression models with change-points is proposed: the change-point detection and the model estimation are both performed automatically, by adopting either the quantile fused…

Statistics Theory · Mathematics 2019-04-10 Gabriela Ciuperca , Matus Maciak

Multivariate normal mixtures provide a flexible model for high-dimensional data. They are widely used in statistical genetics, statistical finance, and other disciplines. Due to the unboundedness of the likelihood function, classical…

Statistics Theory · Mathematics 2008-05-27 Jiahua Chen , Xianming Tan

Laplace approximations are a standard tool for computationally efficient inference in latent Gaussian models, but they fail for quantile regression with the asymmetric Laplace likelihood because the observed Hessian vanishes almost…

Methodology · Statistics 2026-05-21 Andrea Nava , Fabio Sigrist

Quantile regression has demonstrated promising utility in longitudinal data analysis. Existing work is primarily focused on modeling cross-sectional outcomes, while outcome trajectories often carry more substantive information in practice.…

Methodology · Statistics 2018-06-19 Huijuan Ma , Limin Peng , Haoda Fu

In fitting a mixture of linear regression models, normal assumption is traditionally used to model the error and then regression parameters are estimated by the maximum likelihood estimators (MLE). This procedure is not valid if the normal…

Methodology · Statistics 2018-11-06 Yanyuan Ma , Shaoli Wang , Lin Xu , Weixin Yao

This paper develops and analyzes three families of estimators that continuously interpolate between classical quantiles and the sample mean. The construction begins with a smoothed version of the $L_{1}$ loss, indexed by a location…

Methodology · Statistics 2025-12-23 Saïd Maanan , Azzouz Dermoune , Ahmed El Ghini

A basic principle in the design of observational studies is to approximate the randomized experiment that would have been conducted under controlled circumstances. Now, linear regression models are commonly used to analyze observational…

Methodology · Statistics 2022-07-08 Ambarish Chattopadhyay , Jose R. Zubizarreta