English
Related papers

Related papers: Penalized Likelihood Estimation in High-Dimensiona…

200 papers

We introduce GAMSEL (Generalized Additive Model Selection), a penalized likelihood approach for fitting sparse generalized additive models in high dimension. Our method interpolates between null, linear and additive models by allowing the…

Machine Learning · Statistics 2015-06-18 Alexandra Chouldechova , Trevor Hastie

A Poisson autoregressive (PAR) model accounting for discreteness and autocorrelation of count time series data is typically estimated in the state-space modelling framework through extended Kalman filter. However, because of the complex…

Methodology · Statistics 2025-03-05 Paolo Victor T. Redondo , Joseph Ryan G. Lansangan , Erniel B. Barrios

High-dimensional sparse modeling with censored survival data is of great practical importance, as exemplified by modern applications in high-throughput genomic data analysis and credit risk analysis. In this article, we propose a class of…

Methodology · Statistics 2014-03-19 Wei Lin , Jinchi Lv

We consider model selection in generalized linear models (GLM) for high-dimensional data and propose a wide class of model selection criteria based on penalized maximum likelihood with a complexity penalty on the model size. We derive a…

Statistics Theory · Mathematics 2016-03-31 Felix Abramovich , Vadim Grinshtein

We present a unified framework for estimation and analysis of generalized additive models in high dimensions. The framework defines a large class of penalized regression estimators, encompassing many existing methods. An efficient…

Methodology · Statistics 2019-03-13 Asad Haris , Noah Simon , Ali Shojaie

We consider penalized estimation in hidden Markov models (HMMs) with multivariate Normal observations. In the moderate-to-large dimensional setting, estimation for HMMs remains challenging in practice, due to several concerns arising from…

Methodology · Statistics 2014-01-09 Nicolas Städler , Sach Mukherjee

We consider the high-dimensional heteroscedastic regression model, where the mean and the log variance are modeled as a linear combination of input variables. Existing literature on high-dimensional linear regres- sion models has largely…

Machine Learning · Statistics 2012-05-23 Mladen Kolar , James Sharpnack

Multi-parameter regression (MPR) modelling refers to the approach whereby covariates are allowed to enter the model through multiple distributional parameters simultaneously. This is in contrast to the standard approaches where covariates…

Methodology · Statistics 2019-07-03 Fatima-Zahra Jaouimaa , Il Do Ha , Kevin Burke

We have established a sparse estimation method for the generalized exponential marked Hawkes process by the penalized method to the ordinary method (P-O) estimator. Furthermore, we evaluated the probability of correct variable selection. In…

Statistics Theory · Mathematics 2022-04-08 Masatoshi Goda

In this paper, we propose a new nonparametric estimator of time-varying forecast combination weights. When the number of individual forecasts is small, we study the asymptotic properties of the local linear estimator. When the number of…

Econometrics · Economics 2020-10-21 Bin Chen , Kenwin Maung

The paper considers a linear regression model in high-dimension for which the predictive variables can change the influence on the response variable at unknown times (called change-points). Moreover, the particular case of the heavy-tailed…

Statistics Theory · Mathematics 2013-07-03 Gabriela Ciuperca

Skew normal mixture models provide a more flexible framework than the popular normal mixtures for modelling heterogeneous data with asymmetric behaviors. Due to the unboundedness of likelihood function and the divergency of shape…

Methodology · Statistics 2016-08-05 Libin Jin , Wangli Xu , Liping Zhu , Lixing Zhu

Quantile regression (QR) relies on the estimation of conditional quantiles and explores the relationships between independent and dependent variables. At high probability levels, classical QR methods face extrapolation difficulties due to…

Statistics Theory · Mathematics 2026-04-16 Lucien M. Vidagbandji , Alexandre Berred , Cyrille Bertelle , Laurent Amanton

The present paper is about estimation and prediction in high-dimensional additive models under a sparsity assumption ($p\gg n$ paradigm). A PAC-Bayesian strategy is investigated, delivering oracle inequalities in probability. The…

Methodology · Statistics 2018-05-22 Benjamin Guedj , Pierre Alquier

In the regression setting, given a set of hyper-parameters, a model-estimation procedure constructs a model from training data. The optimal hyper-parameters that minimize generalization error of the model are usually unknown. In practice…

Machine Learning · Statistics 2019-04-01 Jean Feng , Noah Simon

Covariance regression offers an effective way to model the large covariance matrix with the auxiliary similarity matrices. In this work, we propose a sparse covariance regression (SCR) approach to handle the potentially high-dimensional…

Methodology · Statistics 2024-10-17 Yuan Gao , Zhiyuan Zhang , Zhanrui Cai , Xuening Zhu , Tao Zou , Hansheng Wang

This paper proposes a recursive interval-valued estimation framework for identifying the parameters of linearly parameterized systems which may be slowly time-varying. It is assumed that the model error (which may consist in measurement…

Systems and Control · Electrical Eng. & Systems 2022-06-22 Laurent Bako , Seydi Ndiaye , Eric Blanco

As an effective nonparametric method, empirical likelihood (EL) is appealing in combining estimating equations flexibly and adaptively for incorporating data information. To select important variables and estimating equations in the sparse…

Methodology · Statistics 2021-07-02 Jiaqi Li , Liya Fu

A penalized maximum likelihood estimation approach is proposed for discrete-time hidden Markov models where covariates affect the observed responses and serial dependence is considered. The proposed penalized maximum likelihood method…

Methodology · Statistics 2025-07-04 Luca Brusa , Fulvia Pennoni , Francesco Bartolucci , Romina Peruilh Bagolini

We consider the nonparametric regression and the classification problems for $\psi$-weakly dependent processes. This weak dependence structure is more general than conditions such as, mixing, association, $\ldots$. A penalized estimation…

Machine Learning · Statistics 2023-03-03 William Kengne , Modou Wade