English
Related papers

Related papers: Variable selection in sparse high-dimensional GLAR…

200 papers

Linear time series modelling is dominated by the use of purely autoregressive models even though incorporating moving average components can greatly improve parsimony. We present a convex formulation for vector-ARMA system identification…

Systems and Control · Electrical Eng. & Systems 2022-12-01 Alex Nguyen-Le , Victor M. Preciado

Panel vector auto-regressive (VAR) models are widely used to capture the dynamics of multivariate time series across different subpopulations, where each subpopulation shares a common set of variables. In this work, we propose a panel VAR…

Methodology · Statistics 2025-09-22 Yuchen Xu , George Michailidis

Sparse prediction with categorical data is challenging even for a moderate number of variables, because one parameter is roughly needed to encode one category or level. The Group Lasso is a well known efficient algorithm for selection…

Methodology · Statistics 2021-12-22 Szymon Nowakowski , Piotr Pokarowski , Wojciech Rejchel

Variable selection for recovering sparsity in nonadditive nonparametric models has been challenging. This problem becomes even more difficult due to complications in modeling unknown interaction terms among high dimensional variables. There…

Methodology · Statistics 2012-06-14 Zaili Fang , Inyoung Kim , Patrick Schaumont

Generalized autoregressive moving average (GARMA) models are a class of models that was developed for extending the univariate Gaussian ARMA time series model to a flexible observation-driven model for non-Gaussian time series data. This…

Applications · Statistics 2017-02-07 Marinho G. Andrade , Ricardo S. Ehlers , Breno S. Andrade

Variable selection and dimension reduction are two commonly adopted approaches for high-dimensional data analysis, but have traditionally been treated separately. Here we propose an integrated approach, called sparse gradient learning…

Machine Learning · Statistics 2010-07-02 Gui-Bo Ye , Xiaohui Xie

We introduce a very general method for sparse and large-scale variable selection. The large-scale regression settings is such that both the number of parameters and the number of samples are extremely large. The proposed method is based on…

Statistics Theory · Mathematics 2019-07-31 Jelena Bradic

As a special infinite-order vector autoregressive (VAR) model, the vector autoregressive moving average (VARMA) model can capture much richer temporal patterns than the widely used finite-order VAR model. However, its practicality has long…

Methodology · Statistics 2024-02-27 Yao Zheng

We propose a sparse coefficient estimation and automated model selection procedure for autoregressive (AR) processes with heavy-tailed innovations based on penalized conditional maximum likelihood. Under mild moment conditions on the…

Methodology · Statistics 2013-09-24 Hailin Sang , Yan Sun

This paper arises from collaborative research the aim of which was to model clinical assessments of upper limb function after stroke using 3D kinematic data. We present a new nonlinear mixed-effects scalar-on-function regression model with…

Applications · Statistics 2016-05-24 Yafeng Cheng , Jian Qing Shi , Janet Eyre

We propose generalized additive partial linear models for complex data which allow one to capture nonlinear patterns of some covariates, in the presence of linear components. The proposed method improves estimation efficiency and increases…

Statistics Theory · Mathematics 2014-05-26 Li Wang , Lan Xue , Annie Qu , Hua Liang

Fitting autoregressive moving average (ARMA) time series models requires model identification before parameter estimation. Model identification involves determining the order of the autoregressive and moving average components which is…

Computation · Statistics 2024-04-09 Yin Liu , Sam Davanloo Tajbakhsh

The generalized linear model (GLM) plays a key role in regression analyses. In high-dimensional data, the sparse GLM has been used but it is not robust against outliers. Recently, the robust methods have been proposed for the specific…

Machine Learning · Statistics 2026-05-15 Takayuki Kawashima , Hironori Fujisawa

This paper considers both the least squares and quasi-maximum likelihood estimation for the recently proposed scalable ARMA model, a parametric infinite-order vector AR model, and their asymptotic normality is also established. It makes…

Methodology · Statistics 2024-06-28 Yuchang Lin , Wenyu Li , Qianqian Zhu , Guodong Li

The Generalized Linear Model (GLM) for the Gamma distribution (glmGamma) is widely used in modeling continuous, non-negative and positive-skewed data, such as insurance claims and survival data. However, model selection for GLM depends on…

Methodology · Statistics 2018-04-24 Xin Chen , Aleksandr Y. Aravkin , R. Douglas Martin

Model averaging is an important alternative to model selection with attractive prediction accuracy. However, its application to high-dimensional data remains under-explored. We propose a high-dimensional model averaging method via…

Statistics Theory · Mathematics 2025-06-11 Zhengyan Wan , Fang Fang , Binyan Jiang

Generating large-scale samples of stationary random fields is of great importance in the fields such as geomaterial modeling and uncertainty quantification. Traditional methodologies based on covariance matrix decomposition have the…

Methodology · Statistics 2022-08-23 Bin Zhu , Jiahao Liu , Zhengshou Lai , Tao Qian

This paper focuses on variable selection for a partially linear single-index varying-coefficient model. A regularized variable selection procedure by combining basis function approximations with SCAD penalty is proposed. It can…

Statistics Theory · Mathematics 2024-12-19 Lijuan Han , Liugen Xue , Junshan Xie

Dynamic inference problems in autoregressive (AR/ARMA/ARIMA), exponential smoothing, and navigation are often formulated and solved using state-space models (SSM), which allow a range of statistical distributions to inform innovations and…

Optimization and Control · Mathematics 2019-10-31 Jonathan Jonker , Peng Zheng , Aleksandr Y. Aravkin

This paper studies model selection consistency for high dimensional sparse regression when data exhibits both cross-sectional and serial dependency. Most commonly-used model selection methods fail to consistently recover the true model when…

Methodology · Statistics 2018-09-12 Jianqing Fan , Yuan Ke , Kaizheng Wang