English
Related papers

Related papers: Model detection and variable selection for mode va…

200 papers

The quantile varying coefficient (VC) model can flexibly capture dynamical patterns of regression coefficients. In addition, due to the quantile check loss function, it is robust against outliers and heavy-tailed distributions of the…

Methodology · Statistics 2023-07-11 Fei Zhou , Jie Ren , Shuangge Ma , Cen Wu

In this paper, we focus on the variable selection techniques for a class of semiparametric spatial regression models which allow one to study the effects of explanatory variables in the presence of the spatial information. The spatial…

Methodology · Statistics 2021-06-03 Guannan Wang , Jue Wang

In this paper, we are concerned with how to select significant variables in semiparametric modeling. Variable selection for semiparametric regression models consists of two components: model selection for nonparametric components and…

Statistics Theory · Mathematics 2008-12-18 Runze Li , Hua Liang

Spatially and temporally varying coefficient (STVC) models are currently attracting attention as a flexible tool to explore the spatio-temporal patterns in regression coefficients. However, these models often struggle with balancing…

Methodology · Statistics 2025-01-07 Daisuke Murakami , Shinichiro Shirota , Seiji Kajita , Mami Kajita

Model selection often aims to choose a single model, assuming that the form of the model is correct. However, there may be multiple possible underlying explanatory patterns in a set of predictors that could explain a response. Model…

Methodology · Statistics 2021-12-17 Laura J. Wendelberger , Brian J. Reich , Alyson G. Wilson

Spatial regression models have a variety of applications in several fields ranging from economics to public health. Typically, it is of interest to select important exogenous predictors of the spatially autocorrelated response variable. In…

Methodology · Statistics 2025-10-31 Sagar Pandhare , Divya Kappara , Siuli Mukhopadhyay

Linear discriminant analysis (LDA) is an important classification tool in statistics and machine learning. This paper investigates the varying coefficient LDA model for dynamic data, with Bayes' discriminant direction being a function of…

Methodology · Statistics 2022-10-11 Yajie Bao , Yuyang Liu

We propose a fast and theoretically grounded method for Bayesian variable selection and model averaging in latent variable regression models. Our framework addresses three interrelated challenges: (i) intractable marginal likelihoods, (ii)…

Methodology · Statistics 2025-09-16 Gregor Zens , Mark F. J. Steel

This paper considers parameter estimation for nonlinear state-space models, which is an important but challenging problem. We address this challenge by employing a variational inference (VI) approach, which is a principled method that has…

Machine Learning · Statistics 2022-09-15 Jarrad Courts , Adrian Wills , Thomas Schön , Brett Ninness

Spatially varying coefficient (SVC) models are a type of regression model for spatial data where covariate effects vary over space. If there are several covariates, a natural question is which covariates have a spatially varying effect and…

Methodology · Statistics 2021-02-12 Jakob A. Dambon , Fabio Sigrist , Reinhard Furrer

We develop a variational Bayes approach for dynamic variable selection in high-dimensional regression models with time-varying parameters and predictors that exhibit a predefined group structure. Through comprehensive simulation studies, we…

Methodology · Statistics 2025-04-16 Nicolas Bianco , Mauro Bernardi , Daniele Bianchi

In this paper, for Lasso penalized linear regression models in high-dimensional settings, we propose a modified cross-validation method for selecting the penalty parameter. The methodology is extended to other penalties, such as Elastic…

Methodology · Statistics 2013-09-10 Yi Yu , Yang Feng

Variable selection, also known as feature selection in machine learning, plays an important role in modeling high dimensional data and is key to data-driven scientific discoveries. We consider here the problem of detecting influential…

Methodology · Statistics 2014-09-24 Bo Jiang , Jun S. Liu

Quantile regression has been successfully used to study heterogeneous and heavy-tailed data. Varying-coefficient models are frequently used to capture changes in the effect of input variables on the response as a function of an index or…

Methodology · Statistics 2021-10-18 Ran Dai , Mladen Kolar

Data science projects often involve various machine learning (ML) methods that depend on data, code, and models. One of the key activities in these projects is the selection of a model or algorithm that is appropriate for the data analysis…

Machine Learning · Computer Science 2023-11-27 Cristina Tavares , Nathalia Nascimento , Paulo Alencar , Donald Cowan

Traditional variable selection methods could fail to be sign consistent when irrepresentable conditions are violated. This is especially critical in high-dimensional settings when the number of predictors exceeds the sample size. In this…

Methodology · Statistics 2022-04-26 Fei Xue , Annie Qu

In this paper, we study the model selection and structure specification for the generalised semi-varying coefficient models (GSVCMs), where the number of potential covariates is allowed to be larger than the sample size. We first propose a…

Statistics Theory · Mathematics 2015-10-30 Degui Li , Yuan Ke , Wenyang Zhang

This paper presents a new method for modelling periodic signals having an aperiodic trend, using the method of variable projection. It is a major extension to the IEEE-standard 1057 by permitting the background to be time varying;…

Signal Processing · Electrical Eng. & Systems 2023-11-21 Johannes Handler , Dimitar Ninevski , Paul O'Leary

Dynamic factor models are often estimated by point-estimation methods, disregarding parameter uncertainty. We propose a method accounting for parameter uncertainty by means of posterior approximation, using variational inference. Our…

Methodology · Statistics 2022-10-14 Erik Spånberg

We present a new variable selection method based on model-based gradient boosting and randomly permuted variables. Model-based boosting is a tool to fit a statistical model while performing variable selection at the same time. A drawback of…

Machine Learning · Statistics 2017-02-16 Janek Thomas , Tobias Hepp , Andreas Mayr , Bernd Bischl