English
Related papers

Related papers: Spike-and-Slab Priors for Function Selection in St…

200 papers

High-dimensional variable selection, with many more covariates than observations, is widely documented in standard regression models, but there are still few tools to address it in non-linear mixed-effects models where data are collected…

Statistics Theory · Mathematics 2024-04-08 Marion Naveau , Guillaume Kon Kam King , Renaud Rincent , Laure Sansonnet , Maud Delattre

Consider the problem of high dimensional variable selection for the Gaussian linear model when the unknown error variance is also of interest. In this paper, we show that the use of conjugate shrinkage priors for Bayesian variable selection…

Methodology · Statistics 2025-04-17 Gemma E. Moran , Veronika Rockova , Edward I. George

Structured additive distributional copula regression allows to model the joint distribution of multivariate outcomes by relating all distribution parameters to covariates. Estimation via statistical boosting enables accounting for…

Substantial research on structured sparsity has contributed to analysis of many different applications. However, there have been few Bayesian procedures among this work. Here, we develop a Bayesian model for structured sparsity that uses a…

Methodology · Statistics 2014-07-09 Barbara E. Engelhardt , Ryan P. Adams

The high dimensional nature of genomics data complicates feature selection, in particular in low sample size studies - not uncommon in clinical prediction settings. It is widely recognized that complementary data on the features, `co-data',…

Methodology · Statistics 2024-05-09 Mark A. van de Wiel , Wessel N. van Wieringen

Additive nonparametric regression models provide an attractive tool for variable selection in high dimensions when the relationship between the response and predictors is complex. They offer greater flexibility compared to parametric…

Machine Learning · Statistics 2016-07-12 Garret Vo , Debdeep Pati

Many complex systems have been shown to share universal properties of organization, such as scale independence, modularity and self-similarity. We borrow tools from statistical physics in order to study structural preferential attachment…

Task vectors capture how a model changes during fine-tuning by recording the difference between pre-trained and task-specific weights. The composition of task vectors, a key operator in task arithmetic, enables models to integrate knowledge…

Machine Learning · Computer Science 2025-09-24 Boyuan Zhang , Yingjun Du , Xiantong Zhen , Ling Shao

High-dimensional, heterogeneous data with complex feature interactions pose significant challenges for traditional predictive modeling approaches. While Projection to Latent Structures (PLS) remains a popular technique, it struggles to…

Machine Learning · Computer Science 2025-10-21 Farwa Abbas , Hussain Ahmad , Claudia Szabo

Joint models for longitudinal and time-to-event data have seen many developments in recent years. Though spatial joint models are still rare and the traditional proportional hazards formulation of the time-to-event part of the model is…

Methodology · Statistics 2024-06-25 Anja Rappl , Thomas Kneib , Stefan Lang , Elisabeth Bergherr

Spike-and-slab and horseshoe regression are arguably the most popular Bayesian variable selection approaches for linear regression models. However, their performance can deteriorate if outliers and heteroskedasticity are present in the…

Methodology · Statistics 2022-10-20 Alberto Cabezas , Marco Battiston , Christopher Nemeth

We consider the joint inference of regression coefficients and the inverse covariance matrix for covariates in high-dimensional probit regression, where the predictors are both relevant to the binary response and functionally related to one…

Methodology · Statistics 2022-03-15 Xuan Cao , Kyoungjae Lee

Linear mixed effects models are highly flexible in handling a broad range of data types and are therefore widely used in applications. A key part in the analysis of data is model selection, which often aims to choose a parsimonious model…

Methodology · Statistics 2013-06-12 Samuel Müller , J. L. Scealy , A. H. Welsh

Selective prediction aims to endow predictors with a reject option, to avoid low confidence predictions. However, existing literature has primarily focused on closed-set tasks, such as visual question answering with predefined options or…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Aditya Sarkar , Yi Li , Jiacheng Cheng , Shlok Mishra , Nuno Vasconcelos

In this article, we propose a novel spatial global-local spike-and-slab selection prior for image-on-scalar regression. We consider a Bayesian hierarchical Gaussian process model for image smoothing, that uses a flexible Inverse-Wishart…

Methodology · Statistics 2022-12-19 Zijian Zeng , Meng Li , Marina Vannucci

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, offer a distinctive approach for capturing the complexities of temporal data. However, their potential for spatial modeling in multivariate time-series…

Machine Learning · Computer Science 2025-08-19 Bang Hu , Changze Lv , Mingjie Li , Yunpeng Liu , Xiaoqing Zheng , Fengzhe Zhang , Wei cao , Fan Zhang

Prediction is a classic challenge in spatial statistics and the inclusion of spatial covariates can greatly improve predictive performance when incorporated into a model with latent spatial effects. It is desirable to develop flexible…

Methodology · Statistics 2025-02-24 Alex Ziyu Jiang , Jon Wakefield

Factor and sparse models are two widely used methods to impose a low-dimensional structure in high-dimensions. However, they are seemingly mutually exclusive. We propose a lifting method that combines the merits of these two models in a…

Econometrics · Economics 2022-09-07 Jianqing Fan , Ricardo Masini , Marcelo C. Medeiros

We propose generalized additive partial linear models for complex data which allow one to capture nonlinear patterns of some covariates, in the presence of linear components. The proposed method improves estimation efficiency and increases…

Statistics Theory · Mathematics 2014-05-26 Li Wang , Lan Xue , Annie Qu , Hua Liang

Latent space models (LSMs) are frequently used to model network data by embedding a network's nodes into a low-dimensional latent space; however, choosing the dimension of this space remains a challenge. To this end, we begin by formalizing…

Methodology · Statistics 2023-09-22 Joshua Daniel Loyal , Yuguo Chen