English
Related papers

Related papers: Scalable Bayesian bi-level variable selection in g…

200 papers

We introduce the spike-and-slab group lasso (SSGL) for Bayesian estimation and variable selection in linear regression with grouped variables. We further extend the SSGL to sparse generalized additive models (GAMs), thereby introducing the…

Methodology · Statistics 2020-07-29 Ray Bai , Gemma E. Moran , Joseph Antonelli , Yong Chen , Mary R. Boland

Large neural networks trained on large datasets have become the dominant paradigm in machine learning. These systems rely on maximum likelihood point estimates of their parameters, precluding them from expressing model uncertainty. This may…

Machine Learning · Statistics 2024-05-01 Javier Antoran

In this study, we introduce a novel methodological framework called Bayesian Penalized Empirical Likelihood (BPEL), designed to address the computational challenges inherent in empirical likelihood (EL) approaches. Our approach has two…

Methodology · Statistics 2025-03-04 Jinyuan Chang , Cheng Yong Tang , Yuanzheng Zhu

Stochastic approximation Monte Carlo (SAMC) has recently been proposed by Liang, Liu and Carroll [J. Amer. Statist. Assoc. 102 (2007) 305--320] as a general simulation and optimization algorithm. In this paper, we propose to improve its…

Statistics Theory · Mathematics 2009-08-26 Faming Liang

In several modern applications, data are generated continuously over time, such as data generated from smartwatches. We assume data are collected and analyzed sequentially, in batches. Since traditional or offline methods can be extremely…

Methodology · Statistics 2025-01-22 Payel Ghosal , Shamriddha De , Joyee Ghosh

A recommender system based on ranks is proposed, where an expert's ranking of a set of objects and a user's ranking of a subset of those objects are combined to make a prediction of the user's ranking of all objects. The rankings are…

Machine Learning · Statistics 2018-02-12 Simon Guillotte , François Perron , Johan Segers

Ordinal categorical data are routinely encountered in many practical applications. When the primary goal is to construct a regression model for ordinal outcomes, cumulative link models represent one of the most popular choices to link the…

Methodology · Statistics 2026-03-13 Emanuele Aliverti

Factor analysis is a flexible technique for assessment of multivariate dependence and codependence. Besides being an exploratory tool used to reduce the dimensionality of multivariate data, it allows estimation of common factors that often…

Methodology · Statistics 2020-02-19 Kelly C. M. Gonçalves , Afonso C. B. Silva

Randomized clinical trials are considered the gold standard for estimating causal effects. Nevertheless, in studies that are aimed at examining adverse effects of interventions, such trials are often impractical because of ethical and…

Methodology · Statistics 2020-01-20 Anthony D. Scotina , Andrew R. Zullo , Robert J. Smith , Roee Gutman

We develop a model-based empirical Bayes approach to variable selection problems in which the number of predictors is very large, possibly much larger than the number of responses (the so-called 'large p, small n' problem). We consider the…

Methodology · Statistics 2015-10-14 Haim Y. Bar , James G. Booth , Martin T. Wells

We introduce a scalable Bayesian preference learning method for identifying convincing arguments in the absence of gold-standard rat- ings or rankings. In contrast to previous work, we avoid the need for separate methods to perform quality…

Computation and Language · Computer Science 2018-06-08 Edwin Simpson , Iryna Gurevych

The recently introduced class of simultaneous graphical dynamic linear models (SGDLMs) defines an ability to scale on-line Bayesian analysis and forecasting to higher-dimensional time series. This paper advances the methodology of SGDLMs,…

Applications · Statistics 2022-06-07 Lutz F. Gruber , Mike West

Likelihood-free methods, such as approximate Bayesian computation, are powerful tools for practical inference problems with intractable likelihood functions. Markov chain Monte Carlo and sequential Monte Carlo variants of approximate…

Computation · Statistics 2019-02-26 David J. Warne , Ruth E. Baker , Matthew J. Simpson

Selection of covariates is crucial in the estimation of average treatment effects given observational data with high or even ultra-high dimensional pretreatment variables. Existing methods for this problem typically assume sparse linear…

Methodology · Statistics 2023-03-20 Juan Chen , Yingchun Zhou

Complex scientific models where the likelihood cannot be evaluated present a challenge for statistical inference. Over the past two decades, a wide range of algorithms have been proposed for learning parameters in computationally feasible…

Computation · Statistics 2021-12-16 Aden Forrow , Ruth E. Baker

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment.…

Machine Learning · Computer Science 2023-09-15 Mohamed Aziz Bhouri , Michael Joly , Robert Yu , Soumalya Sarkar , Paris Perdikaris

Approximate Bayesian inference typically revolves around computing the posterior parameter distribution. In practice, however, the main object of interest is often a model's predictions rather than its parameters. In this work, we propose…

Machine Learning · Statistics 2026-05-29 Julian Rodemann , Alexander Marquard , Thomas Augustin , Michele Caprio

Despite the amount of research on disease mapping in recent years, the use of multivariate models for areal spatial data remains limited due to difficulties in implementation and computational burden. These problems are exacerbated when the…

Methodology · Statistics 2023-07-24 G. Vicente , A. Adin , T. Goicoa , M. D. Ugarte

We pursue tractable Bayesian analysis of generalized linear models (GLMs) for categorical data. Thus far, GLMs are difficult to scale to more than a few dozen categories due to non-conjugacy or strong posterior dependencies when using…

Machine Learning · Statistics 2022-06-02 Michael T. Wojnowicz , Shuchin Aeron , Eric L. Miller , Michael C. Hughes

The Bayesian approach provides powerful methods for variable selection. The ability to incorporate sparsity through prior beliefs and account for parameter uncertainty allows Bayesian variable selection to consistently identify which of the…

Methodology · Statistics 2026-03-05 Beniamino Hadj-Amar , Jack Jewson