English
Related papers

Related papers: New Development of Bayesian Variable Selection Cri…

200 papers

Kernel methods have revolutionized the fields of pattern recognition and machine learning. Their success, however, critically depends on the choice of kernel parameters. Using Gaussian process (GP) classification as a working example, this…

Methodology · Statistics 2014-05-27 Maurizio Filippone

We present novel Monte Carlo (MC) and multilevel Monte Carlo (MLMC) methods to determine the unbiased covariance of random variables using h-statistics. The advantage of this procedure lies in the unbiased construction of the estimator's…

Statistics Theory · Mathematics 2024-05-09 Sharana Kumar Shivanand

In spite of the diverse literature on nonstationary spatial modeling and approximate Gaussian process (GP) methods, there are no general approaches for conducting fully Bayesian inference for moderately sized nonstationary spatial data sets…

Computation · Statistics 2020-07-01 Mark D. Risser , Daniel Turek

This paper introduces methodology for performing Bayesian inference sequentially on a sequence of posteriors on spaces of different dimensions. We show how this may be achieved through the use of sequential Monte Carlo (SMC) samplers (Del…

Computation · Statistics 2020-06-02 Richard G Everitt , Richard Culliford , Felipe Medina-Aguayo , Daniel J Wilson

We present a non-parametric Bayesian latent variable model capable of learning dependency structures across dimensions in a multivariate setting. Our approach is based on flexible Gaussian process priors for the generative mappings and…

Machine Learning · Statistics 2018-07-16 Andrew R. Lawrence , Carl Henrik Ek , Neill D. F. Campbell

In this work we consider time series with a finite number of discrete point changes. We assume that the data in each segment follows a different probability density functions (pdf). We focus on the case where the data in all segments are…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ali Mohammad-Djafari , Olivier Feron

Bayesian variable selection is a powerful tool for data analysis, as it offers a principled method for variable selection that accounts for prior information and uncertainty. However, wider adoption of Bayesian variable selection has been…

Methodology · Statistics 2023-12-06 Martin Jankowiak

This paper develops a semiparametric Bayesian instrumental variable analysis method for estimating the causal effect of an endogenous variable when dealing with unobserved confounders and measurement errors with partly interval-censored…

Methodology · Statistics 2025-01-28 Elvis Han Cui , Xuyang Lu , Jin Zhou , Hua Zhou , Gang Li

We provide a framework which admits a number of ``marginal'' sequential Monte Carlo (SMC) algorithms as particular cases -- including the marginal particle filter [Klaas et al., 2005, in: Proceedings of Uncertainty in Artificial…

Computation · Statistics 2023-03-08 Francesca R. Crucinio , Adam M. Johansen

Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use…

Numerical Analysis · Mathematics 2016-01-20 Matthias Morzfeld , Xuemin Tu , Jon Wilkening , Alexandre J. Chorin

The Gaussian process latent variable model (GP-LVM) is a popular approach to non-linear probabilistic dimensionality reduction. One design choice for the model is the number of latent variables. We present a spike and slab prior for the…

Machine Learning · Statistics 2015-05-12 Zhenwen Dai , James Hensman , Neil Lawrence

Approximate Bayesian computation methods can be used to evaluate posterior distributions without having to calculate likelihoods. In this paper we discuss and apply an approximate Bayesian computation (ABC) method based on sequential Monte…

Computation · Statistics 2009-01-15 Tina Toni , David Welch , Natalja Strelkowa , Andreas Ipsen , Michael P. H. Stumpf

Gaussian process state-space models (GPSSMs) provide a principled and flexible approach to modeling the dynamics of a latent state, which is observed at discrete-time points via a likelihood model. However, inference in GPSSMs is…

Machine Learning · Computer Science 2023-07-18 Xuhui Fan , Edwin V. Bonilla , Terence J. O'Kane , Scott A. Sisson

Variable clustering is important for explanatory analysis. However, only few dedicated methods for variable clustering with the Gaussian graphical model have been proposed. Even more severe, small insignificant partial correlations due to…

Applications · Statistics 2018-06-18 Daniel Andrade , Akiko Takeda , Kenji Fukumizu

We consider a problem of ecological inference, in which individual-level covariates are known, but labeled data is available only at the aggregate level. The intended application is modeling voter preferences in elections. In Rosenman and…

Machine Learning · Statistics 2019-07-23 Evan Rosenman

There is a rich literature on clustering functional data with applications to time-series modeling, trajectory data, and even spatio-temporal applications. However, existing methods routinely perform global clustering that enforces…

Methodology · Statistics 2024-12-16 Tsung-Hung Yao , Suprateek Kundu

Hamiltonian Monte Carlo (HMC) is a powerful algorithm to sample latent variables from Bayesian models. The advent of probabilistic programming languages (PPLs) frees users from writing inference algorithms and lets users focus on modeling.…

Machine Learning · Computer Science 2023-06-05 Jinlin Lai , Javier Burroni , Hui Guan , Daniel Sheldon

We discuss the possibility of applying some standard statistical methods (the least square method, the maximum likelihood method, the method of statistical moments for estimation of parameters) to deterministically chaotic low-dimensional…

Data Analysis, Statistics and Probability · Physics 2009-11-10 V. F. Pisarenko , D. Sornette

This paper proposes a variational Bayes algorithm for computationally efficient posterior and predictive inference in time-varying parameter (TVP) models. Within this context we specify a new dynamic variable/model selection strategy for…

Computation · Statistics 2021-12-23 Gary Koop , Dimitris Korobilis

Bayesian hierarchical modeling is a popular approach to capturing unobserved heterogeneity across individual units. However, standard estimation methods such as Markov chain Monte Carlo (MCMC) can be impracticable for modeling outcomes from…

Methodology · Statistics 2014-11-04 Michael Braun , Paul Damien