English
Related papers

Related papers: Slice sampling covariance hyperparameters of laten…

200 papers

We develop a Bayesian approach to learning from sequential data by using Gaussian processes (GPs) with so-called signature kernels as covariance functions. This allows to make sequences of different length comparable and to rely on strong…

Machine Learning · Statistics 2020-07-07 Csaba Toth , Harald Oberhauser

Learning uncertain dynamics models using Gaussian process~(GP) regression has been demonstrated to enable high-performance and safety-aware control strategies for challenging real-world applications. Yet, for computational tractability,…

Optimization and Control · Mathematics 2024-09-17 Manish Prajapat , Amon Lahr , Johannes Köhler , Andreas Krause , Melanie N. Zeilinger

Gaussian process (GP) models provide a powerful tool for prediction but are computationally prohibitive using large data sets. In such scenarios, one has to resort to approximate methods. We derive an approximation based on a composite…

Machine Learning · Statistics 2018-02-02 Xiuming Liu , Dave Zachariah , Edith C. H. Ngai

Spatial generalized linear mixed-effects models are popularly used to analyze spatially indexed univariate responses. However, with modern technology, it is common to observe vector-valued mixed-type responses, e.g., a combination of…

Methodology · Statistics 2026-04-23 Arghya Mukherjee , Arnab Hazra , Dootika Vats

State-space models are successfully used in many areas of science, engineering and economics to model time series and dynamical systems. We present a fully Bayesian approach to inference \emph{and learning} (i.e. state estimation and system…

Machine Learning · Statistics 2013-12-18 Roger Frigola , Fredrik Lindsten , Thomas B. Schön , Carl E. Rasmussen

Gaussian Processes (GPs) provide a powerful framework for making predictions and understanding uncertainty for classification with kernels and Bayesian non-parametric learning. Building such models typically requires strong prior knowledge…

Machine Learning · Computer Science 2024-08-16 Changze Huang , Di Wang

Gaussian process (GP) methods have been widely studied recently, especially for large-scale systems with big data and even more extreme cases when data is sparse. Key advantages of these methods consist in: 1) the ability to provide…

Methodology · Statistics 2024-09-13 Chenyi Lyu , Xingchi Liu , Lyudmila Mihaylova

In this paper we propose the first non-parametric Bayesian model using Gaussian Processes to make inference on Poisson Point Processes without resorting to gridding the domain or to introducing latent thinning points. Unlike competing…

Machine Learning · Statistics 2015-06-30 Yves-Laurent Kom Samo , Stephen Roberts

Identifying the active factors that have significant impacts on the output of the complex system is an important but challenging variable selection problem in computer experiments. In this paper, a Bayesian hierarchical Gaussian process…

Methodology · Statistics 2024-06-18 Xiao Yao , Ning Jianhui , Qin Hong

The particle Gibbs sampler is a Markov chain Monte Carlo (MCMC) algorithm to sample from the full posterior distribution of a state-space model. It does so by executing Gibbs sampling steps on an extended target distribution defined on the…

Computation · Statistics 2015-07-29 Nicolas Chopin , Sumeetpal S. Singh

Mechanistic simulation models are inverted against observations in order to gain inference on modeled processes. However, with the increasing ability to collect high resolution observations, these observations represent more patterns of…

Computation · Statistics 2018-12-20 Thomas Wutzler

Stochastic processes are a flexible and widely used family of models for statistical modeling. While stochastic processes offer attractive properties such as inclusion of uncertainty properties, their inference is typically intractable,…

Methodology · Statistics 2026-02-10 Teemu Härkönen , Simo Särkkä

Standard sparse pseudo-input approximations to the Gaussian process (GP) cannot handle complex functions well. Sparse spectrum alternatives attempt to answer this but are known to over-fit. We suggest the use of variational inference for…

Machine Learning · Statistics 2015-03-23 Yarin Gal , Richard Turner

Hamiltonian Monte Carlo (HMC) is a Markov chain algorithm for sampling from a high-dimensional distribution with density $e^{-f(x)}$, given access to the gradient of $f$. A particular case of interest is that of a $d$-dimensional Gaussian…

Machine Learning · Statistics 2022-09-27 Simon Apers , Sander Gribling , Dániel Szilágyi

We present a sequential sampling methodology for weakly structural Markov laws, arising naturally in a Bayesian structure learning context for decomposable graphical models. As a key component of our suggested approach, we show that the…

Statistics Theory · Mathematics 2019-09-04 Jimmy Olsson , Tetyana Pavlenko , Felix L. Rios

We apply Gaussian process (GP) regression, which provides a powerful non-parametric probabilistic method of relating inputs to outputs, to survival data consisting of time-to-event and covariate measurements. In this context, the covariates…

Statistics Theory · Mathematics 2014-09-08 James E. Barrett , Anthony C. C. Coolen

Gaussian processes are the gold standard for many real-world modeling problems, especially in cases where a model's success hinges upon its ability to faithfully represent predictive uncertainty. These problems typically exist as parts of…

We study the computational complexity of Markov chain Monte Carlo (MCMC) methods for high-dimensional Bayesian linear regression under sparsity constraints. We first show that a Bayesian approach can achieve variable-selection consistency…

Statistics Theory · Mathematics 2015-06-01 Yun Yang , Martin J. Wainwright , Michael I. Jordan

For multivariate spatial Gaussian process (GP) models, customary specifications of cross-covariance functions do not exploit relational inter-variable graphs to ensure process-level conditional independence among the variables. This is…

Methodology · Statistics 2021-11-19 Debangan Dey , Abhirup Datta , Sudipto Banerjee

Bayesian models have become very popular over the last years in several fields such as signal processing, statistics, and machine learning. Bayesian inference requires the approximation of complicated integrals involving posterior…

Computation · Statistics 2021-07-20 Luca Martino , Víctor Elvira