English
Related papers

Related papers: A General Framework for the Parametrization of Hie…

200 papers

Hierarchical Bayesian Poisson regression models (HBPRMs) provide a flexible modeling approach of the relationship between predictors and count response variables. The applications of HBPRMs to large-scale datasets require efficient…

Machine Learning · Computer Science 2024-07-03 Jin-Zhu Yu , Hiba Baroud

A wide range of Bayesian models have been proposed for data that is divided hierarchically into groups. These models aim to cluster the data at different levels of grouping, by assigning a mixture component to each datapoint, and a mixture…

Machine Learning · Computer Science 2015-04-21 Adway Mitra

In the framework of Bayesian model-based clustering based on a finite mixture of Gaussian distributions, we present a joint approach to estimate the number of mixture components and identify cluster-relevant variables simultaneously as well…

Methodology · Statistics 2016-06-23 Gertraud Malsiner-Walli , Sylvia Frühwirth-Schnatter , Bettina Grün

To conduct Bayesian inference with large data sets, it is often convenient or necessary to distribute the data across multiple machines. We consider a likelihood function expressed as a product of terms, each associated with a subset of the…

Computation · Statistics 2020-04-09 Lewis J. Rendell , Adam M. Johansen , Anthony Lee , Nick Whiteley

Gaussian Process (GP) models are a powerful and flexible tool for non-parametric regression and classification. Computation for GP models is intensive, since computing the posterior density, $\pi$, for covariance function parameters…

Computation · Statistics 2013-05-13 Chunyi Wang , Radford M. Neal

Approximate Bayesian computation methods are useful for generative models with intractable likelihoods. These methods are however sensitive to the dimension of the parameter space, requiring exponentially increasing resources as this…

Computation · Statistics 2026-02-09 Grégoire Clarté , Christian P. Robert , Robin Ryder , Julien Stoehr

We propose a practical and scalable Gaussian process model for large-scale nonlinear probabilistic regression. Our mixture-of-experts model is conceptually simple and hierarchically recombines computations for an overall approximation of a…

Machine Learning · Statistics 2014-12-10 Jun Wei Ng , Marc Peter Deisenroth

Functional mixed models are widely useful for regression analysis with dependent functional data, including longitudinal functional data with scalar predictors. However, existing algorithms for Bayesian inference with these models only…

Methodology · Statistics 2023-06-14 Thomas Y. Sun , Daniel R. Kowal

Finite mixture models are frequently used to uncover latent structures in high-dimensional datasets (e.g.\ identifying clusters of patients in electronic health records). The inference of such structures can be performed in a Bayesian…

High dimensional statistics deals with the challenge of extracting structured information from complex model settings. Compared with the growing number of frequentist methodologies, there are rather few theoretically optimal Bayes methods…

Statistics Theory · Mathematics 2018-08-21 Chao Gao , Aad W. van der Vaart , Harrison H. Zhou

In many situations we are interested in modeling real data where the response distribution, even conditionally on the covariates, presents asymmetry and/or heavy/light tails. In these situations, it is more suitable to consider models based…

Methodology · Statistics 2024-06-06 João Victor B. de Freitas , Caio L. N. Azevedo

A partially identified model, where the parameters can not be uniquely identified, often arises during statistical analysis. While researchers frequently use Bayesian inference to analyze the models, when Bayesian inference with an…

Computation · Statistics 2024-08-21 Seren Lee , Paul Gustafson

In this paper, we investigate the use of probabilistic graphical models, specifically stochastic blockmodels, for the purpose of hierarchical entity clustering on knowledge graphs. These models, seldom used in the Semantic Web community,…

Artificial Intelligence · Computer Science 2024-08-29 Marcin Pietrasik , Marek Reformat , Anna Wilbik

We consider distributed optimization problems where forming the Hessian is computationally challenging and communication is a significant bottleneck. We develop unbiased parameter averaging methods for randomized second order optimization…

Machine Learning · Statistics 2020-02-18 Burak Bartan , Mert Pilanci

This paper proposes a new sampling-based nonlinear model predictive control (MPC) algorithm, with a bound on complexity quadratic in the prediction horizon N and linear in the number of samples. The idea of the proposed algorithm is to use…

Systems and Control · Computer Science 2017-01-13 R. V. Bobiti , M. Lazar

Using a hierarchical construction, we develop methods for a wide and flexible class of models by taking a fully parametric approach to generalized linear mixed models with complex covariance dependence. The Laplace approximation is used to…

Methodology · Statistics 2024-07-31 Jay M. Ver Hoef , Eryn Blagg , Michael Dumelle , Philip M. Dixon , Dale L. Zimmerman , Paul Conn

Markov chain Monte Carlo (MCMC) methods are foundational algorithms for Bayesian inference and probabilistic modeling. However, most MCMC algorithms are inherently sequential and their time complexity scales linearly with the sequence…

Computation · Statistics 2025-12-03 David M. Zoltowski , Skyler Wu , Xavier Gonzalez , Leo Kozachkov , Scott W. Linderman

Pseudo-marginal Metropolis-Hastings (pmMH) is a powerful method for Bayesian inference in models where the posterior distribution is analytical intractable or computationally costly to evaluate directly. It operates by introducing…

Computation · Statistics 2016-08-06 Johan Dahlin , Fredrik Lindsten , Joel Kronander , Thomas B. Schön

Gibbs sampling is a Markov chain Monte Carlo method that is often used for learning and inference on graphical models. Minibatching, in which a small random subset of the graph is used at each iteration, can help make Gibbs sampling scale…

Machine Learning · Computer Science 2019-11-25 Ruqi Zhang , Christopher De Sa

Recent research has shown growing interest in modeling hypergraphs, which capture polyadic interactions among entities beyond traditional dyadic relations. However, most existing methodologies for hypergraphs face significant limitations,…

Methodology · Statistics 2025-11-04 Shihao Wu , Gongjun Xu , Ji Zhu