English
Related papers

Related papers: Scaling Nonparametric Bayesian Inference via Subsa…

200 papers

We propose a general statistical framework for clustering multiple time series that exhibit nonlinear dynamics into an a-priori-unknown number of sub-groups. Our motivation comes from neuroscience, where an important problem is to identify,…

Machine Learning · Statistics 2019-03-05 Alexander Lin , Yingzhuo Zhang , Jeremy Heng , Stephen A. Allsop , Kay M. Tye , Pierre E. Jacob , Demba Ba

A wide variety of optimization techniques, both exact and heuristic, tend to be biased samplers. This means that when attempting to find multiple uncorrelated solutions of a degenerate Boolean optimization problem a subset of the solution…

Disordered Systems and Neural Networks · Physics 2019-05-14 Andrew J. Ochoa , Darryl C. Jacob , Salvatore Mandrà , Helmut G. Katzgraber

Bayesian nonparametric methods are a popular choice for analysing survival data due to their ability to flexibly model the distribution of survival times. These methods typically employ a nonparametric prior on the survival function that is…

Methodology · Statistics 2022-02-22 Edwin Fong , Brieuc Lehmann

Gaussian Process Latent Variable Models (GPLVMs) have become increasingly popular for unsupervised tasks such as dimensionality reduction and missing data recovery due to their flexibility and non-linear nature. An importance-weighted…

Machine Learning · Computer Science 2026-03-10 Jian Xu , Shian Du , Junmei Yang , Qianli Ma , Delu Zeng , John Paisley

Hierarchical Bayesian networks and neural networks with stochastic hidden units are commonly perceived as two separate types of models. We show that either of these types of models can often be transformed into an instance of the other, by…

Machine Learning · Computer Science 2015-01-23 Diederik P. Kingma , Max Welling

Exploiting the fact that samples drawn from a quantum annealer inherently follow a Boltzmann-like distribution, annealing-based Quantum Boltzmann Machines (QBMs) have gained increasing popularity in the quantum research community. While…

The cumulative shrinkage process is an increasing shrinkage prior that can be employed within models in which additional terms are supposed to play a progressively negligible role. A natural application is to Gaussian factor models, where…

Computation · Statistics 2020-08-13 Sirio Legramanti

Understanding sub-cellular protein localisation is an essential component to analyse context specific protein function. Recent advances in quantitative mass-spectrometry (MS) have led to high resolution mapping of thousands of proteins to…

Applications · Statistics 2019-03-12 Oliver M. Crook , Kathryn S. Lilley , Laurent Gatto , Paul D. W. Kirk

In finite-size scaling analyses of Monte Carlo simulations of second-order phase transitions one often needs an extended temperature range around the critical point. By combining the parallel tempering algorithm with cluster updates and an…

Statistical Mechanics · Physics 2015-05-28 Elmar Bittner , Wolfhard Janke

In this paper we develop a new general Bayesian methodology that simultaneously estimates parameters of interest and the marginal likelihood of the model. The proposed methodology builds on Simulated Tempering, which is a powerful algorithm…

Computation · Statistics 2019-06-03 Biljana Jonoska Stojkova , David A. Campbell

This article proposes a Bayesian nonparametric method for forecasting, imputation, and clustering in sparsely observed, multivariate time series data. The method is appropriate for jointly modeling hundreds of time series with widely…

Methodology · Statistics 2019-02-27 Feras A. Saad , Vikash K. Mansinghka

This paper presents a fast algorithm for estimating hidden states of Bayesian state space models. The algorithm is a variation of amortized simulation-based inference algorithms, where a large number of artificial datasets are generated at…

Econometrics · Economics 2022-10-14 Ramis Khabibullin , Sergei Seleznev

We present a consensus Monte Carlo algorithm that scales existing Bayesian nonparametric models for clustering and feature allocation to big data. The algorithm is valid for any prior on random subsets such as partitions and latent feature…

Computation · Statistics 2020-02-26 Yang Ni , Yuan Ji , Peter Mueller

The immense computational cost of traditional numerical weather and climate models has sparked the development of machine learning (ML) based emulators. Because ML methods benefit from long records of training data, it is common to use…

Machine Learning · Computer Science 2023-09-25 Timothy A. Smith , Stephen G. Penny , Jason A. Platt , Tse-Chun Chen

In real world machine learning applications, testing data may contain some meaningful new categories that have not been seen in labeled training data. To simultaneously recognize new data categories and assign most appropriate category…

Machine Learning · Computer Science 2019-10-11 Changying Du , Fuzhen Zhuang , Jia He , Qing He , Guoping Long

Simulated annealing is an effective and general means of optimization. It is in fact inspired by metallurgy, where the temperature of a material determines its behavior in thermodynamics. Likewise, in simulated annealing, the actions that…

Machine Learning · Computer Science 2020-07-01 Avrim Blum , Chen Dan , Saeed Seddighin

In this paper, we describe centering and noncentering methodology as complementary techniques for use in parametrization of broad classes of hierarchical models, with a view to the construction of effective MCMC algorithms for exploring…

Methodology · Statistics 2007-08-30 Omiros Papaspiliopoulos , Gareth O. Roberts , Martin Sköld

Penalized B-splines are routinely used in additive models to describe smooth changes in a response with quantitative covariates. It is typically done through the conditional mean in the exponential family using generalized additive models…

Methodology · Statistics 2020-05-12 Philippe Lambert

In Bayesian inference prior hyperparameters are chosen subjectively or estimated using empirical Bayes methods. Generalised Bayesian Inference (GBI) also has a learning rate hyperparameter. This is compounded in Semi-Modular Inference…

In this paper, we study random subsampling of Gaussian process regression, one of the simplest approximation baselines, from a theoretical perspective. Although subsampling discards a large part of training data, we show provable guarantees…

Machine Learning · Statistics 2019-01-29 Kohei Hayashi , Masaaki Imaizumi , Yuichi Yoshida