中文
相关论文

相关论文: High-Order Stochastic Gradient Thermostats for Bay…

200 篇论文

We show how to speed up Sequential Monte Carlo (SMC) for Bayesian inference in large data problems by data subsampling. SMC sequentially updates a cloud of particles through a sequence of distributions, beginning with a distribution that is…

统计计算 · 统计学 2020-03-25 David Gunawan , Khue-Dung Dang , Matias Quiroz , Robert Kohn , Minh-Ngoc Tran

We propose a new sampler that integrates the protocol of parallel tempering with the Nos\'e-Hoover (NH) dynamics. The proposed method can efficiently draw representative samples from complex posterior distributions with multiple isolated…

机器学习 · 统计学 2018-12-10 Rui Luo , Qiang Zhang , Yuanyuan Liu

The hierarchical Dirichlet process (HDP) has become an important Bayesian nonparametric model for grouped data, such as document collections. The HDP is used to construct a flexible mixed-membership model where the number of components is…

机器学习 · 统计学 2012-01-10 Chong Wang , David M. Blei

Over decades, Markov chain Monte Carlo (MCMC) methods have been widely studied, with a typical application being the quantification of posterior uncertainties in Bayesian system identification of structural dynamic models. To address the…

应用统计 · 统计学 2026-04-28 Xianghao Meng , Yong Huang , James L. Beck , Kui Jiang , Hui Li

Prominent features of simulated moving bed (SMB) chromatography processes in the downstream processing is based on the determination of operating conditions. However, effects of different types of uncertainties have to be studied and…

计算工程、金融与科学 · 计算机科学 2021-07-16 Qiao-Le He , Liming Zhao

We introduce a class of scalable Bayesian hierarchical models for the analysis of massive geostatistical datasets. The underlying idea combines ideas on high-dimensional geostatistics by partitioning the spatial domain and modeling the…

统计方法学 · 统计学 2020-10-09 Michele Peruzzi , Sudipto Banerjee , Andrew O. Finley

Acyclic digraphs are the underlying representation of Bayesian networks, a widely used class of probabilistic graphical models. Learning the underlying graph from data is a way of gaining insights about the structural properties of a…

机器学习 · 统计学 2022-05-06 Jack Kuipers , Giusi Moffa

Markov chain Monte Carlo (MCMC) is the predominant tool used in Bayesian parameter estimation for hierarchical models. When the model expands due to an increasing number of hierarchical levels, number of groups at a particular level, or…

统计计算 · 统计学 2016-06-22 Will Landau , Jarad Niemi

The need to calibrate increasingly complex statistical models requires a persistent effort for further advances on available, computationally intensive Monte Carlo methods. We study here an advanced version of familiar Markov Chain Monte…

统计方法学 · 统计学 2015-03-20 Alexandros Beskos , Konstantinos Kalogeropoulos , Erik Pazos

Stochastic gradient descent (SGD) holds as a classical method to build large scale machine learning models over big data. A stochastic gradient is typically calculated from a limited number of samples (known as mini-batch), so it…

机器学习 · 计算机科学 2016-01-14 Yadong Mu , Wei Liu , Wei Fan

We develop an approach for Bayesian learning of spatiotemporal dynamical mechanistic models. Such learning consists of statistical emulation of the mechanistic system that can efficiently interpolate the output of the system from arbitrary…

统计方法学 · 统计学 2025-07-11 Sudipto Banerjee , Xiang Chen , Ian Frankenburg , Daniel Zhou

Bayesian inverse problems arise in various scientific and engineering domains, and solving them can be computationally demanding. This is especially the case for problems governed by partial differential equations, where the repeated…

数值分析 · 数学 2025-11-04 Juntao Yang , Jeff Adie , Simon See , Adriano Gualandi , Gianmarco Mengaldo

The problem of posterior inference is central to Bayesian statistics and a wealth of Markov Chain Monte Carlo (MCMC) methods have been proposed to obtain asymptotically correct samples from the posterior. As datasets in applications grow…

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the…

机器学习 · 计算机科学 2021-10-18 Lenart Treven , Philippe Wenk , Florian Dörfler , Andreas Krause

The problem of optimising functions with intractable gradients frequently arise in machine learning and statistics, ranging from maximum marginal likelihood estimation procedures to fine-tuning of generative models. Stochastic approximation…

机器学习 · 统计学 2026-01-30 James Cuin , Davide Carbone , Yanbo Tang , O. Deniz Akyildiz

Stochastic kinetic models are ubiquitous in physics, yet inferring their parameters from experimental data remains challenging. In deterministic models, parameter inference often relies on gradients, as they can be obtained efficiently…

计算物理 · 物理学 2026-04-03 Ludwig Burger , Annalena Kofler , Lukas Heinrich , Ulrich Gerland

Stochastic gradient descent in continuous time (SGDCT) provides a computationally efficient method for the statistical learning of continuous-time models, which are widely used in science, engineering, and finance. The SGDCT algorithm…

概率论 · 数学 2017-10-31 Justin Sirignano , Konstantinos Spiliopoulos

We propose a novel adaptive empirical Bayesian method for sparse deep learning, where the sparsity is ensured via a class of self-adaptive spike-and-slab priors. The proposed method works by alternatively sampling from an adaptive…

机器学习 · 统计学 2020-04-15 Wei Deng , Xiao Zhang , Faming Liang , Guang Lin

Gaussian and discrete non-Gaussian spatial datasets are common across fields like public health, ecology, geosciences, and social sciences. Bayesian spatial generalized linear mixed models (SGLMMs) are a flexible class of models for…

统计方法学 · 统计学 2025-01-27 Jin Hyung Lee , Ben Seiyon Lee

Posterior sampling is a task of central importance in Bayesian inference. For many applications in Bayesian meta-analysis and Bayesian transfer learning, the prior distribution is unknown and needs to be estimated from samples. In practice,…

统计计算 · 统计学 2024-08-06 Chenyang Zhong , Shouxuan Ji , Tian Zheng