中文
相关论文

相关论文: Cyclical Stochastic Gradient MCMC for Bayesian Dee…

200 篇论文

Sequential Monte Carlo (SMC) methods comprise one of the most successful approaches to approximate Bayesian filtering. However, SMC without good proposal distributions struggle in high dimensions. We propose nested sequential Monte Carlo…

统计计算 · 统计学 2016-12-30 Christian A. Naesseth , Fredrik Lindsten , Thomas B. Schön

In the stochastic gradient descent (SGD) for sequential simulations such as the neural stochastic differential equations, the Multilevel Monte Carlo (MLMC) method is known to offer better theoretical computational complexity compared to the…

机器学习 · 计算机科学 2023-10-11 Kei Ishikawa

Bayesian Generalized Nonlinear Models (BGNLM) offer a flexible nonlinear alternative to GLM while still providing better interpretability than machine learning techniques such as neural networks. In BGNLM, the methods of Bayesian Variable…

统计计算 · 统计学 2023-12-29 Jon Lachmann , Aliaksandr Hubin

Decision tree learning is a popular approach for classification and regression in machine learning and statistics, and Bayesian formulations---which introduce a prior distribution over decision trees, and formulate learning as posterior…

机器学习 · 统计学 2013-08-26 Balaji Lakshminarayanan , Daniel M. Roy , Yee Whye Teh

Decision trees have found widespread application within the machine learning community due to their flexibility and interpretability. This paper is directed towards learning decision trees from data using a Bayesian approach, which is…

机器学习 · 计算机科学 2023-12-05 Jodie A. Cochrane , Adrian G. Wills , Sarah J. Johnson

Autoencoders gained popularity in the deep learning revolution given their ability to compress data and provide dimensionality reduction. Although prominent deep learning methods have been used to enhance autoencoders, the need to provide…

机器学习 · 计算机科学 2022-04-29 Rohitash Chandra , Mahir Jain , Manavendra Maharana , Pavel N. Krivitsky

Many recent Markov chain Monte Carlo (MCMC) samplers leverage continuous dynamics to define a transition kernel that efficiently explores a target distribution. In tandem, a focus has been on devising scalable variants that subsample the…

统计理论 · 数学 2015-11-03 Yi-An Ma , Tianqi Chen , Emily B. Fox

We propose an empirical Bayes formulation of the structure learning problem, where the prior specification assumes that all node variables have the same error variance, an assumption known to ensure the identifiability of the underlying…

统计计算 · 统计学 2023-08-17 Hyunwoong Chang , James Cai , Quan Zhou

Bayesian inference in deep neural networks is challenging due to the high-dimensional, strongly multi-modal parameter posterior density landscape. Markov chain Monte Carlo approaches asymptotically recover the true posterior but are…

Bayesian models are a powerful tool for studying complex data, allowing the analyst to encode rich hierarchical dependencies and leverage prior information. Most importantly, they facilitate a complete characterization of uncertainty…

机器学习 · 统计学 2023-04-25 Steven Winter , Trevor Campbell , Lizhen Lin , Sanvesh Srivastava , David B. Dunson

Approximate Bayesian inference for models with computationally expensive, black-box likelihoods poses a significant challenge, especially when the posterior distribution is complex. Many inference methods struggle to explore the parameter…

机器学习 · 统计学 2025-11-11 Francesco Silvestrin , Chengkun Li , Luigi Acerbi

Due to their high computational complexity, deep neural networks are still limited to powerful processing units. To promote a reduced model complexity by dint of low-bit fixed-point quantization, we propose a gradient-based optimization…

机器学习 · 计算机科学 2019-07-18 Lukas Enderich , Fabian Timm , Lars Rosenbaum , Wolfram Burgard

A simple and efficient adaptive Markov Chain Monte Carlo (MCMC) method, called the Metropolized Adaptive Subspace (MAdaSub) algorithm, is proposed for sampling from high-dimensional posterior model distributions in Bayesian variable…

统计方法学 · 统计学 2023-01-04 Christian Staerk , Maria Kateri , Ioannis Ntzoufras

In many problems, complex non-Gaussian and/or nonlinear models are required to accurately describe a physical system of interest. In such cases, Monte Carlo algorithms are remarkably flexible and extremely powerful approaches to solve such…

统计计算 · 统计学 2015-04-23 Thi Le Thu Nguyen , Francois Septier , Gareth W. Peters , Yves Delignon

Deriving Bayesian inference for exponential random graph models (ERGMs) is a challenging "doubly intractable" problem as the normalizing constants of the likelihood and posterior density are both intractable. Markov chain Monte Carlo (MCMC)…

统计计算 · 统计学 2019-11-26 Linda S. L. Tan , Nial Friel

Practitioners of Bayesian statistics have long depended on Markov chain Monte Carlo (MCMC) to obtain samples from intractable posterior distributions. Unfortunately, MCMC algorithms are typically serial, and do not scale to the large…

机器学习 · 统计学 2015-06-11 Maxim Rabinovich , Elaine Angelino , Michael I. Jordan

Large crossed mixed effects models with imbalanced structures and missing data pose major computational challenges for standard Bayesian posterior sampling algorithms, as the computational complexity is usually superlinear in the number of…

统计计算 · 统计学 2025-05-12 Xinyu Zhang , Cheng Li

Stochastic differential equations (SDEs) are an important class of time-series models, used to describe stochastic systems evolving in continuous time. Simulating paths from these processes, particularly after conditioning on noisy…

统计计算 · 统计学 2026-02-03 Xinyi Pei , Minhyeok Kim , Vinayak Rao

Deep learning models, such as convolutional neural networks, have long been applied to image and multi-media tasks, particularly those with structured data. More recently, there has been more attention to unstructured data that can be…

机器学习 · 计算机科学 2021-09-17 Rohitash Chandra , Ayush Bhagat , Manavendra Maharana , Pavel N. Krivitsky

Decision trees are flexible models that are well suited for many statistical regression problems. In a Bayesian framework for regression trees, Markov Chain Monte Carlo (MCMC) search algorithms are required to generate samples of tree…

机器学习 · 统计学 2020-10-27 Reza Mohammadi , Matthew Pratola , Maurits Kaptein