English
Related papers

Related papers: Replica-exchange Nos\'e-Hoover dynamics for Bayesi…

200 papers

This paper considers multiple binary hypothesis tests with adaptive allocation of sensing resources from a shared budget over a small number of stages. A Bayesian formulation is provided for the multistage allocation problem of minimizing…

Methodology · Statistics 2014-11-05 Dennis Wei

We propose a novel Bayesian model selection technique on linear mixed-effects models to compare multiple treatments with a control. A fully Bayesian approach is implemented to estimate the marginal inclusion probabilities that provide a…

Applications · Statistics 2015-09-28 Lei Gong , James M. Flegal , Stephen R. Spindler , Patricia L. Mote

High-dimensional deep neural network representations of images and concepts can be aligned to predict human annotations of diverse stimuli. However, such alignment requires the costly collection of behavioral responses, such that, in…

Artificial Intelligence · Computer Science 2023-06-09 Yangyang Yu , Jordan W. Suchow

There is significant interest in learning and optimizing a complex system composed of multiple sub-components, where these components may be agents or autonomous sensors. Among the rich literature on this topic, agent-based and…

Machine Learning · Computer Science 2021-07-08 Kai Wang , Bryan Wilder , Sze-chuan Suen , Bistra Dilkina , Milind Tambe

Bayesian data analysis is widely used across many disciplines, and representative examples in materials science include spectral analysis and sparse modeling. In such applications, the underlying models often become complex and yield…

Information Theory · Computer Science 2026-03-04 Tomohiro Nabika , Kenji Nagata , Shun Katakami , Masaichiro Mizumaki , Masato Okada

We present a novel model architecture which leverages deep learning tools to perform exact Bayesian inference on sets of high dimensional, complex observations. Our model is provably exchangeable, meaning that the joint distribution over…

Machine Learning · Statistics 2018-10-17 Iryna Korshunova , Jonas Degrave , Ferenc Huszár , Yarin Gal , Arthur Gretton , Joni Dambre

We study Bayesian hypernetworks: a framework for approximate Bayesian inference in neural networks. A Bayesian hypernetwork $\h$ is a neural network which learns to transform a simple noise distribution, $p(\vec\epsilon) = \N(\vec 0,\mat…

Machine Learning · Statistics 2018-04-26 David Krueger , Chin-Wei Huang , Riashat Islam , Ryan Turner , Alexandre Lacoste , Aaron Courville

The inverse temperature parameter of the Potts model governs the strength of spatial cohesion and therefore has a major influence over the resulting model fit. A difficulty arises from the dependence of an intractable normalising constant…

Computation · Statistics 2018-08-20 Matthew T. Moores , Geoff K. Nicholls , Anthony N. Pettitt , Kerrie Mengersen

Humans learn efficiently from their environment by engaging multiple interacting neural systems that support distinct yet complementary forms of control, including model-based (goal-directed) planning, model-free (habitual) responding, and…

Machine Learning · Computer Science 2026-02-02 Babak Shahbaba , Zahra Moslemi

We consider the model of cooperative learning via distributed non-Bayesian learning, where a network of agents tries to jointly agree on a hypothesis that best described a sequence of locally available observations. Building upon recently…

Optimization and Control · Mathematics 2020-10-21 Eduardo Mojica-Nava , David Yanguas-Rojas , César A. Uribe

Bayesian optimization (BO) is a sample efficient approach to automatically tune the hyperparameters of machine learning models. In practice, one frequently has to solve similar hyperparameter tuning problems sequentially. For example, one…

Machine Learning · Computer Science 2021-02-26 Samuel Horváth , Aaron Klein , Peter Richtárik , Cédric Archambeau

We analyze the dynamics of an algorithm for approximate inference with large Gaussian latent variable models in a student-teacher scenario. To model nontrivial dependencies between the latent variables, we assume random covariance matrices…

Machine Learning · Computer Science 2020-08-26 Burak Çakmak , Manfred Opper

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than…

Machine Learning · Statistics 2022-09-07 Joel Janek Dabrowski , Daniel Edward Pagendam

Noise is usually regarded as adversarial to extract the effective dynamics from time series, such that the conventional data-driven approaches usually aim at learning the dynamics by mitigating the noisy effect. However, noise can have a…

Adaptation and Self-Organizing Systems · Physics 2023-09-12 Zequn Lin , Zhaofan Lu , Zengru Di , Ying Tang

Scenarios requiring humans to choose from multiple seemingly optimal actions are commonplace, however standard imitation learning often fails to capture this behavior. Instead, an over-reliance on replicating expert actions induces…

Robotics · Computer Science 2022-11-08 Hanbit Oh , Hikaru Sasaki , Brendan Michael , Takamitsu Matsubara

Recursive Bayesian inference, in which posterior beliefs are updated in light of accumulating data, is a tool for implementing Bayesian models in applications with streaming and/or very large data sets. As the posterior of one iteration…

Methodology · Statistics 2025-08-05 Henry R. Scharf

We discuss the possibility of implementing asynchronous replica-exchange (or parallel tempering) molecular dynamics. In our scheme, the exchange attempts are driven by asynchronous messages sent by one of the computing nodes, so that…

Computational Physics · Physics 2009-11-23 Giovanni Bussi

In this work, we introduce a generalized framework for multiscale state-space modeling that incorporates nested nonlinear dynamics, with a specific focus on Bayesian learning under switching regimes. Our framework captures the complex…

Machine Learning · Statistics 2024-10-31 Nayely Vélez-Cruz , Manfred D. Laubichler

Classic Bayesian methods with complex models are frequently infeasible due to an intractable likelihood. Simulation-based inference methods, such as Approximate Bayesian Computing (ABC), calculate posteriors without accessing a likelihood…

Computation · Statistics 2026-01-09 Elliot Maceda , Emily C. Hector , Amanda Lenzi , Brian J. Reich

Reinforcement learning methods are increasingly used to optimise dialogue policies from experience. Most current techniques are model-free: they directly estimate the utility of various actions, without explicit model of the interaction…

Artificial Intelligence · Computer Science 2013-04-09 Pierre Lison