English
Related papers

Related papers: Streaming, Distributed Variational Inference for B…

200 papers

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using…

Machine Learning · Statistics 2019-05-28 Aliaksandr Hubin , Geir Storvik

The present study proposes incorporating non-parametric knowledge into the diffusion least-mean-squares algorithm in the framework of a maximum a posteriori (MAP) estimation. The proposed algorithm leads to a robust estimation of an unknown…

Machine Learning · Computer Science 2023-12-05 Soheil Ashkezari-Toussi , Hadi sadoghi-Yazdi

We introduce a methodology for performing parameter inference in high-dimensional, non-linear diffusion processes. We illustrate its applicability for obtaining insights into the evolution of and relationships between species, including…

Machine Learning · Statistics 2024-11-15 Nicklas Boserup , Gefan Yang , Michael Lind Severinsen , Christy Anna Hipsley , Stefan Sommer

Bayesian neural network models (BNN) have re-surged in recent years due to the advancement of scalable computations and its utility in solving complex prediction problems in a wide variety of applications. Despite the popularity and…

Machine Learning · Statistics 2020-11-20 Shrijita Bhattacharya , Zihuan Liu , Tapabrata Maiti

Using nonparametric methods has been increasingly explored in Bayesian hierarchical modeling as a way to increase model flexibility. Although the field shows a lot of promise, inference in many models, including Hierachical Dirichlet…

Machine Learning · Statistics 2015-01-19 Alexander Spangher

Individual-based models of contagious processes are useful for predicting epidemic trajectories and informing intervention strategies. In such models, the incorporation of contact network information can capture the non-randomness and…

Populations and Evolution · Quantitative Biology 2023-11-09 Maxwell H. Wang , Jukka-Pekka Onnela

We study network response to queries that require computation of remotely located data and seek to characterize the performance limits in terms of maximum sustainable query rate that can be satisfied. The available resources include (i) a…

Networking and Internet Architecture · Computer Science 2016-11-17 Apostolos Destounis , Georgios S. Paschos , Iordanis Koutsopoulos

We perform differential expression analysis of high-throughput sequencing count data under a Bayesian nonparametric framework, removing sophisticated ad-hoc pre-processing steps commonly required in existing algorithms. We propose to use…

Applications · Statistics 2017-05-04 Siamak Zamani Dadaneh , Xiaoning Qian , Mingyuan Zhou

Nested sampling (NS) computes parameter posterior distributions and makes Bayesian model comparison computationally feasible. Its strengths are the unsupervised navigation of complex, potentially multi-modal posteriors until a well-defined…

Computation · Statistics 2023-07-11 Johannes Buchner

Frequency estimation in data streams is one of the classical problems in streaming algorithms. Following much research, there are now almost matching upper and lower bounds for the trade-off needed between the number of samples and the…

Computational Complexity · Computer Science 2023-01-16 Shachar Lovett , Jiapeng Zhang

Variational Bayesian Inference is a popular methodology for approximating posterior distributions over Bayesian neural network weights. Recent work developing this class of methods has explored ever richer parameterizations of the…

Consider a heterogeneous data stream being generated by the nodes of a graph. The data stream is in essence composed by multiple streams, possibly of different nature that depends on each node. At a given moment $\tau$, a change-point…

Machine Learning · Statistics 2021-10-22 Alejandro de la Concha , Argyris Kalogeratos , Nicolas Vayatis

In the past few years, approximate Bayesian Neural Networks (BNNs) have demonstrated the ability to produce statistically consistent posteriors on a wide range of inference problems at unprecedented speed and scale. However, any disconnect…

Cosmology and Nongalactic Astrophysics · Physics 2021-03-24 Sebastian Wagner-Carena , Ji Won Park , Simon Birrer , Philip J. Marshall , Aaron Roodman , Risa H. Wechsler

Mediation analysis with contemporaneously observed multiple mediators is an important area of causal inference. Recent approaches for multiple mediators are often based on parametric models and thus may suffer from model misspecification.…

Methodology · Statistics 2022-08-30 Samrat Roy , Michael J. Daniels , Brendan J. Kelly , Jason Roy

We propose a method to approximate the distribution of robot configurations satisfying multiple objectives. Our approach uses variational inference, a popular method in Bayesian computation, which has several advantages over sampling-based…

Robotics · Computer Science 2019-11-25 Emmanuel Pignat , Teguh Lembono , Sylvain Calinon

We present a continuation method that entails generating a sequence of transition probability density functions from the prior to the posterior in the context of Bayesian inference for parameter estimation problems. The characterization of…

Computation · Statistics 2019-11-27 Ben Mansour Dia

The global inducing point variational approximation for BNNs is based on using a set of inducing inputs to construct a series of conditional distributions that accurately approximate the conditionals of the true posterior distribution. Our…

Machine Learning · Statistics 2023-10-25 Matthew Ashman , Tommy Rochussen , Adrian Weller

This paper re-examines the problem of parameter estimation in Bayesian networks with missing values and hidden variables from the perspective of recent work in on-line learning [Kivinen & Warmuth, 1994]. We provide a unified framework for…

Machine Learning · Computer Science 2013-02-08 Eric Bauer , Daphne Koller , Yoram Singer

Non-linear hierarchical models are commonly used in many disciplines. However, inference in the presence of non-nested effects and on large datasets is challenging and computationally burdensome. This paper provides two contributions to…

Methodology · Statistics 2021-10-22 Max Goplerud

We present a method that models the evolution of an unbounded number of time series clusters by switching among an unknown number of regimes with linear dynamics. We develop a Bayesian non-parametric approach using a hierarchical Dirichlet…

Machine Learning · Statistics 2025-10-09 Adrián Pérez-Herrero , Paulo Félix , Jesús Presedo , Carl Henrik Ek