English
Related papers

Related papers: Truly Bayesian Entropy Estimation

200 papers

We propose a novel method for approximate inference in Bayesian networks (BNs). The idea is to sample data from a BN, learn a latent tree model (LTM) from the data offline, and when online, make inference with the LTM instead of the…

Machine Learning · Computer Science 2014-01-16 Yi Wang , Nevin L. Zhang , Tao Chen

The profile of a sample is the multiset of its symbol frequencies. We show that for samples of discrete distributions, profile entropy is a fundamental measure unifying the concepts of estimation, inference, and compression. Specifically,…

Machine Learning · Statistics 2020-02-27 Yi Hao , Alon Orlitsky

Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use…

Numerical Analysis · Mathematics 2016-01-20 Matthias Morzfeld , Xuemin Tu , Jon Wilkening , Alexandre J. Chorin

We demonstrate that a number of sociology models for social network dynamics can be viewed as continuous time Bayesian networks (CTBNs). A sampling-based approximate inference method for CTBNs can be used as the basis of an…

Social and Information Networks · Computer Science 2012-05-14 Yu Fan , Christian R. Shelton

Consider a Bayesian situation in which we observe $Y \sim p_{\theta}$, where $\theta \in \Theta$, and we have a family $\{ \nu_h, \, h \in \mathcal{H} \}$ of potential prior distributions on $\Theta$. Let $g$ be a real-valued function of…

Methodology · Statistics 2018-07-09 Hani Doss , Yeonhee Park

Uncertainty of decisions in safety-critical engineering applications can be estimated on the basis of the Bayesian Markov Chain Monte Carlo (MCMC) technique of averaging over decision models. The use of decision tree (DT) models assists…

Artificial Intelligence · Computer Science 2010-12-03 Vitaly Schetinin , Jonathan Fieldsend , Derek Partridge , Wojtek Krzanowski , Richard Everson , Trevor Bailey , Adolfo Hernandez

Partly motivated by entropy-estimation problems in neuroscience, we present a detailed and extensive comparison between some of the most popular and effective entropy estimation methods used in practice: The plug-in method, four different…

Information Theory · Computer Science 2015-05-13 Y. Gao , I. Kontoyiannis , E. Bienenstock

Individual-based models of contagious processes are useful for predicting epidemic trajectories and informing intervention strategies. In such models, the incorporation of contact network information can capture the non-randomness and…

Populations and Evolution · Quantitative Biology 2023-11-09 Maxwell H. Wang , Jukka-Pekka Onnela

Given a locally consistent set of reduced density matrices, we construct approximate density matrices which are globally consistent with the local density matrices we started from when the trial density matrix has a tree structure. We…

Disordered Systems and Neural Networks · Physics 2015-06-18 I. Biazzo , A. Ramezanpour

How can one perform Bayesian inference on stochastic simulators with intractable likelihoods? A recent approach is to learn the posterior from adaptively proposed simulations using neural network-based conditional density estimators.…

Machine Learning · Computer Science 2019-05-21 David S. Greenberg , Marcel Nonnenmacher , Jakob H. Macke

A Bayesian approach is presented for detecting and characterising the signal from discrete objects embedded in a diffuse background. The approach centres around the evaluation of the posterior distribution for the parameters of the discrete…

Astrophysics · Physics 2009-11-07 M. P. Hobson , C. McLachlan

The Shannon entropy is a fundamental measure for quantifying diversity and model complexity in fields such as information theory, ecology, and genetics. However, many existing studies assume that the number of species is known, an…

Methodology · Statistics 2026-02-23 Takato Hashino , Koji Tsukuda

Network inference has been extensively studied in several fields, such as systems biology and social sciences. Learning network topology and internal dynamics is essential to understand mechanisms of complex systems. In particular, sparse…

Machine Learning · Statistics 2022-06-13 Yasen Wang , Junyang Jin , Jorge Goncalves

Entropy estimation is of practical importance in information theory and statistical science. Many existing entropy estimators suffer from fast growing estimation bias with respect to dimensionality, rendering them unsuitable for…

Information Theory · Computer Science 2023-08-22 Ziqiao Ao , Jinglai Li

We target the problem of accuracy and robustness in causal inference from finite data sets. Some state-of-the-art algorithms produce clear output complete with solid theoretical guarantees but are susceptible to propagating erroneous…

Artificial Intelligence · Computer Science 2012-10-19 Tom Claassen , Tom Heskes

Measuring the predictability and complexity of time series using entropy is essential tool de-signing and controlling a nonlinear system. However, the existing methods have some drawbacks related to the strong dependence of entropy on the…

Machine Learning · Computer Science 2022-01-14 Andrei Velichko , Hanif Heidari

Transfer entropy has been used to quantify the directed flow of information between source and target variables in many complex systems. While transfer entropy was originally formulated in discrete time, in this paper we provide a framework…

Information Theory · Computer Science 2017-04-05 Richard E. Spinney , Mikhail Prokopenko , Joseph T. Lizier

Epidemics are inherently stochastic, and stochastic models provide an appropriate way to describe and analyse such phenomena. Given temporal incidence data consisting of, for example, the number of new infections or removals in a given time…

Methodology · Statistics 2024-05-24 Sam A. Whitaker , Andrew Golightly , Colin S. Gillespie , Theodore Kypraios

Information theory on a time-discrete setting in the framework of time series analysis is generalized to the time-continuous case. Considerations of the Roessler and Lorenz dynamics as well as the Ornstein-Uhlenbeck process yield for…

Chaotic Dynamics · Physics 2008-06-04 Detlef Holstein

We consider the analysis of sets of categorical sequences consisting of piecewise homogeneous Markov segments. The sequences are assumed to be governed by a common underlying process with segments occurring in the same order for each…

Methodology · Statistics 2015-04-08 Petter Arnesen , Tracy Holsclaw , Padhraic Smyth