English
Related papers

Related papers: Accuracy criterion for mean field approximations o…

200 papers

Solving the error correcting code is an important goal with regard to communication theory.To reveal the error correcting code characteristics, several researchers have applied a statistical-mechanical approach to this problem. In our…

Disordered Systems and Neural Networks · Physics 2007-05-23 Masami Takata , Hayaru Shouno , Kazuki Joe , Masato Okada

For a class of $\zz^2$ Markov Random Fields (MRFs) $\mu$, we show that the sequence of successive differences of entropies of induced MRFs on strips of height $n$ converges exponentially fast (in $n$) to the entropy of $\mu$. These strip…

Dynamical Systems · Mathematics 2010-09-17 Brian Marcus , Ronnie Pavlov

Markov Random Fields (MRFs), a formulation widely used in generative image modeling, have long been plagued by the lack of expressive power. This issue is primarily due to the fact that conventional MRFs formulations tend to use simplistic…

Computer Vision and Pattern Recognition · Computer Science 2016-09-08 Zhirong Wu , Dahua Lin , Xiaoou Tang

We consider a population of $N$ individuals, of which we observe the number of actions as time evolves. For each couple of individuals $(i,j)$, $j$ may or not influence $i$, which we model by i.i.d. Bernoulli$(p)$-random variables, for some…

Statistics Theory · Mathematics 2016-01-28 Sylvain Delattre , Nicolas Fournier

Belief Propagation (BP) is a widely used approximation for exact probabilistic inference in graphical models, such as Markov Random Fields (MRFs). In graphs with cycles, however, no exact convergence guarantees for BP are known, in general.…

Artificial Intelligence · Computer Science 2016-12-28 Wolfgang Gatterbauer

We introduce an extension of the dynamical mean field approximation (DMFA) which retains the causal properties and generality of the DMFA, but allows for systematic inclusion of non-local corrections. Our technique maps the problem to a…

Strongly Correlated Electrons · Physics 2009-10-31 M. H. Hettler , A. N. Tahvildar-Zadeh , M. Jarrell , T. Pruschke , H. R. Krishnamurthy

It has been shown in the past that many real-world networks exhibit community structures and non-trivial clustering which comes with the occurrence of a notable number of triangular connections. Yet the influence of such connection patterns…

Physics and Society · Physics 2016-10-25 Ilja Rausch

Multi-agent coordination algorithms with randomized interactions have seen use in a variety of settings in the multi-agent systems literature. In some cases, these algorithms can be random by design, as in a gossip-like algorithm, and in…

Optimization and Control · Mathematics 2017-03-22 Matthew T. Hale , Magnus Egerstedt

We present an information-based uncertainty quantification method for general Markov Random Fields. Markov Random Fields (MRF) are structured, probabilistic graphical models over undirected graphs, and provide a fundamental unifying…

Machine Learning · Statistics 2021-07-20 Panagiota Birmpa , Markos A. Katsoulakis

Mean-field games (MFGs) are a modeling framework for systems with a large number of interacting agents. They have applications in economics, finance, and game theory. Normalizing flows (NFs) are a family of deep generative models that…

Optimization and Control · Mathematics 2023-05-24 Han Huang , Jiajia Yu , Jie Chen , Rongjie Lai

Discrete Markov random fields form a natural class of models to represent images and spatial data sets. The use of such models is, however, hampered by a computationally intractable normalising constant. This makes parameter estimation and…

Computation · Statistics 2015-05-25 Haakon Michael Austad , Håkon Tjelmeland

In the paper, the approximate sequence for entropy of some binary hidden Markov models has been found to have two bound sequences, the low bound sequence and the upper bound sequence. The error bias of the approximate sequence is bound by a…

Information Theory · Computer Science 2011-12-30 Shuangping Chen , Jun Li , Mi Zhou

The fault tolerance of random graphs with unbounded degrees with respect to connectivity is investigated, which relates to the reliability of wireless sensor networks with unreliable relay nodes. The model evaluates the network breakdown…

Disordered Systems and Neural Networks · Physics 2019-06-05 Satoshi Takabe , Takafumi Nakano , Tadashi Wadayama

A number of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov random field. Belief propagation, an iterative message-passing algorithm, computes exactly such…

Machine Learning · Statistics 2012-10-23 Victorin Martin , Jean-Marc Lasgouttes , Cyril Furtlehner

This paper studies a large number of homogeneous Markov decision processes where the transition probabilities and costs are coupled in the empirical distribution of states (also called mean-field). The state of each process is not known to…

Optimization and Control · Mathematics 2020-12-03 Jalal Arabneydi , Amir G. Aghdam

In this paper, we propose a method called Convolutional Neural Network-Markov Random Field (CNN-MRF) to estimate the crowd count in a still image. We first divide the dense crowd visible image into overlapping patches and then use a deep…

Computer Vision and Pattern Recognition · Computer Science 2017-10-18 Kang Han , Wanggen Wan , Haiyan Yao , Li Hou

The mean-field limit in a weakly interacting stochastic many-particle system for multiple population species in the whole space is proved. The limiting system consists of cross-diffusion equations, modeling the segregation of populations.…

Analysis of PDEs · Mathematics 2019-09-04 Li Chen , Esther S. Daus , Ansgar Jüngel

Opinion and belief dynamics are a central topic in the study of social interactions through dynamical systems. In this work, we study a model where, at each discrete time, all the agents update their opinion as an average of their intrinsic…

Optimization and Control · Mathematics 2024-12-05 Javiera Gutiérrez-Ramírez , David Salas , Victor Verdugo

We investigate local-density dependent Markov processes on a class of large graphs sampled from a graphon, where the transition rates of the vertices are influenced by the states of their neighbors. We show that as the average degree…

Probability · Mathematics 2020-11-24 Daniel Keliger , Illes Horvath , Balint Takacs

Continuous-time Bayesian networks is a natural structured representation language for multicomponent stochastic processes that evolve continuously over time. Despite the compact representation, inference in such models is intractable even…

Artificial Intelligence · Computer Science 2012-05-14 Ido Cohn , Tal El-Hay , Nir Friedman , Raz Kupferman