English
Related papers

Related papers: Resummed mean-field inference for strongly coupled…

200 papers

This article presents a novel, general, and effective simulation-inspired approach, called {\it repro samples method}, to conduct statistical inference. The approach studies the performance of artificial samples, referred to as {\it repro…

Methodology · Statistics 2022-06-15 Min-ge Xie , Peng Wang

We present a new method for estimating the expected return of a POMDP from experience. The method does not assume any knowledge of the POMDP and allows the experience to be gathered from an arbitrary sequence of policies. The return is…

Artificial Intelligence · Computer Science 2013-01-14 Christian R. Shelton

We consider the problem of distributed average consensus in a sensor network where sensors exchange quantized information with their neighbors. We propose a novel quantization scheme that exploits the increasing correlation between the…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-03-22 Dorina Thanou , Effrosyni Kokiopoulou , Pascal Frossard

In the setting of entangled single-sample distributions, the goal is to estimate some common parameter shared by a family of distributions, given one \emph{single} sample from each distribution. We study mean estimation and linear…

Machine Learning · Computer Science 2020-07-08 Hui Yuan , Yingyu Liang

Stochastic variational inference makes it possible to approximate posterior distributions induced by large datasets quickly using stochastic optimization. The algorithm relies on the use of fully factorized variational distributions.…

Machine Learning · Computer Science 2014-11-27 Matthew D. Hoffman , David M. Blei

We introduce an exact replica method for the study of critical systems with quenched bond randomness in two dimensions. For the $q$-state Potts model we show that a line of renormalization group fixed points interpolates from weak to strong…

Statistical Mechanics · Physics 2017-06-28 Gesualdo Delfino

We consider continuous-time sparse stochastic processes from which we have only a finite number of noisy/noiseless samples. Our goal is to estimate the noiseless samples (denoising) and the signal in-between (interpolation problem). By…

Machine Learning · Computer Science 2015-06-11 Arash Amini , Ulugbek S. Kamilov , Emrah Bostan , Michael Unser

We analyze the emergent regimes and the stimulus-response relationship of a population of noisy map neurons by means of a mean-field model, derived within the framework of cumulant approach complemented by the Gaussian closure hypothesis.…

Chaotic Dynamics · Physics 2017-09-13 Igor Franovic , Oleg V. Maslennikov , Iva Bacic , Vladimir I. Nekorkin

The typical approach for recovery of spatially correlated signals is regularized least squares with a coupled regularization term. In the Bayesian framework, this algorithm is seen as a maximum-a-posterior estimator whose postulated prior…

Information Theory · Computer Science 2018-05-31 Ali Bereyhi , Saeid Haghighatshoar , Ralf R. Müller

Network structures are reconstructed from dynamical data by respectively naive mean field (nMF) and Thouless-Anderson-Palmer (TAP) approximations. For TAP approximation, we use two methods to reconstruct the network: a) iteration method; b)…

Computation · Statistics 2015-05-20 Hong-Li Zeng , Erik Aurell , Mikko Alava , Hamed Mahmoudi

We consider the approximations behind the typical mean-field model derived for a class of systems made up of type II excitable units influenced by noise and coupling delays. The formulation of the two approximations, referred to as the…

Chaotic Dynamics · Physics 2015-06-18 I. Franovic , K. Todorovic , N. Vasovic , N. Buric

The improvement of resummation algorithms for divergent perturbative expansions in quantum field theory by asymptotic information about perturbative coefficients is investigated. Various asymptotically optimized resummation prescriptions…

High Energy Physics - Phenomenology · Physics 2008-11-26 U. D. Jentschura , E. J. Weniger , G. Soff

We consider an application of probabilistic coupling techniques which provides explicit estimates for comparison of local expectation values between label permutation invariant states, for instance, between certain microcanonical,…

Mathematical Physics · Physics 2020-08-26 Kalle Koskinen , Jani Lukkarinen

We describe how the couplings in an asynchronous kinetic Ising model can be inferred. We consider two cases, one in which we know both the spin history and the update times and one in which we only know the spin history. For the first case,…

Data Analysis, Statistics and Probability · Physics 2015-06-11 Hong-Li Zeng , Mikko Alava , Erik Aurell , John Hertz , Yasser Roudi

An artificial intelligence (AI) model can be viewed as a function that maps inputs to outputs in high-dimensional spaces. Once designed and well trained, the AI model is applied for inference. However, even optimized AI models can produce…

Artificial Intelligence · Computer Science 2026-02-27 Sha Hu

In this paper, we derive tail approximations of integrals of exponential functions of Gaussian random fields with varying mean functions and approximations of the associated point processes. This study is motivated naturally by multiple…

Statistics Theory · Mathematics 2011-12-05 Jingchen Liu , Gongjun Xu

Consider the problem of joint parameter estimation and prediction in a Markov random field: i.e., the model parameters are estimated on the basis of an initial set of data, and then the fitted model is used to perform prediction (e.g.,…

Machine Learning · Computer Science 2007-07-13 Martin J. Wainwright

Random fields are useful mathematical tools for representing natural phenomena with complex dependence structures in space and/or time. In particular, the Gaussian random field is commonly used due to its attractive properties and…

In this paper, we provide a general methodology to draw statistical inferences on individual signal coordinates or linear combinations of them in sparse phase retrieval. Given an initial estimator for the targeting parameter (some simple…

Methodology · Statistics 2020-09-29 Yisha Yao

Approximating marginals of a graphical model is one of the fundamental problems in the theory of networks. In a recent paper a method was shown to construct a variational free energy such that the linear response estimates, and maximum…

Disordered Systems and Neural Networks · Physics 2014-05-01 Jack Raymond , Federico Ricci-Tersenghi