English
Related papers

Related papers: Message passing algorithms for the Hopfield networ…

200 papers

Affinity propagation is an exemplar-based clustering algorithm that finds a set of data-points that best exemplify the data, and associates each datapoint with one exemplar. We extend affinity propagation in a principled way to solve the…

Machine Learning · Computer Science 2012-02-20 Inmar Givoni , Clement Chung , Brendan J. Frey

We study a class of Hopfield models where the memories are represented by a mixture of Gaussian and binary variables and the neurons are Ising spins. We study the properties of this family of models as the relative weight of the two kinds…

Disordered Systems and Neural Networks · Physics 2022-09-29 Luca Leuzzi , Alberto Patti , Federico Ricci-Tersenghi

Through a redefinition of patterns in an Hopfield-like model, we introduce and develop an approach to model discrete systems made up of many, interacting components with inner degrees of freedom. Our approach clarifies the intrinsic…

Statistical Mechanics · Physics 2015-05-19 Elena Agliari , Adriano Barra

The problem of communicating sensor measurements over shared networks is prevalent in many modern large-scale distributed systems such as cyber-physical systems, wireless sensor networks, and the internet of things. Due to bandwidth…

Systems and Control · Electrical Eng. & Systems 2021-12-14 Marcos M. Vasconcelos

The random field Ising model with Gaussian disorder is studied using a new Monte Carlo algorithm. The algorithm combines the advantanges of the replica exchange method and the two-replica cluster method and is much more efficient than the…

Statistical Mechanics · Physics 2009-10-31 Jon Machta , Mark Newman , Lincoln Chayes

We propose a framework for the derivation and evaluation of distributed iterative algorithms for receiver cooperation in interference-limited wireless systems. Our approach views the processing within and collaboration between receivers as…

Information Theory · Computer Science 2012-04-18 Mihai-Alin Badiu , Carles Navarro Manchón , Vasile Bota , Bernard Henri Fleury

Information spreads across social and technological networks, but often the network structures are hidden from us and we only observe the traces left by the diffusion processes, called cascades. Can we recover the hidden network structures…

Social and Information Networks · Computer Science 2014-05-14 Hadi Daneshmand , Manuel Gomez-Rodriguez , Le Song , Bernhard Schoelkopf

The document covers the fundamental algorithm of backward propagation from the point of view of reconstructing the wavefield captured by a "screen" in an imaging system. Owing to a property of the Helmholtz equation, wavefields have an…

Image and Video Processing · Electrical Eng. & Systems 2020-04-20 Anurag Pallaprolu

Using probabilistic approach, the transient dynamics of sparsely connected Hopfield neural networks is studied for arbitrary degree distributions. A recursive scheme is developed to determine the time evolution of overlap parameters. As…

Disordered Systems and Neural Networks · Physics 2011-11-09 Pan Zhang , Yong Chen

Various iterative reconstruction algorithms for inverse problems can be unfolded as neural networks. Empirically, this approach has often led to improved results, but theoretical guarantees are still scarce. While some progress on…

Statistics Theory · Mathematics 2021-08-16 Arash Behboodi , Holger Rauhut , Ekkehard Schnoor

We consider a class of random, weighted networks, obtained through a redefinition of patterns in an Hopfield-like model and, by performing percolation processes, we get information about topology and resilience properties of the networks…

Statistical Mechanics · Physics 2015-05-30 Elena Agliari , Claudia Cioli , Enore Guadagnini

In a recent paper, the authors proposed a new class of low-complexity iterative thresholding algorithms for reconstructing sparse signals from a small set of linear measurements \cite{DMM}. The new algorithms are broadly referred to as AMP,…

Information Theory · Computer Science 2009-11-24 David L. Donoho , Arian Maleki , Andrea Montanari

We consider a generalization of the Hopfield model, where the entries of patterns are Gaussian and diluted. We focus on the high-storage regime and we investigate analytically the topological properties of the emergent network, as well as…

Disordered Systems and Neural Networks · Physics 2012-09-28 Elena Agliari , Lorenzo Asti , Adriano Barra , Raffaella Burioni , Guido Uguzzoni

It is in practice impossible to describe the topology of a real network or its message propagation process using a single dynamic model. To address this issue, we constructed a new hybrid network model based on scale-free (SF), small-world…

Social and Information Networks · Computer Science 2021-06-01 Fuzhong Nian , Hongyuan Diao

The paper observes the Hermite and the Fourier Transform domains in terms of Frequency Hopping Spread Spectrum signals sparsification. Sparse signals can be recovered from a reduced set of samples by using the Compressive Sensing approach.…

Signal Processing · Electrical Eng. & Systems 2018-02-15 Valentina Konatar , Maja Vesovic

This work is driven by the ubiquitous dissent over the abilities and contributions of the Metropolis-Hastings and reversible jump algorithm within the context of trans dimensional sampling. We demystify this topic by taking a deeper look…

Statistics Theory · Mathematics 2019-08-05 Tobias Siems , Lisa Koeppel

In this paper we analyze the performance of Warning Propagation, a popular message passing algorithm. We show that for 3CNF formulas drawn from a certain distribution over random satisfiable 3CNF formulas, commonly referred to as the…

Probability · Mathematics 2010-12-30 Uriel Feige , Elchanan Mossel , Dan Vilenchik

As Internet of Things (IoT) devices become both cheaper and more powerful, researchers are increasingly finding solutions to their scientific curiosities both financially and computationally feasible. When operating with restricted power or…

Signal Processing · Electrical Eng. & Systems 2022-06-16 Gary Koplik , Nathan Borggren , Sam Voisin , Gabrielle Angeloro , Jay Hineman , Tessa Johnson , Paul Bendich

We present new message passing algorithms for performing inference with graphical models. Our methods are designed for the most difficult inference problems where loopy belief propagation and other heuristics fail to converge. Belief…

Artificial Intelligence · Computer Science 2022-07-19 Anna Grim , Pedro Felzenszwalb

Several recent experiments in biology study systems composed of several interacting elements, for example neuron networks. Normally, measurements describe only the collective behavior of the system, even if in most cases we would like to…

Disordered Systems and Neural Networks · Physics 2010-10-12 Vitor Sessak