English
Related papers

Related papers: Efficient Hopfield pattern recognition on a scale-…

200 papers

We discuss prototype formation in the Hopfield network. Typically, Hebbian learning with highly correlated states leads to degraded memory performance. We show this type of learning can lead to prototype formation, where unlearned states…

Neural and Evolutionary Computing · Computer Science 2024-07-08 Hayden McAlister , Anthony Robins , Lech Szymanski

Brain-inspired computing aims to mimic cognitive functions like associative memory, the ability to recall complete patterns from partial cues. Memristor technology offers promising hardware for such neuromorphic systems due to its potential…

Machine Learning · Computer Science 2025-05-20 Chengping He , Mingrui Jiang , Keyi Shan , Szu-Hao Yang , Zefan Li , Shengbo Wang , Giacomo Pedretti , Jim Ignowski , Can Li

The exponential rise in data generation has led to vast, heterogeneous datasets crucial for predictive analytics and decision-making. Ensuring data quality and semantic integrity remains a challenge. This paper presents a brain-inspired…

Machine Learning · Computer Science 2025-03-06 Ashwin Viswanathan Kannan , Johnson P Thomas , Abhimanyu Mukerji

We consider a generalization of the Hopfield model, where the entries of patterns are Gaussian and diluted. We focus on the high-storage regime and we investigate analytically the topological properties of the emergent network, as well as…

Disordered Systems and Neural Networks · Physics 2012-09-28 Elena Agliari , Lorenzo Asti , Adriano Barra , Raffaella Burioni , Guido Uguzzoni

Many realistic networks are scale-free, with small characteristic path lengths, high clustering, and power law in their degree distribution. They can be obtained by dynamical networks in which a preferential attachment process takes place.…

Physics and Society · Physics 2017-03-13 Francesco Caravelli , Alioscia Hamma , Massimiliano Di Ventra

We consider the Hopfield model with $n$ neurons and an increasing number $p=p(n)$ of randomly chosen patterns and use Stein's method to obtain rates of convergence for the central limit theorem of overlap parameters, which holds for every…

Probability · Mathematics 2013-03-22 Peter Eichelsbacher , Bastian Martschink

Intracortical brain-machine interfaces require decoders that adapt continuously to neural signal instability while operating within strict memory budgets. We introduce a dual-timescale Hebbian accumulator learning rule for spiking neural…

Signal Processing · Electrical Eng. & Systems 2026-04-10 Sriram V. C. Nallani , Sahil Shah

In Hopfield-type associative memory models, memories are stored in the connectivity matrix and can be retrieved subsequently thanks to the collective dynamics of the network. In these models, the retrieval of a particular memory can be…

Neurons and Cognition · Quantitative Biology 2025-10-21 Marco Benedetti , Nicolas Brunel , Enzo Marinari , Ulises Pereira Obilinovic

A spatial scale-free network is introduced and studied whose motivation has been originated in the growing Internet as well as the Airport networks. We argue that in these real-world networks a new node necessarily selects one of its…

Statistical Mechanics · Physics 2009-11-11 G. Mukherjee , S. S. Manna

Many learning problems involve symmetries, and while invariance can be built into neural architectures, it can also emerge implicitly when training on group-structured data. We study this phenomenon in classical Hopfield networks and show…

Machine Learning · Computer Science 2026-01-21 Michael Murray , Tenzin Chan , Kedar Karhadker , Christopher J. Hillar

This article delves into the Hopfield neural network model, drawing inspiration from biological neural systems. The exploration begins with an overview of the model's foundations, incorporating insights from mechanical statistics to deepen…

Disordered Systems and Neural Networks · Physics 2024-10-29 Matteo Silvestri

Attractor neural network is an important theoretical scenario for modeling memory function in the hippocampus and in the cortex. In these models, memories are stored in the plastic recurrent connections of neural populations in the form of…

Neurons and Cognition · Quantitative Biology 2016-01-12 Alireza Alemi

We test four fast mean field type algorithms on Hopfield networks as an inverse Ising problem. The equilibrium behavior of Hopfield networks is simulated through Glauber dynamics. In the low temperature regime, the simulated annealing…

Disordered Systems and Neural Networks · Physics 2013-05-29 Haiping Huang

We study analytically and numerically a Hopfield fully-connected network with $d$-dimensional vector spins. These networks are models of associative memory that generalize the standard Hopfield with Ising spins, where $P$ examples are…

Disordered Systems and Neural Networks · Physics 2026-02-17 Flavio Nicoletti , Francesco D'Amico , Matteo Negri

We present a mathematical analysis of the effects of Hebbian learning in random recurrent neural networks, with a generic Hebbian learning rule including passive forgetting and different time scales for neuronal activity and learning…

Chaotic Dynamics · Physics 2008-04-07 Benoit Siri , Hugues Berry , Bruno Cessac , Bruno Delord , Mathias Quoy

Associative memories are structures that store data in such a way that it can later be retrieved given only a part of its content -- a sort-of error/erasure-resilience property. They are used in applications ranging from caches and memory…

Information Theory · Computer Science 2013-04-23 Vincent Gripon , Michael Rabbat

We study a model of associative memory based on a neural network with small-world structure. The efficacy of the network to retrieve one of the stored patterns exhibits a phase transition at a finite value of the disorder. The more ordered…

Adaptation and Self-Organizing Systems · Physics 2009-11-10 Luis G. Morelli , Guillermo Abramson , Marcelo N. Kuperman

Associative memories in the brain receive and store patterns of activity registered by the sensory neurons, and are able to retrieve them when necessary. Due to their importance in human intelligence, computational models of associative…

Machine Learning · Computer Science 2021-09-17 Tommaso Salvatori , Yuhang Song , Yujian Hong , Simon Frieder , Lei Sha , Zhenghua Xu , Rafal Bogacz , Thomas Lukasiewicz

The task of a neural associative memory is to retrieve a set of previously memorized patterns from their noisy versions using a network of neurons. An ideal network should have the ability to 1) learn a set of patterns as they arrive, 2)…

Neural and Evolutionary Computing · Computer Science 2014-07-25 Amin Karbasi , Amir Hesam Salavati , Amin Shokrollahi

On the basis of the general form for the energy needed to adapt the connection strengths of a network in which learning takes place, a local learning rule is found for the changes of the weights. This biologically realizable learning rule…

Disordered Systems and Neural Networks · Physics 2009-10-31 M. Heerema , W. A. van Leeuwen