A correspondence between Hebbian unlearning and steady states generated by nonequilibrium dynamics
Abstract
The classic paradigms for learning and memory recall focus on strengths of synaptic couplings and how these can be modulated to encode memories. In a previous paper [A. K. Behera, M. Rao, S. Sastry, and S. Vaikuntanathan, Physical Review X 13, 041043 (2023)], we demonstrated how a specific non-equilibrium modification of the dynamics of an associative memory system can lead to increase in storage capacity. In this work, using analytical theory and computational inference schemes, we show that the dynamical steady state accessed is in fact similar to those accessed after the operation of a classic unsupervised scheme for improving memory recall, Hebbian unlearning or ``dreaming". Together, our work suggests how nonequilibrium dynamics can provide an alternative route for controlling the memory encoding and recall properties of a variety of synthetic (neuromorphic) and biological systems.
Keywords
Cite
@article{arxiv.2410.06269,
title = {A correspondence between Hebbian unlearning and steady states generated by nonequilibrium dynamics},
author = {Agnish Kumar Behera and Matthew Du and Uday Jagadisan and Srikanth Sastry and Madan Rao and Suriyanarayanan Vaikuntanathan},
journal= {arXiv preprint arXiv:2410.06269},
year = {2024}
}
Comments
15 pages, 13 figures