English
Related papers

Related papers: Maximum memory capacity on neural networks with sh…

200 papers

The interplay between structure and function is crucial in determining some emerging properties of many natural systems. Here we use an adaptive neural network model inspired in observations of synaptic pruning that couples activity and…

Physics and Society · Physics 2019-04-26 Ana P. Millán , J. J. Torres , S. Johnson , J. Marro

Neural networks are susceptible to catastrophic forgetting. They fail to preserve previously acquired knowledge when adapting to new tasks. Inspired by human associative memory system, we propose a brain-like approach that imitates the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Yi Gu , Jie Li , Yuting Gao , Ruoxin Chen , Chentao Wu , Feiyang Cai , Chao Wang , Zirui Zhang

Associative memory, traditionally modeled by Hopfield networks, enables the retrieval of previously stored patterns from partial or noisy cues. Yet, the local computational principles which are required to enable this function remain…

Performing more tasks in parallel is a typical feature of complex brains. These are characterized by the coexistence of excitatory and inhibitory synapses, whose percentage in mammals is measured to have a typical value of 20-30\%. Here we…

Neurons and Cognition · Quantitative Biology 2015-08-25 Vittorio Capano , Hans J. Herrmann , Lucilla de Arcangelis

Dense Associative Memories or modern Hopfield networks permit storage and reliable retrieval of an exponentially large (in the dimension of feature space) number of memories. At the same time, their naive implementation is non-biological,…

Neurons and Cognition · Quantitative Biology 2021-04-29 Dmitry Krotov , John Hopfield

Synaptic plasticity is vital for learning and memory in the brain. It consists of long-term potentiation (LTP) and long-term depression (LTD). Spike frequency is one of the major components of synaptic plasticity in the brain, a noisy…

Neurons and Cognition · Quantitative Biology 2021-08-13 Yuto Takeda , Katsuhiko Hata , Tokio Yamasaki , Masaki Kaneko , Osamu Yokoi , Chengta Tsai , Kazuo Umemura , Tetsuro Nikuni

We investigate from a computational perspective the efficiency of the Willshaw synaptic update rule in the context of familiarity discrimination, a binary-answer, memory-related task that has been linked through psychophysical experiments…

Neurons and Cognition · Quantitative Biology 2012-08-01 João Sacramento , Andreas Wichert

Inhibition is considered to shape neural activity, and broaden its pattern repertoire. In the sensory organs, where the anatomy of neural circuits is highly structured, lateral inhibition sharpens contrast among stimulus properties. The…

Neurons and Cognition · Quantitative Biology 2018-09-18 Netta Haroush , Shimon Marom

Explaining individual differences in cognitive abilities requires both identifying brain parameters that vary across individuals and understanding how brain networks are recruited for specific tasks. Typically, task performance relies on…

Neurons and Cognition · Quantitative Biology 2026-05-05 Sida Chen , Siqi Yang , Zhao Chang , Taro Toyoizumi , Werner Sommer , Lianchun Yu , Qian-Yuan Tang , Changsong Zhou

Neural networks can be compressed to reduce memory and computational requirements, or to increase accuracy by facilitating the use of a larger base architecture. In this paper we focus on pruning individual neurons, which can simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2018-04-20 Bin Dai , Chen Zhu , David Wipf

We study a model of spiking neurons, with recurrent connections that result from learning a set of spatio-temporal patterns with a spike-timing dependent plasticity rule and a global inhibition. We investigate the ability of the network to…

Neurons and Cognition · Quantitative Biology 2020-04-22 S. Scarpetta , A. de Candia

Finding actions that satisfy the constraints imposed by both external inputs and internal representations is central to decision making. We demonstrate that some important classes of constraint satisfaction problems (CSPs) can be solved by…

Neurons and Cognition · Quantitative Biology 2018-01-16 Ueli Rutishauser , Jean-Jacques Slotine , Rodney J. Douglas

A common view in the neuroscience community is that memory is encoded in the connection strength between neurons. This perception led artificial neural network models to focus on connection weights as the key variables to modulate learning.…

Neural and Evolutionary Computing · Computer Science 2022-02-22 Hananel Hazan , Simon Caby , Christopher Earl , Hava Siegelmann , Michael Levin

We study a fully connected Hopfield-type associative memory network with online activity-dependent synaptic plasticity, where neural states and synaptic couplings coevolve during retrieval. Using the generating-functional formalism, we…

Disordered Systems and Neural Networks · Physics 2026-05-22 Yoshinori Hara , Yoshiyuki Kabashima

In this paper, we clarify the mechanisms underlying a general phenomenon present in pulse-coupled heterogeneous inhibitory networks: inhibition can induce not only suppression of the neural activity, as expected, but it can also promote…

Neurons and Cognition · Quantitative Biology 2017-05-23 David Angulo-Garcia , Stefano Luccioli , Simona Olmi , Alessandro Torcini

Attractor neural network is an important theoretical scenario for modeling memory function in the hippocampus and in the cortex. In these models, memories are stored in the plastic recurrent connections of neural populations in the form of…

Neurons and Cognition · Quantitative Biology 2016-01-12 Alireza Alemi

This paper investigates stability conditions of continuous-time Hopfield and firing-rate neural networks by leveraging contraction theory. First, we present a number of useful general algebraic results on matrix polytopes and products of…

Optimization and Control · Mathematics 2023-05-16 Veronica Centorrino , Anand Gokhale , Alexander Davydov , Giovanni Russo , Francesco Bullo

We consider a fully-connected network of leaky integrate-and-fire neurons with spike-timing-dependent plasticity. The plasticity is controlled by a parameter representing the expected weight of a synapse between neurons that are firing…

Neurons and Cognition · Quantitative Biology 2011-09-23 Chun-Chung Chen , David Jasnow

Neural networks rely on learning synaptic weights. However, this overlooks other neural parameters that can also be learned and may be utilized by the brain. One such parameter is the delay: the brain exhibits complex temporal dynamics with…

Neural and Evolutionary Computing · Computer Science 2025-11-03 Pengfei Sun , Jascha Achterberg , Zhe Su , Dan F. M. Goodman , Danyal Akarca

The studies described in this dissertation have attempted to address the cellular mechanisms of information storage by the brain. My work has focused primarily on the postsynaptic events that occur during and after induction of long-term…

Neurons and Cognition · Quantitative Biology 2009-09-29 Lalania Kaye Schexnayder