Related papers: Self-Organized Short-Term Memories
We examine the emergence of dynamical memory effects in quantum processes having indefinite time direction and causal order. In particular, we focus on the class of phase-covariant qubit channels, which encompasses some of the most…
It is argued that systems whose elements are renewed according to an extremal criterion can generally be expected to exhibit long-term memory. This is verified for the minimal extremally driven model, which is first defined and then solved…
Making neural networks remember over the long term has been a longstanding issue. Although several external memory techniques have been introduced, most focus on retaining recent information in the short term. Regardless of its importance,…
Several guiding principles for thought processes are proposed and a neural-network-type model implementing these principles is presented and studied. We suggest to consider thinking within an associative network built-up of overlapping…
We present a stochastic neural automata in which activity fluctuations and synaptic intensities evolve at different temperature, the latter moving through a set of stored patterns. The network thus exhibits various retrieval phases,…
We investigate a new method to augment recurrent neural networks with extra memory without increasing the number of network parameters. The system has an associative memory based on complex-valued vectors and is closely related to…
Natural spatiotemporal processes can be highly non-stationary in many ways, e.g. the low-level non-stationarity such as spatial correlations or temporal dependencies of local pixel values; and the high-level variations such as the…
Stochastic renewal processes are ubiquitous across physics, biology, and the social sciences. Here, we show that continuous-time renewal dynamics can naturally produce a mixed discrete-continuous structure, with a macroscopic fraction of…
Understanding the binding dynamics of liquid molecules is of fundamental importance in physical and life sciences. However, nanoscale fast dynamics pose great challenges for experimental characterization. Conventionally, the binding…
Many materials that are out of equilibrium can "learn" one or more inputs that are repeatedly applied. Yet, a common framework for understanding such memories is lacking. Here we construct minimal representations of cyclic memory behaviors…
We consider nonequilibrium transport in a simple chain of identical mechanical cells in which particles move around. In each cell, there is a rotating disc, with which these particles interact, and this is the only interaction in the model.…
Quantum memory is a central component for quantum information processing devices, and will be required to provide high-fidelity storage of arbitrary states, long storage times and small access latencies. Despite growing interest in applying…
A robot operating in a household makes observations of multiple objects as it moves around over the course of days or weeks. The objects may be moved by inhabitants, but not completely at random. The robot may be called upon later to…
In this paper we study the convergence to fractional Brownian motion for long memory time series having independent innovations with infinite second moment. For the sake of applications we derive the self-normalized version of this theorem.…
Working memory is a cognitive process that is responsible for temporarily holding and manipulating information. Most of the empirical neuroscience research on working memory has focused on measuring sustained activity in prefrontal cortex…
We demonstrate experimentally that a granular packing of glass spheres is capable of storing memory of multiple strain states in the dynamic process of stress relaxation. Modeling the system as a non-interacting population of relaxing…
Cross-situational word learning, wherein a learner combines information about possible meanings of a word across multiple exposures, has previously been shown to be a very powerful strategy to acquire a large lexicon in a short time.…
Many biological systems can sense periodical variations in a stimulus input and produce well-timed, anticipatory responses after the input is removed. Such systems show memory effects for retaining timing information in the stimulus and…
A bouncing drop and its associated accompanying wave forms a walker. Based on previous works, we show in this article that it is possible to formulate a simple theoretical framework for the walker dynamics. It relies on a time scale…
Koopman operator theory has found significant success in learning models of complex, real-world dynamical systems, enabling prediction and control. The greater interpretability and lower computational costs of these models, compared to…