English
Related papers

Related papers: Self-Organized Short-Term Memories

200 papers

We examine the emergence of dynamical memory effects in quantum processes having indefinite time direction and causal order. In particular, we focus on the class of phase-covariant qubit channels, which encompasses some of the most…

Quantum Physics · Physics 2024-07-23 Göktuğ Karpat , Barış Çakmak

It is argued that systems whose elements are renewed according to an extremal criterion can generally be expected to exhibit long-term memory. This is verified for the minimal extremally driven model, which is first defined and then solved…

Statistical Mechanics · Physics 2009-10-31 D. A. Head

Making neural networks remember over the long term has been a longstanding issue. Although several external memory techniques have been introduced, most focus on retaining recent information in the short term. Regardless of its importance,…

Machine Learning · Computer Science 2024-07-19 Sangjun Park , JinYeong Bak

Several guiding principles for thought processes are proposed and a neural-network-type model implementing these principles is presented and studied. We suggest to consider thinking within an associative network built-up of overlapping…

Neurons and Cognition · Quantitative Biology 2007-05-23 Claudius Gros

We present a stochastic neural automata in which activity fluctuations and synaptic intensities evolve at different temperature, the latter moving through a set of stored patterns. The network thus exhibits various retrieval phases,…

Statistical Mechanics · Physics 2007-05-23 J. M. Cortes , P. L. Garrido , J. Marro , J. J. Torres

We investigate a new method to augment recurrent neural networks with extra memory without increasing the number of network parameters. The system has an associative memory based on complex-valued vectors and is closely related to…

Neural and Evolutionary Computing · Computer Science 2016-05-20 Ivo Danihelka , Greg Wayne , Benigno Uria , Nal Kalchbrenner , Alex Graves

Natural spatiotemporal processes can be highly non-stationary in many ways, e.g. the low-level non-stationarity such as spatial correlations or temporal dependencies of local pixel values; and the high-level variations such as the…

Machine Learning · Computer Science 2019-04-23 Yunbo Wang , Jianjin Zhang , Hongyu Zhu , Mingsheng Long , Jianmin Wang , Philip S Yu

Stochastic renewal processes are ubiquitous across physics, biology, and the social sciences. Here, we show that continuous-time renewal dynamics can naturally produce a mixed discrete-continuous structure, with a macroscopic fraction of…

Statistical Mechanics · Physics 2026-05-21 Ohad Vilk

Understanding the binding dynamics of liquid molecules is of fundamental importance in physical and life sciences. However, nanoscale fast dynamics pose great challenges for experimental characterization. Conventionally, the binding…

Chemical Physics · Physics 2024-10-28 Shiyi Qin , Zhi Yang , Huimin Liu , Xiaoli Wang , Shangguo Hou , Kai Huang

Many materials that are out of equilibrium can "learn" one or more inputs that are repeatedly applied. Yet, a common framework for understanding such memories is lacking. Here we construct minimal representations of cyclic memory behaviors…

Soft Condensed Matter · Physics 2019-06-13 Joseph D Paulsen , Nathan C Keim

We consider nonequilibrium transport in a simple chain of identical mechanical cells in which particles move around. In each cell, there is a rotating disc, with which these particles interact, and this is the only interaction in the model.…

Statistical Mechanics · Physics 2008-07-15 Jean-Pierre Eckmann , Carlos Mejia-Monasterio , Emmanuel Zabey

Quantum memory is a central component for quantum information processing devices, and will be required to provide high-fidelity storage of arbitrary states, long storage times and small access latencies. Despite growing interest in applying…

A robot operating in a household makes observations of multiple objects as it moves around over the course of days or weeks. The objects may be moved by inhabitants, but not completely at random. The robot may be called upon later to…

Machine Learning · Computer Science 2022-08-02 Yilun Du , Tomas Lozano-Perez , Leslie Kaelbling

In this paper we study the convergence to fractional Brownian motion for long memory time series having independent innovations with infinite second moment. For the sake of applications we derive the self-normalized version of this theorem.…

Methodology · Statistics 2016-11-25 Magda Peligrad , Hailin Sang

Working memory is a cognitive process that is responsible for temporarily holding and manipulating information. Most of the empirical neuroscience research on working memory has focused on measuring sustained activity in prefrontal cortex…

Artificial Intelligence · Computer Science 2018-05-29 David J. Heeger , Wayne E. Mackey

We demonstrate experimentally that a granular packing of glass spheres is capable of storing memory of multiple strain states in the dynamic process of stress relaxation. Modeling the system as a non-interacting population of relaxing…

Soft Condensed Matter · Physics 2020-04-29 Kieran A. Murphy , Jonathon W. Kruppe , Heinrich M. Jaeger

Cross-situational word learning, wherein a learner combines information about possible meanings of a word across multiple exposures, has previously been shown to be a very powerful strategy to acquire a large lexicon in a short time.…

Physics and Society · Physics 2018-10-01 James Holehouse , Richard A. Blythe

Many biological systems can sense periodical variations in a stimulus input and produce well-timed, anticipatory responses after the input is removed. Such systems show memory effects for retaining timing information in the stimulus and…

Neurons and Cognition · Quantitative Biology 2015-09-09 Ying-Jen Yang , Chun-Chung Chen , Pik-Yin Lai , C. K. Chan

A bouncing drop and its associated accompanying wave forms a walker. Based on previous works, we show in this article that it is possible to formulate a simple theoretical framework for the walker dynamics. It relies on a time scale…

Fluid Dynamics · Physics 2016-04-27 Matthieu Labousse , Stéphane Perrard , Yves Couder , Emmanuel Fort

Koopman operator theory has found significant success in learning models of complex, real-world dynamical systems, enabling prediction and control. The greater interpretability and lower computational costs of these models, compared to…

Dynamical Systems · Mathematics 2025-01-08 William T. Redman , Dean Huang , Maria Fonoberova , Igor Mezić