Related papers: Multiple transient memories in experiments on shea…
Large language models readily memorize arbitrary training instances, such as label noise, yet they perform strikingly well on reasoning tasks. In this work, we investigate how language models memorize label noise, and why such memorization…
Machine learning models exhibit two seemingly contradictory phenomena: training data memorization, and various forms of forgetting. In memorization, models overfit specific training examples and become susceptible to privacy attacks. In…
The theory of stochastic resetting asserts that restarting a stochastic process can expedite its completion. In this paper, we study the escape process of a Brownian particle in an open Hamiltonian system that suffers noise-enhanced…
We study stability issue of reset and impulsive switched systems. We find time constraints (dwell time and flee time) on switching signals which stabilize a given reset switched system. For a given collection of matrices, we find an…
Using numerical simulations it is shown that a random, athermal pack of soft frictional grains will store an arbitrary waveform that is applied as a small time-dependent shear while the system is slowly compressed. When the system is…
One of the main challenges in the study of time-varying networks is the interplay of memory effects with structural heterogeneity. In particular, different nodes and dyads can have very different statistical properties in terms of both link…
Memories are stored, at least partly, as patterns of strong synapses. Given molecular turnover, how can synapses maintain strong for the years that memories can persist? Some models postulate that biochemical bistability maintains strong…
Localized persistent neural activity can encode delayed estimates of continuous variables. Common experiments require that subjects store and report the feature value (e.g., orientation) of a particular cue (e.g., oriented bar on a screen)…
Neural dynamical systems with stable attractor structures, such as point attractors and continuous attractors, are hypothesized to underlie meaningful temporal behavior that requires working memory. However, working memory may not support…
This paper investigates the second order properties of a stationary process after random sampling. While a short memory process gives always rise to a short memory one, we prove that long-memory can disappear when the sampling law has heavy…
Regardless of the marked differences between biological and artificial neural systems, one fundamental similarity is that they are essentially dynamical systems that can learn to imitate other dynamical systems, without knowing their…
Memory effect reflects a system's ability to encode, retain and retrieve information about its past. Such effects are essentially an out-of-equilibrium phenomenon providing insight into the complex structural and dynamical behavior of the…
With increasing communication rates via quantum channels, memory effects become unavoidable whenever the use rate of the channel is comparable to the typical relaxation time of the channel environment. We introduce a model of a bosonic…
The transient behaviour of highly concentrated colloidal liquids and dynamically arrested states (glasses) under time-dependent shear is reviewed. This includes both theoretical and experimental studies and comprises the macroscopic…
Multistability, the coexistence of multiple attractors in a dynamical system, is explored in bursting nerve cells. A modeling study is performed to show that a large class of bursting systems, as defined by a shared topology when…
We study the interplay between forgetful and memory-keeping evolution enforced on a two-level system by a multi-spin environment whose elements are coupled to local bosonic baths. Contrarily to the expectation that any non-Markovian effect…
The measurement outcomes of two incompatible observables on a particle can be precisely predicted when it is maximally entangled with a quantum memory, as quantified recently [Nature Phys. 6, 659 (2010)]. We explore the behavior of the…
Real-world sequential signals, such as audio or video, contain critical information that is often embedded within long periods of silence or noise. While recurrent neural networks (RNNs) are designed to process such data efficiently, they…
Two nested classes of discrete-time linear time-invariant systems, which differ by the set of periodic signals that they leave invariant, are studied. The first class preserves the property of periodic monotonicity (period-wise…
Under normal operations, memristive devices undergo variability in time and space and have internal dynamics. Interplay of memory and stochastic signal processing in memristive devices makes them candidates for performing bio-inspired tasks…