相关论文: The delicate memory structure of origami switches
While reduction in feature size makes computation cheaper in terms of latency, area, and power consumption, performance of emerging data-intensive applications is determined by data movement. These trends have introduced the concept of…
Memory plays a pivotal role in enabling large language model~(LLM)-based agents to engage in complex and long-term interactions, such as question answering (QA) and dialogue systems. While various memory modules have been proposed for these…
This work focuses on the training dynamics of one associative memory module storing outer products of token embeddings. We reduce this problem to the study of a system of particles, which interact according to properties of the data…
A long-standing challenge in impact mitigation is the development of versatile and omnifarious protective structures capable of encompassing a wide spectrum of scenarios, for example, ranging from low-speed pedestrian impacts to high-speed…
We present a combined experimental and theoretical study to get insight into both memory and negative differential resistance (NDR) effect in organic memory devices. The theoretical model we propose is simply a one-dimensional metallic…
The Kuramoto model provides a prototypical framework to synchronization phenomena in interacting particle systems. Apart from full phase synchrony where all oscillators behave identically, identical Kuramoto oscillators with ring-like…
We propose an optical memory cell based on ultrafast wavelength switching in coupled-cavity microlasers, featuring bistability between modes separated by several nanometers. A numerical implementation is demonstrated by simulating a…
Why do we forget? Why do we remember things that never happened? The conventional answer points to biological hardware. We propose a different one: geometry. Here we show that high-dimensional embedding spaces, subjected to noise,…
Disordered magnets, martensitic mixed crystals, and glassy solids can be irreversibly deformed by subjecting them to external deformation. The deformation produces a smooth, reversible response punctuated by abrupt relaxation "glitches".…
Multistability-induced hysteresis has been widely studied in mechanical systems, but such behavior has proven more difficult to reproduce experimentally in flow networks. Natural flow networks like animal and plant vasculature can exhibit…
This paper introduces a structured memory which can be easily integrated into a neural network. The memory is very large by design and significantly increases the capacity of the architecture, by up to a billion parameters with a negligible…
A new collective behavior of resonant synchronization is discovered and the ability to retrieve information from brain memory is proposed based on this mechanism. We use modified Kuramoto phase oscillator to simulate the dynamics of a…
The instability of mixing in the Kuramoto model of coupled phase oscillators is the key to understanding a range of spatiotemporal patterns, which feature prominently in collective dynamics of systems ranging from neuronal networks, to…
Traditional memory writing operations proceed one bit at a time, where e.g. an individual magnetic domain is force-flipped by a localized external field. One way to increase material storage capacity would be to write several bits at a time…
Memory systems can store vastly different amounts of information despite similar hardware constraints. Here, we show that superior spatial memory emerges from a discrete stiffening of hippocampal population geometry-a transition from…
Several guiding principles for thought processes are proposed and a neural-network-type model implementing these principles is presented and studied. We suggest to consider thinking within an associative network built-up of overlapping…
We present a modular DNA origami design approach to address the challenges of assembling geometrically complex nanoscale structures, including those with nonuniform Gaussian curvature. This approach features a core structure that completely…
State space models (SSMs) have gained attention by showing potential to outperform Transformers. However, previous studies have not sufficiently addressed the mechanisms underlying their high performance owing to a lack of theoretical…
Adaptive response to a varying environment is a common feature of biological organisms. Reproducing such features in electronic systems and circuits is of great importance for a variety of applications. Here, we consider memory models…
The notion of complex energy landscape underpins the intriguing dynamical behaviors in many complex systems ranging from polymers, to brain activity, to social networks and glass transitions. The spin glass state found in dilute magnetic…