English
Related papers

Related papers: Temporal pattern recognition with delayed feedback…

200 papers

Recent advancements in reservoir computing research have created a demand for analog devices with dynamics that can facilitate the physical implementation of reservoirs, promising faster information processing while consuming less energy…

Despite remarkable capabilities, artificial neural networks exhibit limited flexible, generalizable intelligence. This limitation stems from their fundamental divergence from biological cognition that overlooks both neural regions'…

Artificial Intelligence · Computer Science 2025-11-05 Boheng Liu , Ziyu Li , Qing Li , Xia Wu

Complex dynamics of silicon microring resonators loaded by delayed feedback elements enable high-speed photonic reservoir computing. Implementing feedback is especially challenging when the required delay should match the time scales of…

Differentiable neural computers extend artificial neural networks with an explicit memory without interference, thus enabling the model to perform classic computation tasks such as graph traversal. However, such models are difficult to…

Machine Learning · Computer Science 2022-06-06 Benjamin Paaßen , Alexander Schulz , Terrence C. Stewart , Barbara Hammer

Working memory - the ability to remember recent events as they recede continuously into the past - requires the ability to represent any stimulus at any time delay. This property requires neurons coding working memory to show mixed…

Neurons and Cognition · Quantitative Biology 2025-08-12 Aakash Sarkar , Chenyu Wang , Shangfu Zuo , Marc W. Howard

We consider application of the multiple time delayed feedback for control of anharmonic (nonlinear) oscillators subject to noise. In contrast to the case of a single delay feedback, the multiple one exhibits resonances between feedback and…

Statistical Mechanics · Physics 2014-07-30 Denis S. Goldobin

World models enable agents to plan within imagined environments by predicting future states conditioned on past observations and actions. However, their ability to plan over long horizons is limited by the effective memory span of the…

Artificial Intelligence · Computer Science 2025-12-09 Eli J. Laird , Corey Clark

The well-known generalization problem hinders the application of artificial neural networks in continuous-time prediction tasks with varying latent dynamics. In sharp contrast, biological systems can neatly adapt to evolving environments…

Machine Learning · Computer Science 2025-03-10 Jindou Jia , Zihan Yang , Meng Wang , Kexin Guo , Jianfei Yang , Xiang Yu , Lei Guo

We demonstrate a high-quality spin orbit torque nano-oscillator comprised of spin wave modes confined by the magnetic field by the strongly inhomogeneous dipole field of a nearby micromagnet. This approach enables variable spatial…

Mesoscale and Nanoscale Physics · Physics 2021-12-28 Chi Zhang , Inhee Lee , Yong Pu , Sergei A. Manuilov , Denis V. Pelekhov , P. Chris Hammel

Recurrent neural networks (RNNs) provide state-of-the-art performance in processing sequential data but are memory intensive to train, limiting the flexibility of RNN models which can be trained. Reversible RNNs---RNNs for which the…

Machine Learning · Computer Science 2018-10-26 Matthew MacKay , Paul Vicol , Jimmy Ba , Roger Grosse

Spiking neural networks (SNNs) are rapidly gaining momentum as an alternative to conventional artificial neural networks in resource constrained edge systems. In this work, we continue a recent research line on recurrent SNNs where axonal…

Neural and Evolutionary Computing · Computer Science 2026-04-20 Lúcio Folly Sanches Zebendo , Eleonora Cicciarella , Michele Rossi

We present a novel model designed for resource-efficient multichannel speech enhancement in the time domain, with a focus on low latency, lightweight, and low computational requirements. The proposed model incorporates explicit spatial and…

Sound · Computer Science 2024-01-17 Ashutosh Pandey , Buye Xu

Neural interfaces capable of multi-site electrical recording, on-site signal classification, and closed-loop therapy are critical for the diagnosis and treatment of neurological disorders. However, deploying machine learning algorithms on…

Hardware Architecture · Computer Science 2020-10-22 Bingzhao Zhu , Uisub Shin , Mahsa Shoaran

Much of the information the brain processes and stores is temporal in nature - a spoken word or a handwritten signature, for example, is defined by how it unfolds in time. However, it remains unclear how neural circuits encode complex…

Neurons and Cognition · Quantitative Biology 2017-08-15 Vishwa Goudar , Dean Buonomano

For decades, conventional computers based on the von Neumann architecture have performed computation by repeatedly transferring data between their processing and their memory units, which are physically separated. As computation becomes…

Emerging Technologies · Computer Science 2018-02-07 Abu Sebastian , Tomas Tuma , Nikolaos Papandreou , Manuel Le Gallo , Lukas Kull , Thomas Parnell , Evangelos Eleftheriou

This paper introduces an efficient and robust method for discovering interpretable circuits in large language models using discrete sparse autoencoders. Our approach addresses key limitations of existing techniques, namely computational…

Computation and Language · Computer Science 2024-05-22 Charles O'Neill , Thang Bui

Working memory -- the ability to store and recall precise temporal patterns of neural activity -- remains an open challenge for spiking neural networks (SNNs). We propose a recurrent SNN of $N$ neurons in which each synapse is equipped with…

Neurons and Cognition · Quantitative Biology 2026-04-16 Laurent U Perrinet

In this paper, a neuron with nonlinear dendrites (NNLD) and binary synapses that is able to learn temporal features of spike input patterns is considered. Since binary synapses are considered, learning happens through formation and…

Neural and Evolutionary Computing · Computer Science 2015-06-18 Subhrajit Roy , Phyo Phyo San , Shaista Hussain , Lee Wang Wei , Arindam Basu

By incorporating feedback loops, that engender amplification and damping so that output is not proportional to input, the biological neural networks become highly nonlinear and thus very likely chaotic in nature. Research in control theory…

Neurons and Cognition · Quantitative Biology 2022-12-22 Fan Zhang

Neuromorphic computing has emerged as a promising avenue towards building the next generation of intelligent computing systems. It has been proposed that memristive devices, which exhibit history-dependent conductivity modulation, could…