English
Related papers

Related papers: Hierarchical Temporal Memory Based on Spin-Neurons…

200 papers

Neuromorphic systems that learn and predict from streaming inputs hold significant promise in pervasive edge computing and its applications. In this paper, a neuromorphic system that processes spatio-temporal information on the edge is…

Emerging Technologies · Computer Science 2020-06-23 Abdullah M. Zyarah , Kevin Gomez , Dhireesha Kudithipudi

Spike-based neuromorphic hardware holds the promise to provide more energy efficient implementations of Deep Neural Networks (DNNs) than standard hardware such as GPUs. But this requires to understand how DNNs can be emulated in an…

Neural and Evolutionary Computing · Computer Science 2021-11-09 Philipp Plank , Arjun Rao , Andreas Wild , Wolfgang Maass

Over the past decade Spiking Neural Networks (SNN) have emerged as one of the popular architectures to emulate the brain. In SNN, information is temporally encoded and communication between neurons is accomplished by means of spikes. In…

Emerging Technologies · Computer Science 2016-12-14 Abhronil Sengupta , Aparajita Banerjee , Kaushik Roy

Reinforcement learning agents often forget details of the past, especially after delays or distractor tasks. Agents with common memory architectures struggle to recall and integrate across multiple timesteps of a past event, or even to…

Machine Learning · Computer Science 2021-12-09 Andrew Kyle Lampinen , Stephanie C. Y. Chan , Andrea Banino , Felix Hill

Predicting human mobility is inherently challenging due to complex long-range dependencies and multi-scale periodic behaviors. To address this, we introduce RHYTHM (Reasoning with Hierarchical Temporal Tokenization for Human Mobility), a…

Machine Learning · Computer Science 2026-02-25 Haoyu He , Haozheng Luo , Yan Chen , Qi R. Wang

The estimation of sparse hierarchical components reflecting patterns of the brain's functional connectivity from rsfMRI data can contribute to our understanding of the brain's functional organization, and can lead to biomarkers of diseases.…

Machine Learning · Computer Science 2021-04-22 Dushyant Sahoo , Christos Davatzikos

This paper proposes a low latency neural network architecture for event-based dense prediction tasks. Conventional architectures encode entire scene contents at a fixed rate regardless of their temporal characteristics. Instead, the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Ryuhei Hamaguchi , Yasutaka Furukawa , Masaki Onishi , Ken Sakurada

In the decade since Jeff Hawkins proposed Hierarchical Temporal Memory (HTM) as a model of neocortical computation, the theory and the algorithms have evolved dramatically. This paper presents a detailed description of HTM's Cortical…

Neural and Evolutionary Computing · Computer Science 2015-10-09 Fergal Byrne

Human brains are known to be capable of speeding up visual recognition of repeatedly presented objects through faster memory encoding and accessing procedures on activated neurons. For the first time, we borrow and distill such a capability…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Yun Li , Chen Zhang , Shihao Han , Li Lyna Zhang , Baoqun Yin , Yunxin Liu , Mengwei Xu

This project explores the use of non-volatile synapses in neuromorphic computing for pattern recognition tasks through a comprehensive simulation-based approach. The main approach is through spintronic synapses, which leverage the…

Mesoscale and Nanoscale Physics · Physics 2025-01-08 Luis Sosa , Minhyeok Wi , Miguel Barrera , Imran Nasrullah , Yingying Wu

Spatio-temporal data are ubiquitous in the agricultural, ecological, and environmental sciences, and their study is important for understanding and predicting a wide variety of processes. One of the difficulties with modeling spatial…

Machine Learning · Statistics 2019-02-25 Christopher K. Wikle

Fabricating powerful neuromorphic chips the size of a thumb requires miniaturizing their basic units: synapses and neurons. The challenge for neurons is to scale them down to submicrometer diameters while maintaining the properties that…

In this paper, a novel architecture of Recurrent Neural Network (RNN) is designed and experimented. The proposed RNN adopts a computational memory based on the concept of stigmergy. The basic principle of a Stigmergic Memory (SM) is that…

Neural and Evolutionary Computing · Computer Science 2019-04-30 Federico A. Galatolo , Mario G. C. A. Cimino , Gigliola Vaglini

Emulating various facets of computing principles of the brain can potentially lead to the development of neuro-computers that are able to exhibit brain-like cognitive capabilities. In this letter, we propose a magnetoelectronic neuron that…

Emerging Technologies · Computer Science 2020-02-19 Kezhou Yang , Abhronil Sengupta

Training deep recurrent neural network (RNN) architectures is complicated due to the increased network complexity. This disrupts the learning of higher order abstracts using deep RNN. In case of feed-forward networks training deep…

Computation and Language · Computer Science 2018-08-07 Murali Karthick Baskar , Martin Karafiat , Lukas Burget , Karel Vesely , Frantisek Grezl , Jan Honza Cernocky

Time series classification underpins applications such as human activity recognition, healthcare monitoring, and gesture detection in the IoT domain. Tiny Machine Learning enables models to run directly on low-power microcontroller units,…

Performance · Computer Science 2026-03-06 Bidyut Saha , Riya Samanta

In the domain of sequence modelling, Recurrent Neural Networks (RNN) have been capable of achieving impressive results in a variety of application areas including visual question answering, part-of-speech tagging and machine translation.…

Machine Learning · Computer Science 2018-05-22 Tharindu Fernando , Simon Denman , Aaron McFadyen , Sridha Sridharan , Clinton Fookes

Associative memory retrieves complete patterns from partial or corrupted inputs and constitutes a primitive form of generative inference. Classical Hopfield networks (CHN) provide a canonical framework for associative memory but suffer from…

We present a design-scheme for ultra-low power neuromorphic hardware using emerging spin-devices. We propose device models for 'neuron', based on lateral spin valves and domain wall magnets that can operate at ultra-low terminal voltage of…

Disordered Systems and Neural Networks · Physics 2012-07-19 Mrigank Sharad , Charles Augustine , Georgios Panagopoulos , Kaushik Roy

Neuromorphic computing systems overcome the limitations of traditional von Neumann computing architectures. These computing systems can be further improved upon by using emerging technologies that are more efficient than CMOS for neural…