English
Related papers

Related papers: Neuromorphic Hardware learns to learn

200 papers

The human brain has immense learning capabilities at extreme energy efficiencies and scale that no artificial system has been able to match. For decades, reverse engineering the brain has been one of the top priorities of science and…

Research on neuromorphic computing is driven by the vision that we can emulate brain-like computing capability, learning capability, and energy-efficiency in novel hardware. Unfortunately, this vision has so far been pursued in a…

Neural and Evolutionary Computing · Computer Science 2023-10-26 Wolfgang Maass

How can we build agents that keep learning from experience, quickly and efficiently, after their initial training? Here we take inspiration from the main mechanism of learning in biological brains: synaptic plasticity, carefully tuned by…

Neural and Evolutionary Computing · Computer Science 2018-08-01 Thomas Miconi , Jeff Clune , Kenneth O. Stanley

Neuromorphic engineering (NE) encompasses a diverse range of approaches to information processing that are inspired by neurobiological systems, and this feature distinguishes neuromorphic systems from conventional computing systems. The…

Memristive reservoirs draw inspiration from a novel class of neuromorphic hardware known as nanowire networks. These systems display emergent brain-like dynamics, with optimal performance demonstrated at dynamical phase transitions. In…

Disordered Systems and Neural Networks · Physics 2023-06-23 Ruomin Zhu , Jason K. Eshraghian , Zdenka Kuncic

We consider a class of a nested optimization problems involving inner and outer objectives. We observe that by taking into explicit account the optimization dynamics for the inner objective it is possible to derive a general framework that…

Machine Learning · Statistics 2019-08-22 Luca Franceschi , Michele Donini , Paolo Frasconi , Massimiliano Pontil

Training neural networks for neuromorphic deployment is non-trivial. There have been a variety of approaches proposed to adapt back-propagation or back-propagation-like algorithms appropriate for training. Considering that these networks…

Photonic brain-inspired platforms are emerging as novel analog computing devices, enabling fast and energy-efficient operations for machine learning. These artificial neural networks generally require tailored optical elements, such as…

Emerging Technologies · Computer Science 2021-07-30 Davide Pierangeli , Giulia Marcucci , Claudio Conti

Neuromorphic computing is a brainlike information processing paradigm that requires adaptive learning mechanisms. A spiking neuro-evolutionary system is used for this purpose; plastic resistive memories are implemented as synapses in…

Neural and Evolutionary Computing · Computer Science 2015-05-19 Gerard David Howard , Larry Bull , Ben de Lacy Costello , Andrew Adamatzky , Ella Gale

A hallmark of intelligence is the ability to autonomously learn new flexible, cognitive behaviors - that is, behaviors where the appropriate action depends not just on immediate stimuli (as in simple reflexive stimulus-response…

Neural and Evolutionary Computing · Computer Science 2023-05-30 Thomas Miconi

There are two common approaches for optimizing the performance of a machine: genetic algorithms and machine learning. A genetic algorithm is applied over many generations whereas machine learning works by applying feedback until the system…

Artificial Intelligence · Computer Science 2017-09-01 Leigh Sheneman , Arend Hintze

Resistive memory (RM) based neuromorphic systems can emulate synaptic plasticity and thus support continual learning, but they generally lack biologically inspired mechanisms for active forgetting, which are critical for meeting modern data…

Meta-learning often referred to as learning-to-learn is a promising notion raised to mimic human learning by exploiting the knowledge of prior tasks but being able to adapt quickly to novel tasks. A plethora of models has emerged in this…

Machine Learning · Computer Science 2022-10-17 Jicang Cai , Saeed Vahidian , Weijia Wang , Mohsen Joneidi , Bill Lin

As humans advance toward a higher level of artificial intelligence, it is always at the cost of escalating computational resource consumption, which requires developing novel solutions to meet the exponential growth of AI computing demand.…

Artificial neural networks and computational neuroscience models have made tremendous progress, allowing computers to achieve impressive results in artificial intelligence (AI) applications, such as image recognition, natural language…

Neural and Evolutionary Computing · Computer Science 2019-11-05 Giacomo Indiveri , Yulia Sandamirskaya

Neuromorphic computing is poised to further the success of software-based neural networks by utilizing improved customized hardware. However, the translation of neuromorphic algorithms to hardware specifications is a problem that has been…

Emerging Technologies · Computer Science 2022-08-03 Andres E. Lombo , Jesus E. Lares , Matteo Castellani , Chi-Ning Chou , Nancy Lynch , Karl K. Berggren

Randomization is a powerful tool that endows algorithms with remarkable properties. For instance, randomized algorithms excel in adversarial settings, often surpassing the worst-case performance of deterministic algorithms with large…

Machine Learning · Computer Science 2024-08-21 Johannes von Oswald , Seijin Kobayashi , Yassir Akram , Angelika Steger

Neuromorphic computing aims to incorporate lessons from studying biological nervous systems in the design of computer architectures. While existing approaches have successfully implemented aspects of those computational principles, such as…

Neurons and Cognition · Quantitative Biology 2023-02-15 Christian Pehle , Luca Blessing , Elias Arnold , Eric Müller , Johannes Schemmel

Emergent learning transforms a disordered optical medium into a photonic device capable of storage, recognition, and classification of arbitrary memory patterns. First, we show that the intensity at the output of a multiply scattering…

Neuromorphic hardware strives to emulate brain-like neural networks and thus holds the promise for scalable, low-power information processing on temporal data streams. Yet, to solve real-world problems, these networks need to be trained.…

Neural and Evolutionary Computing · Computer Science 2020-10-23 Friedemann Zenke , Emre O. Neftci