English
Related papers

Related papers: On-chip Few-shot Learning with Surrogate Gradient …

200 papers

Neuromorphic hardware strives to emulate brain-like neural networks and thus holds the promise for scalable, low-power information processing on temporal data streams. Yet, to solve real-world problems, these networks need to be trained.…

Neural and Evolutionary Computing · Computer Science 2020-10-23 Friedemann Zenke , Emre O. Neftci

Neuromorphic computing aims to incorporate lessons from studying biological nervous systems in the design of computer architectures. While existing approaches have successfully implemented aspects of those computational principles, such as…

Neurons and Cognition · Quantitative Biology 2023-02-15 Christian Pehle , Luca Blessing , Elias Arnold , Eric Müller , Johannes Schemmel

AI systems on edge devices require online continual learning -- adapting to non-stationary streams and unfamiliar classes without catastrophic forgetting -- under strict power constraints. We present CLP-SNN, a spiking neural network with a…

Neuromorphic computing aims to improve the efficiency of artificial neural networks by taking inspiration from biological neurons and leveraging temporal sparsity, spatial sparsity, and compute near/in memory. Although these approaches have…

Neural and Evolutionary Computing · Computer Science 2025-05-13 Matthew Brehove , Sadia Anjum Tumpa , Espoir Kyubwa , Naresh Menon , Vijaykrishnan Narayanan

Recent research has demonstrated the usefulness of neural networks as variational ansatz functions for quantum many-body states. However, high-dimensional sampling spaces and transient autocorrelations confront these approaches with a…

Quantum Physics · Physics 2021-11-29 Robert Klassert , Andreas Baumbach , Mihai A. Petrovici , Martin Gärttner

Gradient-based meta-learning techniques aim to distill useful prior knowledge from a set of training tasks such that new tasks can be learned more efficiently with gradient descent. While these methods have achieved successes in various…

Machine Learning · Computer Science 2023-10-16 Mike Huisman , Aske Plaat , Jan N. van Rijn

Neuromorphic hardware has several promising advantages compared to von Neumann architectures and is highly interesting for robot control. However, despite the high speed and energy efficiency of neuromorphic computing, algorithms utilizing…

Neural and Evolutionary Computing · Computer Science 2020-11-30 Carlo Michaelis , Andrew B. Lehr , Christian Tetzlaff

Spiking neural networks (SNN) are delivering energy-efficient, massively parallel, and low-latency solutions to AI problems, facilitated by the emerging neuromorphic chips. To harness these computational benefits, SNN need to be trained by…

Neural and Evolutionary Computing · Computer Science 2021-10-28 Guangzhi Tang , Neelesh Kumar , Ioannis Polykretis , Konstantinos P. Michmizos

Sparse and asynchronous sensing and processing in natural organisms lead to ultra low-latency and energy-efficient perception. Event cameras, known as neuromorphic vision sensors, are designed to mimic these characteristics. However, fully…

Robotics · Computer Science 2024-12-24 Junjie Jiang , Delei Kong , Chenming Hu , Zheng Fang

Neuromorphic hardware implementations of Spiking Neural Networks (SNNs) promise energy-efficient, low-latency AI through sparse, event-driven computation. Yet, training SNNs under fine temporal discretization remains a major challenge,…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Roel Koopman , Sebastian Otte , Sander Bohté

We introduce SubGD, a novel few-shot learning method which is based on the recent finding that stochastic gradient descent updates tend to live in a low-dimensional parameter subspace. In experimental and theoretical analyses, we show that…

The increasing need for intelligent sensors in a wide range of everyday objects requires the existence of low power information processing systems which can operate autonomously in their environment. In particular, merging and processing…

Neural and Evolutionary Computing · Computer Science 2019-03-12 Johannes C. Thiele , Olivier Bichler , Antoine Dupret , Sergio Solinas , Giacomo Indiveri

Real-time biosignal processing on wearable devices has attracted worldwide attention for its potential in healthcare applications. However, the requirement of low-area, low-power and high adaptability to different patients challenge…

Signal Processing · Electrical Eng. & Systems 2022-09-29 Chaoming Fang , Ziyang Shen , Fengshi Tian , Jie Yang , Mohamad Sawan

Neuromorphic devices represent an attempt to mimic aspects of the brain's architecture and dynamics with the aim of replicating its hallmark functional capabilities in terms of computational power, robust learning and energy efficiency. We…

Neuromorphic computing mimics the neural activity of the brain through emulating spiking neural networks. In numerous machine learning tasks, neuromorphic chips are expected to provide superior solutions in terms of cost and power…

Neural and Evolutionary Computing · Computer Science 2022-04-12 Te-Yuan Liu , Ata Mahjoubfar , Daniel Prusinski , Luis Stevens

Equipping a deep model the abaility of few-shot learning, i.e., learning quickly from only few examples, is a core challenge for artificial intelligence. Gradient-based meta-learning approaches effectively address the challenge by learning…

Machine Learning · Computer Science 2024-01-09 Baoquan Zhang , Chuyao Luo , Demin Yu , Huiwei Lin , Xutao Li , Yunming Ye , Bowen Zhang

The stringent memory and power constraints required in edge-computing sensory-processing applications have made event-driven neuromorphic systems a promising technology. On-chip online learning provides such systems the ability to learn the…

Emerging Technologies · Computer Science 2022-01-26 Matteo Cartiglia , Arianna Rubino , Shyam Narayanan , Charlotte Frenkel , Germain Haessig , Giacomo Indiveri , Melika Payvand

On-device transfer learning is crucial for adapting a common backbone model to the unique environment of each edge device. Tiny microcontrollers, such as the Raspberry Pi Pico, are key targets for on-device learning but often lack…

Machine Learning · Computer Science 2025-03-24 Honoka Anada , Sefutsu Ryu , Masayuki Usui , Tatsuya Kaneko , Shinya Takamaeda-Yamazaki

Mixed-signal neuromorphic processors provide extremely low-power operation for edge inference workloads, taking advantage of sparse asynchronous computation within Spiking Neural Networks (SNNs). However, deploying robust applications to…

Emerging Technologies · Computer Science 2024-05-03 Uğurcan Çakal , Maryada , Chenxi Wu , Ilkay Ulusoy , Dylan R. Muir

Tracking visual objects from a single initial exemplar in the testing phase has been broadly cast as a one-/few-shot problem, i.e., one-shot learning for initial adaptation and few-shot learning for online adaptation. The recent few-shot…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Jin Gao , Yan Lu , Xiaojuan Qi , Yutong Kou , Bing Li , Liang Li , Shan Yu , Weiming Hu