English
Related papers

Related papers: On-chip Few-shot Learning with Surrogate Gradient …

200 papers

State-of-the-art deep learning algorithms yield remarkable results in many visual recognition tasks. However, they still fail to provide satisfactory results in scarce data regimes. To a certain extent this lack of data can be compensated…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Frederik Pahde , Oleksiy Ostapenko , Patrick Jähnichen , Tassilo Klein , Moin Nabi

We use the EMNIST dataset of handwritten digits to test a simple approach for few-shot learning. A fully connected neural network is pre-trained with a subset of the 10 digits and used for few-shot learning with untrained digits. Two basic…

Machine Learning · Computer Science 2020-09-22 Detlef Schmicker

The process of continuously reallocating funds into financial assets, aiming to increase the expected return of investment and minimizing the risk, is known as portfolio management. Processing speed and energy consumption of portfolio…

Machine Learning · Computer Science 2022-03-29 Seyyed Amirhossein Saeidi , Forouzan Fallah , Soroush Barmaki , Hamed Farbeh

Few-shot learning (FSL) is popular due to its ability to adapt to novel classes. Compared with inductive few-shot learning, transductive models typically perform better as they leverage all samples of the query set. The two existing classes…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Hao Zhu , Piotr Koniusz

Deep neural networks (DNNs) have recently found emerging use in accelerated MRI reconstruction. DNNs typically learn data-driven priors from large datasets constituting pairs of undersampled and fully-sampled acquisitions. Acquiring such…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Salman Ul Hassan Dar , Mahmut Yurt , Tolga Çukur

Recently, the use of bio-inspired learning techniques such as Hebbian learning and its closely-related Spike-Timing-Dependent Plasticity (STDP) variant have drawn significant attention for the design of compute-efficient AI systems that can…

Neural and Evolutionary Computing · Computer Science 2024-11-19 Ali Safa

Event-based machine learning promises more energy-efficient AI on future neuromorphic hardware. Here, we investigate how the recently discovered Eventprop algorithm for gradient descent on exact gradients in spiking neural networks can be…

Neural and Evolutionary Computing · Computer Science 2025-02-03 Thomas Nowotny , James P. Turner , James C. Knight

Few-shot learning (FSL) techniques seek to learn the underlying patterns in data using fewer samples, analogous to how humans learn from limited experience. In this limited-data scenario, the challenges associated with deep neural networks,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Deepan Chakravarthi Padmanabhan , Shruthi Gowda , Elahe Arani , Bahram Zonooz

We demonstrate that scalable neuromorphic hardware can implement the finite element method, which is a critical numerical method for engineering and scientific discovery. Our approach maps the sparse interactions between neighboring finite…

Neural and Evolutionary Computing · Computer Science 2025-01-22 Bradley H. Theilman , James B. Aimone

This work is motivated by the recent advances in Deep Neural Networks (DNNs) and their widespread applications in human-machine interfaces. DNNs have been recently used for detecting the intended hand gesture through processing of surface…

Machine Learning · Computer Science 2020-11-13 Elahe Rahimian , Soheil Zabihi , Amir Asif , Dario Farina , Seyed Farokh Atashzar , Arash Mohammadi

Event-based neuromorphic systems promise to reduce the energy consumption of deep learning tasks by replacing expensive floating point operations on dense matrices by low power sparse and asynchronous operations on spike events. While these…

Neural and Evolutionary Computing · Computer Science 2019-06-04 Johannes Christian Thiele , Olivier Bichler , Antoine Dupret

Metric learning is a widely used method for few shot learning in which the quality of prototypes plays a key role in the algorithm. In this paper we propose the trainable prototypes for distance measure instead of the artificial ones within…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Jianyi Li , Guizhong Liu

Being very low power, the use of neuromorphic processors in mobile devices to solve machine learning problems is a promising alternative to traditional Von Neumann processors. Federated Learning enables entities such as mobile devices to…

Machine Learning · Computer Science 2020-11-04 Kenneth Stewart , Yanqi Gu

Many applications of deep learning for image generation use perceptual losses for either training or fine-tuning of the generator networks. The use of perceptual loss however incurs repeated forward-backward passes in a large image…

Machine Learning · Computer Science 2021-05-06 Dmitry Nikulin , Roman Suvorov , Aleksei Ivakhnenko , Victor Lempitsky

Most of the existing deep neural nets on automatic facial expression recognition focus on a set of predefined emotion classes, where the amount of training data has the biggest impact on performance. However, in the standard setting…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Anca-Nicoleta Ciubotaru , Arnout Devos , Behzad Bozorgtabar , Jean-Philippe Thiran , Maria Gabrani

Humans are capable of learning new concepts from small numbers of examples. In contrast, supervised deep learning models usually lack the ability to extract reliable predictive rules from limited data scenarios when attempting to classify…

Machine Learning · Computer Science 2020-07-17 Zhongjie Yu , Sebastian Raschka

In this study, we propose and analyze in simulations a new, highly flexible method of implementing synaptic plasticity in a wafer-scale, accelerated neuromorphic hardware system. The study focuses on globally modulated STDP, as a special…

Neurons and Cognition · Quantitative Biology 2013-08-21 Simon Friedmann , Nicolas Frémaux , Johannes Schemmel , Wulfram Gerstner , Karlheinz Meier

Spiking Neural Networks (SNNs) offer inherent advantages for low-power inference through sparse, event-driven computation. However, the theoretical energy benefits of SNNs are often decoupled from real hardware performance due to the opaque…

Hardware Architecture · Computer Science 2026-03-27 Ilkin Aliyev , Jesus Lopez , Tosiron Adegbija

We seek to investigate the scalability of neuromorphic computing for computer vision, with the objective of replicating non-neuromorphic performance on computer vision tasks while reducing power consumption. We convert the deep Artificial…

Neural and Evolutionary Computing · Computer Science 2021-06-17 Kinjal Patel , Eric Hunsberger , Sean Batir , Chris Eliasmith

Despite its importance for federated learning, continuous learning and many other applications, on-device training remains an open problem for EdgeAI. The problem stems from the large number of operations (e.g., floating point…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Yuedong Yang , Guihong Li , Radu Marculescu