English
Related papers

Related papers: On-chip Few-shot Learning with Surrogate Gradient …

200 papers

Large pretrained language models (LMs) like BERT have improved performance in many disparate natural language processing (NLP) tasks. However, fine tuning such models requires a large number of training examples for each target task.…

Computation and Language · Computer Science 2022-01-28 Jixuan Wang , Kuan-Chieh Wang , Frank Rudzicz , Michael Brudno

The use of a few examples for each class to train a predictive model that can be generalized to novel classes is a crucial and valuable research direction in artificial intelligence. This work addresses this problem by proposing a few-shot…

Machine Learning · Computer Science 2020-09-10 Bin Xiao , Chien-Liang Liu , Wen-Hoar Hsaio

Biological sensing and processing is asynchronous and sparse, leading to low-latency and energy-efficient perception and action. In robotics, neuromorphic hardware for event-based vision and spiking neural networks promises to exhibit…

This paper presents ProFi-Net, a novel few-shot learning framework for WiFi-based gesture recognition that overcomes the challenges of limited training data and sparse feature representations. ProFi-Net employs a prototype-based metric…

Machine Learning · Computer Science 2025-04-30 Zhe Cui , Shuxian Zhang , Kangzhi Lou , Le-Nam Tran

Meta learning approaches to few-shot classification are computationally efficient at test time, requiring just a few optimization steps or single forward pass to learn a new task, but they remain highly memory-intensive to train. This…

Despite the tremendous success of deep neural networks in medical image segmentation, they typically require a large amount of costly, expert-level annotated data. Few-shot segmentation approaches address this issue by learning to transfer…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Qinji Yu , Kang Dang , Nima Tajbakhsh , Demetri Terzopoulos , Xiaowei Ding

Neuromorphic computing applies insights from neuroscience to uncover innovations in computing technology. In the brain, billions of interconnected neurons perform rapid computations at extremely low energy levels by leveraging properties…

Neural and Evolutionary Computing · Computer Science 2020-04-28 E. Paxon Frady , Garrick Orchard , David Florey , Nabil Imam , Ruokun Liu , Joyesh Mishra , Jonathan Tse , Andreas Wild , Friedrich T. Sommer , Mike Davies

Thanks to their parallel and sparse activity features, recurrent neural networks (RNNs) are well-suited for hardware implementation in low-power neuromorphic hardware. However, mapping rate-based RNNs to hardware-compatible spiking neural…

Neural and Evolutionary Computing · Computer Science 2024-07-19 Gauthier Boeshertz , Giacomo Indiveri , Manu Nair , Alpha Renner

Most approaches in few-shot learning rely on costly annotated data related to the goal task domain during (pre-)training. Recently, unsupervised meta-learning methods have exchanged the annotation requirement for a reduction in few-shot…

Machine Learning · Computer Science 2020-06-23 Carlos Medina , Arnout Devos , Matthias Grossglauser

An important difference between brains and deep neural networks is the way they learn. Nervous systems learn online where a stream of noisy data points are presented in a non-independent, identically distributed (non-i.i.d.) way. Further,…

Neural and Evolutionary Computing · Computer Science 2023-07-28 Nick Alonso , Jeff Krichmar

Emulating spiking neural networks on analog neuromorphic hardware offers several advantages over simulating them on conventional computers, particularly in terms of speed and energy consumption. However, this usually comes at the cost of…

Imitation learning enables intelligent systems to acquire complex behaviors with minimal supervision. However, existing methods often focus on short-horizon skills, require large datasets, and struggle to solve long-horizon tasks or…

Robotics · Computer Science 2025-09-01 Pierrick Lorang , Hong Lu , Johannes Huemer , Patrik Zips , Matthias Scheutz

Spiking Neural Networks are attracting increased attention as a more energy-efficient alternative to traditional Artificial Neural Networks for edge computing. Neuromorphic computing can significantly reduce energy requirements. Here, we…

Neural and Evolutionary Computing · Computer Science 2025-10-16 Balázs Mészáros , James C. Knight , Jonathan Timcheck , Thomas Nowotny

Graph neural networks have emerged as a specialized branch of deep learning, designed to address problems where pairwise relations between objects are crucial. Recent advancements utilize graph convolutional neural networks to extract…

Emerging Technologies · Computer Science 2024-04-29 Shay Snyder , Victoria Clerico , Guojing Cong , Shruti Kulkarni , Catherine Schuman , Sumedh R. Risbud , Maryam Parsa

Neuromorphic hardware platforms, such as Intel's Loihi chip, support the implementation of Spiking Neural Networks (SNNs) as an energy-efficient alternative to Artificial Neural Networks (ANNs). SNNs are networks of neurons with internal…

Machine Learning · Computer Science 2019-12-19 Hyeryung Jang , Osvaldo Simeone

Few-shot learning (learning with a few samples) is one of the most important cognitive abilities of the human brain. However, the current artificial intelligence systems meet difficulties in achieving this ability. Similar challenges also…

Neural and Evolutionary Computing · Computer Science 2022-12-06 Yang Li , Yiting Dong , Dongcheng Zhao , Yi Zeng

On-chip learning in a crossbar array based analog hardware Neural Network (NN) has been shown to have major advantages in terms of speed and energy compared to training NN on a traditional computer. However analog hardware NN proposals and…

Neural and Evolutionary Computing · Computer Science 2019-07-02 Nilabjo Dey , Janak Sharda , Utkarsh Saxena , Divya Kaushik , Utkarsh Singh , Debanjan Bhowmik

We consider the task of few shot link prediction on graphs. The goal is to learn from a distribution over graphs so that a model is able to quickly infer missing edges in a new graph after a small amount of training. We show that current…

Machine Learning · Computer Science 2020-03-03 Avishek Joey Bose , Ankit Jain , Piero Molino , William L. Hamilton

Neuromorphic computing systems are set to revolutionize energy-constrained robotics by achieving orders-of-magnitude efficiency gains, while enabling native temporal processing. Spiking Neural Networks (SNNs) represent a promising…

Artificial Intelligence · Computer Science 2025-10-29 Korneel Van den Berghe , Stein Stroobants , Vijay Janapa Reddi , G. C. H. E. de Croon

There is a growing demand for low-power, autonomously learning artificial intelligence (AI) systems that can be applied at the edge and rapidly adapt to the specific situation at deployment site. However, current AI models struggle in such…