English
Related papers

Related papers: Bit-Width-Aware Design Environment for Few-Shot Le…

200 papers

Field Programmable Gate Arrays (FPGAs) plays an increasingly important role in data sampling and processing industries due to its highly parallel architecture, low power consumption, and flexibility in custom algorithms. Especially, in the…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Yufeng Hao

Few-shot algorithms aim at learning new tasks provided only a handful of training examples. In this work we investigate few-shot learning in the setting where the data points are sequences of tokens and propose an efficient learning…

Machine Learning · Computer Science 2020-12-18 Lajanugen Logeswaran , Ann Lee , Myle Ott , Honglak Lee , Marc'Aurelio Ranzato , Arthur Szlam

Few-shot learning aims at leveraging knowledge learned by one or more deep learning models, in order to obtain good classification performance on new problems, where only a few labeled samples per class are available. Recent years have seen…

Machine Learning · Computer Science 2022-02-08 Yassir Bendou , Yuqing Hu , Raphael Lafargue , Giulia Lioi , Bastien Pasdeloup , Stéphane Pateux , Vincent Gripon

Edge computing devices inherently face tight resource constraints, which is especially apparent when deploying Deep Neural Networks (DNN) with high memory and compute demands. FPGAs are commonly available in edge devices. Since these…

Hardware Architecture · Computer Science 2021-10-04 Jude Haris , Perry Gibson , José Cano , Nicolas Bohm Agostini , David Kaeli

On-device transfer learning is crucial for adapting a common backbone model to the unique environment of each edge device. Tiny microcontrollers, such as the Raspberry Pi Pico, are key targets for on-device learning but often lack…

Machine Learning · Computer Science 2025-03-24 Honoka Anada , Sefutsu Ryu , Masayuki Usui , Tatsuya Kaneko , Shinya Takamaeda-Yamazaki

The use of low-precision fixed-point arithmetic along with stochastic rounding has been proposed as a promising alternative to the commonly used 32-bit floating point arithmetic to enhance training neural networks training in terms of…

Machine Learning · Computer Science 2018-04-17 Marc Ortiz , Adrián Cristal , Eduard Ayguadé , Marc Casas

Few-Shot Learning is the challenge of training a model with only a small amount of data. Many solutions to this problem use meta-learning algorithms, i.e. algorithms that learn to learn. By sampling few-shot tasks from a larger dataset, we…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Etienne Bennequin

Recent NLP models have shown the remarkable ability to effectively generalise `zero-shot' to new tasks using only natural language instructions as guidance. However, many of these approaches suffer from high computational costs due to their…

Computation and Language · Computer Science 2023-05-26 Hamish Ivison , Akshita Bhagia , Yizhong Wang , Hannaneh Hajishirzi , Matthew Peters

We use the EMNIST dataset of handwritten digits to test a simple approach for few-shot learning. A fully connected neural network is pre-trained with a subset of the 10 digits and used for few-shot learning with untrained digits. Two basic…

Machine Learning · Computer Science 2020-09-22 Detlef Schmicker

The rapid advancement of neural network applications necessitates hardware that not only accelerates computation but also adapts efficiently to dynamic processing requirements. While processing-in-pixel has emerged as a promising solution…

Hardware Architecture · Computer Science 2024-08-21 Zihan Yin , Akhilesh Jaiswal

Purpose: Visual perception enables robots to perceive the environment. Visual data is processed using computer vision algorithms that are usually time-expensive and require powerful devices to process the visual data in real-time, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Sandro Costa Magalhães , Filipe Neves Santos , Pedro Machado , António Paulo Moreira , Jorge Dias

Modern AI hardware, such as Nvidia's Blackwell architecture, is increasingly embracing low-precision floating-point (FP) formats to handle the pervasive activation outliers in Large Language Models (LLMs). Despite this industry trend, a…

Machine Learning · Computer Science 2025-10-30 Mengzhao Chen , Meng Wu , Hui Jin , Zhihang Yuan , Jing Liu , Chaoyi Zhang , Yunshui Li , Jie Huang , Jin Ma , Zeyue Xue , Zhiheng Liu , Xingyan Bin , Ping Luo

Few-shot learning (FSL) techniques seek to learn the underlying patterns in data using fewer samples, analogous to how humans learn from limited experience. In this limited-data scenario, the challenges associated with deep neural networks,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Deepan Chakravarthi Padmanabhan , Shruthi Gowda , Elahe Arani , Bahram Zonooz

Both few-shot learning and domain adaptation sub-fields in Computer Vision have seen significant recent progress in terms of the availability of state-of-the-art algorithms and datasets. Frameworks have been developed for each sub-field;…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Bharadwaj Ravichandran , Alexander Lynch , Sarah Brockman , Brandon RichardWebster , Dawei Du , Anthony Hoogs , Christopher Funk

Circuit knitting emerges as a promising technique to overcome the limitation of the few physical qubits in near-term quantum hardware by cutting large quantum circuits into smaller subcircuits. Recent research in this area has been…

Hardware Architecture · Computer Science 2024-09-09 Xiangyu Ren , Mengyu Zhang , Antonio Barbalace

Few-shot object detection (FSOD) aims to detect objects using only a few examples. How to adapt state-of-the-art object detectors to the few-shot domain remains challenging. Object proposal is a key ingredient in modern object detectors.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Guangxing Han , Shiyuan Huang , Jiawei Ma , Yicheng He , Shih-Fu Chang

Recent hardware acceleration advances have enabled powerful specialized accelerators for finite element computations, spiking neural network inference, and sparse tensor operations. However, existing approaches face fundamental limitations:…

Hardware Architecture · Computer Science 2026-01-09 Chuanzhen Wang , Leo Zhang , Eric Liu

Traditional shape descriptors have been gradually replaced by convolutional neural networks due to their superior performance in feature extraction and classification. The state-of-the-art methods recognize object shapes via image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Wenlong Shi , Changsheng Lu , Ming Shao , Yinjie Zhang , Siyu Xia , Piotr Koniusz

The ability to learn from a small number of examples has been a difficult problem in machine learning since its inception. While methods have succeeded with large amounts of training data, research has been underway in how to accomplish…

Machine Learning · Computer Science 2017-08-24 Nathan Hilliard , Nathan O. Hodas , Courtney D. Corley

Accurate and low-latency qubit state measurement is critical for trapped-ion quantum computing. While deep neural networks (DNNs) have been integrated to enhance detection fidelity, their latency performance on specific hardware platforms…