English
Related papers

Related papers: Few-shot learning approaches for classifying low r…

200 papers

Deep neural networks require large training sets but suffer from high computational cost and long training times. Training on much smaller training sets while maintaining nearly the same accuracy would be very beneficial. In the few-shot…

Machine Learning · Computer Science 2021-08-09 Ilia Sucholutsky , Matthias Schonlau

This paper evaluates Few-Shot Prompting with Large Language Models for Named Entity Recognition (NER). Traditional NER systems rely on extensive labeled datasets, which are costly and time-consuming to obtain. Few-Shot Prompting or…

Information Retrieval · Computer Science 2024-09-05 Hédi Zeghidi , Ludovic Moncla

Few-shot learning benchmarks are critical for evaluating modern NLP techniques. It is possible, however, that benchmarks favor methods which easily make use of unlabeled text, because researchers can use unlabeled text from the test set to…

Computation and Language · Computer Science 2024-10-03 Kush Dubey

In this paper, we tackle the new Cross-Domain Few-Shot Learning benchmark proposed by the CVPR 2020 Challenge. To this end, we build upon state-of-the-art methods in domain adaptation and few-shot learning to create a system that can be…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 John Cai , Sheng Mei Shen

Few-shot text classification is a fundamental NLP task in which a model aims to classify text into a large number of categories, given only a few training examples per category. This paper explores data augmentation -- a technique…

Computation and Language · Computer Science 2021-06-16 Jason Wei , Chengyu Huang , Soroush Vosoughi , Yu Cheng , Shiqi Xu

Even though large pre-trained multilingual models (e.g. mBERT, XLM-R) have led to significant performance gains on a wide range of cross-lingual NLP tasks, success on many downstream tasks still relies on the availability of sufficient…

Computation and Language · Computer Science 2021-09-07 M Saiful Bari , Batool Haider , Saab Mansour

Most of the recent few-shot learning (FSL) algorithms are based on transfer learning, where a model is pre-trained using a large amount of source data, and the pre-trained model is fine-tuned using a small amount of target data. In transfer…

Machine Learning · Computer Science 2022-08-22 Yujin Kim , Jaehoon Oh , Sungnyun Kim , Se-Young Yun

Microscopy data collections are becoming larger and more frequent. Accurate and precise quantitative analysis tools like cell instance segmentation are necessary to benefit from them. This is challenging due to the variability in the data,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Ram J. Zaveri , Voke Brume , Gianfranco Doretto

Training a neural network model that can quickly adapt to a new task is highly desirable yet challenging for few-shot learning problems. Recent few-shot learning methods mostly concentrate on developing various meta-learning strategies from…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Zihang Jiang , Bingyi Kang , Kuangqi Zhou , Jiashi Feng

Most of the existing deep neural nets on automatic facial expression recognition focus on a set of predefined emotion classes, where the amount of training data has the biggest impact on performance. However, in the standard setting…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Anca-Nicoleta Ciubotaru , Arnout Devos , Behzad Bozorgtabar , Jean-Philippe Thiran , Maria Gabrani

Few-shot learning refers to understanding new concepts from only a few examples. We propose an information retrieval-inspired approach for this problem that is motivated by the increased importance of maximally leveraging all the available…

Machine Learning · Computer Science 2017-11-15 Eleni Triantafillou , Richard Zemel , Raquel Urtasun

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal

Few-shot classification aims to learn a classifier to recognize unseen classes during training with limited labeled examples. While significant progress has been made, the growing complexity of network designs, meta-learning algorithms, and…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Wei-Yu Chen , Yen-Cheng Liu , Zsolt Kira , Yu-Chiang Frank Wang , Jia-Bin Huang

Pretrained language models have improved zero-shot text classification by allowing the transfer of semantic knowledge from the training data in order to classify among specific label sets in downstream tasks. We propose a simple way to…

Computation and Language · Computer Science 2023-10-24 Lingyu Gao , Debanjan Ghosh , Kevin Gimpel

Training or finetuning large-scale language models (LLMs) such as GPT-3 requires substantial computation resources, motivating recent efforts to explore parameter-efficient adaptation to downstream tasks. One practical area of research is…

Computation and Language · Computer Science 2023-10-23 Danqing Luo , Chen Zhang , Jiahui Xu , Bin Wang , Yiming Chen , Yan Zhang , Haizhou Li

Large pre-trained language models have shown promise for few-shot learning, completing text-based tasks given only a few task-specific examples. Will models soon solve classification tasks that have so far been reserved for human research…

Over the last couple of years few-shot learning (FSL) has attracted great attention towards minimizing the dependency on labeled training examples. An inherent difficulty in FSL is the handling of ambiguities resulting from having too few…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Orhun Buğra Baran , Ramazan Gökberk Cinbiş

Automated surgical skill assessment (SSA) is a central task in surgical computer vision. Developing robust SSA models is challenging due to the scarcity of skill annotations, which are time-consuming to produce and require expert consensus.…

Few-shot learning (FSL) is the task of learning to recognize previously unseen categories of images from a small number of training examples. This is a challenging task, as the available examples may not be enough to unambiguously determine…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Kun Yan , Zied Bouraoui , Ping Wang , Shoaib Jameel , Steven Schockaert

Existing approaches to few-shot learning in NLP rely on large language models (LLMs) and/or fine-tuning of these to generalise on out-of-distribution data. In this work, we propose a novel few-shot learning approach based on soft-label…

Machine Learning · Computer Science 2024-09-24 Avyav Kumar Singh , Ekaterina Shutova , Helen Yannakoudakis