English
Related papers

Related papers: On Training Instance Selection for Few-Shot Neural…

200 papers

Recently, prompt-based methods have achieved significant performance in few-shot learning scenarios by bridging the gap between language model pre-training and fine-tuning for downstream tasks. However, existing prompt templates are mostly…

Computation and Language · Computer Science 2022-03-09 Liwen Wang , Rumei Li , Yang Yan , Yuanmeng Yan , Sirui Wang , Wei Wu , Weiran Xu

Many tasks related to Computational Social Science and Web Content Analysis involve classifying pieces of text based on the claims they contain. State-of-the-art approaches usually involve fine-tuning models on large annotated datasets,…

Computation and Language · Computer Science 2024-05-10 Sandrine Chausson , Björn Ross

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal

A large number of annotated training images is crucial for training successful scene text recognition models. However, collecting sufficient datasets can be a labor-intensive and costly process, particularly for low-resource languages. To…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Yangchen Xie , Xinyuan Chen , Hongjian Zhan , Palaiahankote Shivakum , Bing Yin , Cong Liu , Yue Lu

In-context learning enables language models (LM) to adapt to downstream data or tasks by incorporating few samples as demonstrations within the prompts. It offers strong performance without the expense of fine-tuning. However, the…

Computation and Language · Computer Science 2024-10-15 Jian Gu , Aldeida Aleti , Chunyang Chen , Hongyu Zhang

Self-training provides an effective means of using an extremely small amount of labeled data to create pseudo-labels for unlabeled data. Many state-of-the-art self-training approaches hinge on different regularization methods to prevent…

Computation and Language · Computer Science 2022-02-08 Hazel Kim , Jaeman Son , Yo-Sub Han

Objective: Few-shot learning (FSL) methods require small numbers of labeled instances for training. As many medical topics have limited annotated textual data in practical settings, FSL-based natural language processing (NLP) methods hold…

Computation and Language · Computer Science 2022-05-02 Yao Ge , Yuting Guo , Yuan-Chi Yang , Mohammed Ali Al-Garadi , Abeed Sarker

While state-of-the-art models that rely upon massively multilingual pretrained encoders achieve sample efficiency in downstream applications, they still require abundant amounts of unlabelled text. Nevertheless, most of the world's…

Computation and Language · Computer Science 2024-02-16 Yaoyiran Li , Edoardo M. Ponti , Ivan Vulić , Anna Korhonen

Few-shot learning aims to recognize novel classes from a few examples. Although significant progress has been made in the image domain, few-shot video classification is relatively unexplored. We argue that previous methods underestimate the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Yongqin Xian , Bruno Korbar , Matthijs Douze , Lorenzo Torresani , Bernt Schiele , Zeynep Akata

Few-shot learning deals with problems such as image classification using very few training examples. Recent vision foundation models show excellent few-shot transfer abilities, but are large and slow at inference. Using knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Erik Landolsi , Fredrik Kahl

The remarkable advancements in large language models (LLMs) have significantly enhanced the performance in few-shot learning settings. By using only a small number of labeled examples, referred to as demonstrations, LLMs can effectively…

Computation and Language · Computer Science 2023-11-23 Katerina Margatina , Timo Schick , Nikolaos Aletras , Jane Dwivedi-Yu

Episodic training is a mainstream training strategy for few-shot learning. In few-shot scenarios, however, this strategy is often inferior to some non-episodic training strategy, e. g., Neighbourhood Component Analysis (NCA), which…

Machine Learning · Computer Science 2024-02-02 Tao Zhang

Demonstration-based learning has shown great potential in stimulating pretrained language models' ability under limited data scenario. Simply augmenting the input with some demonstrations can significantly improve performance on few-shot…

Computation and Language · Computer Science 2022-10-20 Hongxin Zhang , Yanzhe Zhang , Ruiyi Zhang , Diyi Yang

Large Language Models (LLMs) operating in 0-shot or few-shot settings achieve competitive results in Text Classification tasks. In-Context Learning (ICL) typically achieves better accuracy than the 0-shot setting, but it pays in terms of…

Computation and Language · Computer Science 2024-04-04 Parth Patwa , Simone Filice , Zhiyu Chen , Giuseppe Castellucci , Oleg Rokhlenko , Shervin Malmasi

A supervised ranking model, despite its advantage of being effective, usually involves complex processing - typically multiple stages of task-specific pre-training and fine-tuning. This has motivated researchers to explore simpler pipelines…

Information Retrieval · Computer Science 2024-10-08 Nilanjan Sinhababu , Andrew Parry , Debasis Ganguly , Debasis Samanta , Pabitra Mitra

Prior work on language models (LMs) shows that training on a large number of diverse tasks improves few-shot learning (FSL) performance on new tasks. We take this to the extreme, automatically extracting 413,299 tasks from internet tables -…

Computation and Language · Computer Science 2022-08-09 Jun Shern Chan , Michael Pieler , Jonathan Jao , Jérémy Scheurer , Ethan Perez

Short text clustering is a challenging task due to the lack of signal contained in such short texts. In this work, we propose iterative classification as a method to b o ost the clustering quality (e.g., accuracy) of short texts. Given a…

Information Retrieval · Computer Science 2020-02-03 Md Rashadul Hasan Rakib , Norbert Zeh , Magdalena Jankowska , Evangelos Milios

Conventional text style transfer approaches focus on sentence-level style transfer without considering contextual information, and the style is described with attributes (e.g., formality). When applying style transfer in conversations such…

Computation and Language · Computer Science 2023-09-25 Shamik Roy , Raphael Shu , Nikolaos Pappas , Elman Mansimov , Yi Zhang , Saab Mansour , Dan Roth

In high-stakes domains such as healthcare, the reliability of Large Language Models (LLMs) is critical, particularly when generating clinical insights from incident reports. This study proposes a tag-based few-shot example selection method…

Computation and Language · Computer Science 2026-05-12 Yuna Haseyama , Tomoki Ito , Hiroki Sakaji , Itsuki Noda

Neural table-to-text generation models have achieved remarkable progress on an array of tasks. However, due to the data-hungry nature of neural models, their performances strongly rely on large-scale training examples, limiting their…

Computation and Language · Computer Science 2021-09-01 Yixuan Su , Zaiqiao Meng , Simon Baker , Nigel Collier