English
Related papers

Related papers: Multilingual Few-Shot Learning via Language Model …

200 papers

We introduce a few-shot transfer learning method for keyword spotting in any language. Leveraging open speech corpora in nine languages, we automate the extraction of a large multilingual keyword bank and use it to train an embedding model.…

Computation and Language · Computer Science 2021-09-13 Mark Mazumder , Colby Banbury , Josh Meyer , Pete Warden , Vijay Janapa Reddi

Large-scale generative language models such as GPT-3 are competitive few-shot learners. While these models are known to be able to jointly represent many different languages, their training data is dominated by English, potentially limiting…

We explore the use of large pretrained language models as few-shot semantic parsers. The goal in semantic parsing is to generate a structured meaning representation given a natural language input. However, language models are trained to…

Even though large pre-trained multilingual models (e.g. mBERT, XLM-R) have led to significant performance gains on a wide range of cross-lingual NLP tasks, success on many downstream tasks still relies on the availability of sufficient…

Computation and Language · Computer Science 2021-09-07 M Saiful Bari , Batool Haider , Saab Mansour

Language models exhibit an emergent ability to learn a new task from a small number of input-output demonstrations. However, recent work shows that in-context learners largely rely on their pre-trained knowledge, such as the sentiment of…

Computation and Language · Computer Science 2023-07-20 Michal Štefánik , Marek Kadlčík

Few-shot learning is a promising way for reducing the label cost in new categories adaptation with the guidance of a small, well labeled support set. But for few-shot semantic segmentation, the pixel-level annotations of support images are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Jing Wang , Yuang Liu , Qiang Zhou , Fan Wang

Few-shot Learning (FSL) aims to classify new concepts from a small number of examples. While there have been an increasing amount of work on few-shot object classification in the last few years, most current approaches are limited to images…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Mathieu Pagé Fortin , Brahim Chaib-draa

Few-shot Continual Relation Extraction is a crucial challenge for enabling AI systems to identify and adapt to evolving relationships in dynamic real-world domains. Traditional memory-based approaches often overfit to limited samples,…

Computation and Language · Computer Science 2025-03-03 Nguyen Xuan Thanh , Anh Duc Le , Quyen Tran , Thanh-Thien Le , Linh Ngo Van , Thien Huu Nguyen

Few-shot crosslingual transfer has been shown to outperform its zero-shot counterpart with pretrained encoders like multilingual BERT. Despite its growing popularity, little to no attention has been paid to standardizing and analyzing the…

Computation and Language · Computer Science 2021-06-03 Mengjie Zhao , Yi Zhu , Ehsan Shareghi , Ivan Vulić , Roi Reichart , Anna Korhonen , Hinrich Schütze

Few-shot learning refers to understanding new concepts from only a few examples. We propose an information retrieval-inspired approach for this problem that is motivated by the increased importance of maximally leveraging all the available…

Machine Learning · Computer Science 2017-11-15 Eleni Triantafillou , Richard Zemel , Raquel Urtasun

Providing better language tools for low-resource and endangered languages is imperative for equitable growth. Recent progress with massively multilingual pretrained models has proven surprisingly effective at performing zero-shot transfer…

Computation and Language · Computer Science 2022-11-10 Louis Clouâtre , Prasanna Parthasarathi , Amal Zouaq , Sarath Chandar

Few-shot detection is a major task in pattern recognition which seeks to localize objects using models trained with few labeled data. One of the mainstream few-shot methods is transfer learning which consists in pretraining a detection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Jie Mei , Mingyuan Jiu , Hichem Sahbi , Xiaoheng Jiang , Mingliang Xu

Recent research on sequence labelling has been exploring different strategies to mitigate the lack of manually annotated data for the large majority of the world languages. Among others, the most successful approaches have been based on (i)…

Computation and Language · Computer Science 2024-07-30 Anar Yeginbergen , Maite Oronoz , Rodrigo Agerri

In this paper, we explore meta-learning for few-shot text classification. Meta-learning has shown strong performance in computer vision, where low-level patterns are transferable across learning tasks. However, directly applying this…

Computation and Language · Computer Science 2020-02-19 Yujia Bao , Menghua Wu , Shiyu Chang , Regina Barzilay

In recent years, pre-trained large language models (LLMs) have demonstrated remarkable efficiency in achieving an inference-time few-shot learning capability known as in-context learning. However, existing literature has highlighted the…

Computation and Language · Computer Science 2024-02-14 Xinyi Wang , Wanrong Zhu , Michael Saxon , Mark Steyvers , William Yang Wang

Human learning benefits from multi-modal inputs that often appear as rich semantics (e.g., description of an object's attributes while learning about it). This enables us to learn generalizable concepts from very limited visual examples.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Mohamed Afham , Salman Khan , Muhammad Haris Khan , Muzammal Naseer , Fahad Shahbaz Khan

Few-shot learning that trains image classifiers over few labeled examples per category is a challenging task. In this paper, we propose to exploit an additional big dataset with different categories to improve the accuracy of few-shot…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Liangqu Long , Wei Wang , Jun Wen , Meihui Zhang , Qian Lin , Beng Chin Ooi

Few-shot learning has been studied to adapt models to tasks with very few samples. It holds profound significance, particularly in clinical tasks, due to the high annotation cost of medical images. Several works have explored few-shot…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Kaipeng Zheng , Weiran Huang , Lichao Sun

In-context learning has become an important approach for few-shot learning in Large Language Models because of its ability to rapidly adapt to new tasks without fine-tuning model parameters. However, it is restricted to applications in…

Machine Learning · Computer Science 2023-10-16 Christopher Fifty , Jure Leskovec , Sebastian Thrun

Stance detection aims to identify whether the author of a text is in favor of, against, or neutral to a given target. The main challenge of this task comes two-fold: few-shot learning resulting from the varying targets and the lack of…

Computation and Language · Computer Science 2022-06-28 Yan Jiang , Jinhua Gao , Huawei Shen , Xueqi Cheng