English
Related papers

Related papers: Assertion Enhanced Few-Shot Learning: Instructive …

200 papers

Large language models have exhibited intriguing in-context learning capability, achieving promising zero- and few-shot performance without updating the parameters. However, conventional in-context learning is usually restricted by length…

Computation and Language · Computer Science 2022-12-14 Yaru Hao , Yutao Sun , Li Dong , Zhixiong Han , Yuxian Gu , Furu Wei

The existing event classification (EC) work primarily focuseson the traditional supervised learning setting in which models are unableto extract event mentions of new/unseen event types. Few-shot learninghas not been investigated in this…

Computation and Language · Computer Science 2020-06-22 Viet Dac Lai , Franck Dernoncourt , Thien Huu Nguyen

Machine learning classifiers are often trained to recognize a set of pre-defined classes. However, in many applications, it is often desirable to have the flexibility of learning additional concepts, with limited data and without…

Machine Learning · Computer Science 2019-10-08 Mengye Ren , Renjie Liao , Ethan Fetaya , Richard S. Zemel

Few-shot learning aims to train models that can recognize novel classes given just a handful of labeled examples, known as the support set. While the field has seen notable advances in recent years, they have often focused on multi-class…

Sound · Computer Science 2021-10-20 Yu Wang , Nicholas J. Bryan , Justin Salamon , Mark Cartwright , Juan Pablo Bello

Current literature demonstrates that Large Language Models (LLMs) are great few-shot learners, and prompting significantly increases their performance on a range of downstream tasks in a few-shot learning setting. An attempt to automate…

Computation and Language · Computer Science 2023-06-26 Yulin Zhou , Yiren Zhao , Ilia Shumailov , Robert Mullins , Yarin Gal

Thinking aloud is an effective meta-cognitive strategy human reasoners apply to solve difficult problems. We suggest to improve the reasoning ability of pre-trained neural language models in a similar way, namely by expanding a task's…

Computation and Language · Computer Science 2021-03-25 Gregor Betz , Kyle Richardson , Christian Voigt

This paper introduces a novel approach for efficiently distilling LLMs into smaller, application-specific models, significantly reducing operational costs and manual labor. Addressing the challenge of deploying computationally intensive…

Computation and Language · Computer Science 2024-03-26 Lukas Vöge , Vincent Gurgul , Stefan Lessmann

While many methods purport to explain predictions by highlighting salient features, what aims these explanations serve and how they ought to be evaluated often go unstated. In this work, we introduce a framework to quantify the value of…

Continual learning strives to ensure stability in solving previously seen tasks while demonstrating plasticity in a novel domain. Recent advances in continual learning are mostly confined to a supervised learning setting, especially in NLP…

Machine Learning · Computer Science 2024-06-03 Stella Ho , Ming Liu , Shang Gao , Longxiang Gao

Recent works have shown that chain-of-thought (CoT) prompting can elicit language models to solve complex reasoning tasks, step-by-step. However, prompt-based CoT methods are dependent on very large models such as GPT-3 175B which are…

Computation and Language · Computer Science 2023-06-14 Namgyu Ho , Laura Schmid , Se-Young Yun

Few-shot learning (FSL) presents a challenging learning problem in which only a few samples are available for each class. Decision interpretation is more important in few-shot classification due to a greater chance of error compared to…

Machine Learning · Computer Science 2025-04-01 Mohammad Reza Zarei , Majid Komeili

Recent work on few-shot learning \cite{tian2020rethinking} showed that quality of learned representations plays an important role in few-shot classification performance. On the other hand, the goal of self-supervised learning is to recover…

Machine Learning · Computer Science 2021-01-26 Nathaniel Simard , Guillaume Lagrange

Few-shot class incremental learning implies the model to learn new classes while retaining knowledge of previously learned classes with a small number of training instances. Existing frameworks typically freeze the parameters of the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Parinita Nema , Vinod K Kurmi

Few-shot Continual Relation Extraction is a crucial challenge for enabling AI systems to identify and adapt to evolving relationships in dynamic real-world domains. Traditional memory-based approaches often overfit to limited samples,…

Computation and Language · Computer Science 2025-03-03 Nguyen Xuan Thanh , Anh Duc Le , Quyen Tran , Thanh-Thien Le , Linh Ngo Van , Thien Huu Nguyen

We introduce a new paradigm of learning for reasoning, understanding, and prediction, as well as the scaffolding network to implement this paradigm. The scaffolding network embodies an incremental learning approach that is formulated as a…

Computation and Language · Computer Science 2017-05-23 Asli Celikyilmaz , Li Deng , Lihong Li , Chong Wang

Large language models (LLMs) hold great promise for educational applications, particularly in intelligent tutoring systems. However, effective tutoring requires alignment with pedagogical strategies - something current LLMs lack without…

Computation and Language · Computer Science 2025-06-10 Kseniia Petukhova , Ekaterina Kochmar

New classes of sounds constantly emerge with a few samples, making it challenging for models to adapt to dynamic acoustic environments. This challenge motivates us to address the new problem of few-shot class-incremental audio…

Sound · Computer Science 2023-05-30 Wei Xie , Yanxiong Li , Qianhua He , Wenchang Cao , Tuomas Virtanen

Autonomous agents interacting with the real world need to learn new concepts efficiently and reliably. This requires learning in a low-data regime, which is a highly challenging problem. We address this task by introducing a fast…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Ardhendu Shekhar Tripathi , Martin Danelljan , Luc Van Gool , Radu Timofte

Sentiment analysis is an important task in natural language processing. In recent works, pre-trained language models are often used to achieve state-of-the-art results, especially when training data is scarce. It is common to fine-tune on…

Computation and Language · Computer Science 2022-04-13 Ehsan Hosseini-Asl , Wenhao Liu , Caiming Xiong

In machine learning applications, gradual data ingress is common, especially in audio processing where incremental learning is vital for real-time analytics. Few-shot class-incremental learning addresses challenges arising from limited…

Sound · Computer Science 2024-08-08 Riyansha Singh , Parinita Nema , Vinod K Kurmi