English
Related papers

Related papers: Ontology-enhanced Prompt-tuning for Few-shot Learn…

200 papers

Prior work on language models (LMs) shows that training on a large number of diverse tasks improves few-shot learning (FSL) performance on new tasks. We take this to the extreme, automatically extracting 413,299 tasks from internet tables -…

Computation and Language · Computer Science 2022-08-09 Jun Shern Chan , Michael Pieler , Jonathan Jao , Jérémy Scheurer , Ethan Perez

Recent advances in large pre-trained language models (PLMs) lead to impressive gains in natural language understanding (NLU) tasks with task-specific fine-tuning. However, directly fine-tuning PLMs heavily relies on sufficient labeled…

Computation and Language · Computer Science 2023-03-24 Canyu Chen , Kai Shu

Depicting novel classes with language descriptions by observing few-shot samples is inherent in human-learning systems. This lifelong learning capability helps to distinguish new knowledge from old ones through the increase of open-world…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Yifan Zhao , Jia Li , Zeyin Song , Yonghong Tian

Prompt-based knowledge probing for 1-hop relations has been used to measure how much world knowledge is stored in pretrained language models. Existing work uses considerable amounts of data to tune the prompts for better performance. In…

Artificial Intelligence · Computer Science 2021-09-14 Tianxing He , Kyunghyun Cho , James Glass

Few-shot segmentation is a task to segment objects or regions of novel classes within an image given only a few annotated examples. In the generalized setting, the task extends to segment both the base and the novel classes. The main…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Steve Andreas Immanuel , Hagai Raja Sinulingga

Recently, Large language models (LLMs) with in-context learning have demonstrated remarkable potential in handling neural machine translation. However, existing evidence shows that LLMs are prompt-sensitive and it is sub-optimal to apply…

Computation and Language · Computer Science 2025-01-06 Lei Tang , Jinghui Qin , Wenxuan Ye , Hao Tan , Zhijing Yang

In Few-Shot Learning (FSL), models are trained to recognise unseen objects from a query set, given a few labelled examples from a support set. In standard FSL, models are evaluated on query instances sampled from the same class distribution…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Mateusz Ochal , Massimiliano Patacchiola , Malik Boudiaf , Sen Wang

The task of Few-shot learning (FSL) aims to transfer the knowledge learned from base categories with sufficient labelled data to novel categories with scarce known information. It is currently an important research question and has great…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Chengming Xu , Chen Liu , Xinwei Sun , Siqian Yang , Yabiao Wang , Chengjie Wang , Yanwei Fu

LLMs are typically trained in high-resource languages, and tasks in lower-resourced languages tend to underperform the higher-resource language counterparts for in-context learning. Despite the large body of work on prompting settings, it…

Computation and Language · Computer Science 2025-06-25 Christopher Toukmaji , Jeffrey Flanigan

Knowledge tracing (KT), aiming to mine students' mastery of knowledge by their exercise records and predict their performance on future test questions, is a critical task in educational assessment. While researchers achieved tremendous…

Artificial Intelligence · Computer Science 2024-05-28 Haoxuan Li , Jifan Yu , Yuanxin Ouyang , Zhuang Liu , Wenge Rong , Juanzi Li , Zhang Xiong

This study addresses the issues of semantic entanglement, unclear label structure, and insufficient feature representation in few-shot text classification, and proposes an optimization framework based on structured prompts to enhance…

Computation and Language · Computer Science 2026-03-02 Jiasen Zheng , Zijun Zhou , Huajun Zhang , Junjiang Lin , Jingyun Jia , Qi Wang

Few-shot learning (FSL) aims to recognize new concepts using a limited number of visual samples. Existing approaches attempt to incorporate semantic information into the limited visual data for category understanding. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Mushui Liu , Fangtai Wu , Bozheng Li , Ziqian Lu , Yunlong Yu , Xi Li

Few-shot learning (FSL) aims to learn models that generalize to novel classes with limited training samples. Recent works advance FSL towards a scenario where unlabeled examples are also available and propose semi-supervised FSL methods.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Linglan Zhao , Dashan Guo , Yunlu Xu , Liang Qiao , Zhanzhan Cheng , Shiliang Pu , Yi Niu , Xiangzhong Fang

Text classification tends to be difficult when data are deficient or when it is required to adapt to unseen classes. In such challenging scenarios, recent studies have often used meta-learning to simulate the few-shot task, thus negating…

Information Retrieval · Computer Science 2019-11-22 Shumin Deng , Ningyu Zhang , Zhanlin Sun , Jiaoyan Chen , Huajun Chen

Few-shot learning (FSL) enables machine learning models to generalize effectively with minimal labeled data, making it crucial for data-scarce domains such as healthcare, robotics, and natural language processing. Despite its potential, FSL…

Machine Learning · Computer Science 2025-01-24 Rishabh Agrawal

Few-shot learning (FSL) aims to enable models to recognize novel objects or classes with limited labelled data. Feature generators, which synthesize new data points to augment limited datasets, have emerged as a promising solution to this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Heethanjan Kanagalingam , Thenukan Pathmanathan , Navaneethan Ketheeswaran , Mokeeshan Vathanakumar , Mohamed Afham , Ranga Rodrigo

Recent prompt-based approaches allow pretrained language models to achieve strong performances on few-shot finetuning by reformulating downstream tasks as a language modeling problem. In this work, we demonstrate that, despite its…

Computation and Language · Computer Science 2021-09-10 Prasetya Ajie Utama , Nafise Sadat Moosavi , Victor Sanh , Iryna Gurevych

Current multi-instance learning algorithms for pathology image analysis often require a substantial number of Whole Slide Images for effective training but exhibit suboptimal performance in scenarios with limited learning data. In clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Linhao Qu , Dingkang Yang , Dan Huang , Qinhao Guo , Rongkui Luo , Shaoting Zhang , Xiaosong Wang

As an effective approach to tune pre-trained language models (PLMs) for specific tasks, prompt-learning has recently attracted much attention from researchers. By using \textit{cloze}-style language prompts to stimulate the versatile…

Computation and Language · Computer Science 2021-08-25 Ning Ding , Yulin Chen , Xu Han , Guangwei Xu , Pengjun Xie , Hai-Tao Zheng , Zhiyuan Liu , Juanzi Li , Hong-Gee Kim

We consider the task of few-shot intent detection, which involves training a deep learning model to classify utterances based on their underlying intents using only a small amount of labeled data. The current approach to address this…

Computation and Language · Computer Science 2024-09-17 Haode Zhang , Haowen Liang , Liming Zhan , Albert Y. S. Lam , Xiao-Ming Wu