English
Related papers

Related papers: Ontology-enhanced Prompt-tuning for Few-shot Learn…

200 papers

Ontology (and more generally: Knowledge Graph) Matching is a challenging task where information in natural language is one of the most important signals to process. With the rise of Large Language Models, it is possible to incorporate this…

Information Retrieval · Computer Science 2023-11-08 Sven Hertling , Heiko Paulheim

Zero-shot learning (ZSL) endeavors to transfer knowledge from seen categories to recognize unseen categories, which mostly relies on the semantic-visual interactions between image and attribute tokens. Recently, prompt learning has emerged…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Man Liu , Huihui Bai , Feng Li , Chunjie Zhang , Yunchao Wei , Tat-Seng Chua , Yao Zhao

Efficiently adapting large Vision-Language Models (VLMs) like CLIP for few-shot learning poses challenges in balancing pre-trained knowledge retention and task-specific adaptation. Existing methods often overlook valuable structural…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Dazhi Huang

Few-shot learning refers to understanding new concepts from only a few examples. We propose an information retrieval-inspired approach for this problem that is motivated by the increased importance of maximally leveraging all the available…

Machine Learning · Computer Science 2017-11-15 Eleni Triantafillou , Richard Zemel , Raquel Urtasun

Few-shot classification is a challenging task which aims to formulate the ability of humans to learn concepts from limited prior data and has drawn considerable attention in machine learning. Recent progress in few-shot classification has…

Machine Learning · Computer Science 2020-04-14 Meiyu Huang , Xueshuang Xiang , Yao Xu

Remote sensing applications increasingly rely on deep learning for scene classification. However, their performance is often constrained by the scarcity of labeled data and the high cost of annotation across diverse geographic and sensor…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Ivica Dimitrovski , Vlatko Spasev , Ivan Kitanovski

When adapting large language models (LLMs) to a specific downstream task, two primary approaches are commonly employed: (1) prompt engineering, often with in-context few-shot learning, leveraging the model's inherent generalization…

Machine Learning · Computer Science 2025-12-24 Jorg Bornschein , Clare Lyle , Yazhe Li , Amal Rannen-Triki , Xu Owen He , Razvan Pascanu

Few-shot learning (FSL) aims to develop a learning model with the ability to generalize to new classes using a few support samples. For transductive FSL tasks, prototype learning and label propagation methods are commonly employed.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Jiahui Wang , Qin Xu , Bo Jiang , Bin Luo

Vision-Language Models (VLMs) demonstrate remarkable zero-shot generalization to unseen tasks, but fall short of the performance of supervised methods in generalizing to downstream tasks with limited data. Prompt learning is emerging as a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Marco Mistretta , Alberto Baldrati , Marco Bertini , Andrew D. Bagdanov

Large language models (LLMs) have achieved remarkable performance in generating human-like text and solving reasoning tasks of moderate complexity, such as question-answering and mathematical problem-solving. However, their capabilities in…

Computation and Language · Computer Science 2025-02-21 Cole Gawin , Yidan Sun , Mayank Kejriwal

A particularly successful class of approaches for few-shot learning combines language models with prompts -- hand-crafted task descriptions that complement data samples. However, designing prompts by hand for each task commonly requires…

Computation and Language · Computer Science 2023-10-24 Rami Aly , Xingjian Shi , Kaixiang Lin , Aston Zhang , Andrew Gordon Wilson

Using prompts to utilize language models to perform various downstream tasks, also known as prompt-based learning or prompt-learning, has lately gained significant success in comparison to the pre-train and fine-tune paradigm. Nonetheless,…

Computation and Language · Computer Science 2022-10-19 Yi Sun , Yu Zheng , Chao Hao , Hangping Qiu

This study harnesses state-of-the-art AI technology for detecting mental disorders through user-generated textual content. Existing studies typically rely on fully supervised machine learning, which presents challenges such as the…

Computation and Language · Computer Science 2025-03-17 Haoxin Liu , Wenli Zhang , Jiaheng Xie , Buomsoo Kim , Zhu Zhang , Yidong Chai , Sudha Ram

Transformer-based pre-trained models have emerged as the predominant solution for natural language processing (NLP). Fine-tuning such pre-trained models for downstream tasks often requires a considerable amount of labeled private data. In…

Computation and Language · Computer Science 2023-08-22 Dongqi Cai , Yaozong Wu , Haitao Yuan , Shangguang Wang , Felix Xiaozhu Lin , Mengwei Xu

Large pre-trained vision-language (VL) models can learn a new task with a handful of examples and generalize to a new task without fine-tuning. However, these VL models are hard to deploy for real-world applications due to their…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Woojeong Jin , Yu Cheng , Yelong Shen , Weizhu Chen , Xiang Ren

Neural-based end-to-end approaches to natural language generation (NLG) from structured data or knowledge are data-hungry, making their adoption for real-world applications difficult with limited data. In this work, we propose the new task…

Computation and Language · Computer Science 2020-04-21 Zhiyu Chen , Harini Eavani , Wenhu Chen , Yinyin Liu , William Yang Wang

Despite the large number of patients in Electronic Health Records (EHRs), the subset of usable data for modeling outcomes of specific phenotypes are often imbalanced and of modest size. This can be attributed to the uneven coverage of…

Machine Learning · Computer Science 2021-03-25 Mohamed Ghalwash , Zijun Yao , Prithwish Chakraborty , James Codella , Daby Sow

By describing the features and abstractions of our world, language is a crucial tool for human learning and a promising source of supervision for machine learning models. We use language to improve few-shot visual classification in the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Jesse Mu , Percy Liang , Noah Goodman

Most computer aided pathology detection systems rely on large volumes of quality annotated data to aid diagnostics and follow up procedures. However, quality assuring large volumes of annotated medical image data can be subjective and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Sohini Roychowdhury

Few-shot learning is a promising way for reducing the label cost in new categories adaptation with the guidance of a small, well labeled support set. But for few-shot semantic segmentation, the pixel-level annotations of support images are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Jing Wang , Yuang Liu , Qiang Zhou , Fan Wang