English
Related papers

Related papers: Generating customized prompts for Zero-Shot Rare E…

200 papers

The remarkable success of pretrained language models has motivated the study of what kinds of knowledge these models learn during pretraining. Reformulating tasks as fill-in-the-blanks problems (e.g., cloze tests) is a natural approach for…

Computation and Language · Computer Science 2020-11-10 Taylor Shin , Yasaman Razeghi , Robert L. Logan , Eric Wallace , Sameer Singh

Augmenting large language models (LLMs) with user-specific knowledge is crucial for real-world applications, such as personal AI assistants. However, LLMs inherently lack mechanisms for prompt-driven knowledge capture. This paper…

Computation and Language · Computer Science 2024-02-02 Tolga Çöplü , Arto Bendiken , Andrii Skomorokhov , Eduard Bateiko , Stephen Cobb , Joshua J. Bouw

Recent Vision-Language Models (VLMs) enable zero-shot classification by aligning images and text in a shared space, a promising approach for data-scarce conditions. However, the influence of prompt design on recognizing visually similar…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 MingZe Tang , Jubal Chandy Jacob

Few-shot learning has been successfully applied to medical image classification as only very few medical examples are available for training. Due to the challenging problem of limited number of annotated medical images, image…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Zhenwei Wang , Qiule Sun , Bingbing Zhang , Pengfei Wang , Jianxin Zhang , Qiang Zhang

Rare diseases, including Inborn Errors of Metabolism (IEM), pose significant diagnostic challenges. Case reports serve as key but computationally underutilized resources to inform diagnosis. Clinical dense information extraction refers to…

Computation and Language · Computer Science 2025-05-26 Xiao Yu Cindy Zhang , Carlos R. Ferreira , Francis Rossignol , Raymond T. Ng , Wyeth Wasserman , Jian Zhu

Recently, prompt-based learning has gained popularity across many natural language processing (NLP) tasks by reformulating them into a cloze-style format to better align pre-trained language models (PLMs) with downstream tasks. However,…

Computation and Language · Computer Science 2023-08-15 Wenjie Zhang , Xiaoning Song , Zhenhua Feng , Tianyang Xu , Xiaojun Wu

Prompting language models (LMs) with training examples and task descriptions has been seen as critical to recent successes in few-shot learning. In this work, we show that finetuning LMs in the few-shot setting can considerably reduce the…

Computation and Language · Computer Science 2021-07-02 Robert L. Logan , Ivana Balažević , Eric Wallace , Fabio Petroni , Sameer Singh , Sebastian Riedel

This study harnesses state-of-the-art AI technology for detecting mental disorders through user-generated textual content. Existing studies typically rely on fully supervised machine learning, which presents challenges such as the…

Computation and Language · Computer Science 2025-03-17 Haoxin Liu , Wenli Zhang , Jiaheng Xie , Buomsoo Kim , Zhu Zhang , Yidong Chai , Sudha Ram

Open-Domain Question Answering (ODQA) aims to answer questions without explicitly providing specific background documents. This task becomes notably challenging in a zero-shot setting where no data is available to train tailored…

Computation and Language · Computer Science 2024-03-29 Junlong Li , Jinyuan Wang , Zhuosheng Zhang , Hai Zhao

Recent research in zero-shot Relation Extraction (RE) has focused on using Large Language Models (LLMs) due to their impressive zero-shot capabilities. However, current methods often perform suboptimally, mainly due to a lack of detailed,…

Information Retrieval · Computer Science 2024-12-24 Siyi Liu , Yang Li , Jiang Li , Shan Yang , Yunshi Lan

The large-scale pre-trained vision language models (VLM) have shown remarkable domain transfer capability on natural images. However, it remains unknown whether this capability can also apply to the medical image domain. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Ziyuan Qin , Huahui Yi , Qicheng Lao , Kang Li

Exploring open-vocabulary video action recognition is a promising venture, which aims to recognize previously unseen actions within any arbitrary set of categories. Existing methods typically adapt pretrained image-text models to the video…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Chengyou Jia , Minnan Luo , Xiaojun Chang , Zhuohang Dang , Mingfei Han , Mengmeng Wang , Guang Dai , Sizhe Dang , Jingdong Wang

Requirements classification assigns natural language requirements to predefined classes, such as functional and non functional. Accurate classification reduces risk and improves software quality. Most existing models rely on supervised…

Software Engineering · Computer Science 2025-09-18 Manal Binkhonain , Reem Alfayaz

In high-stakes domains such as healthcare, the reliability of Large Language Models (LLMs) is critical, particularly when generating clinical insights from incident reports. This study proposes a tag-based few-shot example selection method…

Computation and Language · Computer Science 2026-05-12 Yuna Haseyama , Tomoki Ito , Hiroki Sakaji , Itsuki Noda

In this paper, we describe our participation in the subtask 1 of CASE-2022, Event Causality Identification with Casual News Corpus. We address the Causal Relation Identification (CRI) task by exploiting a set of simple yet complementary…

Computation and Language · Computer Science 2024-04-18 Sergio Burdisso , Juan Zuluaga-Gomez , Esau Villatoro-Tello , Martin Fajcik , Muskaan Singh , Pavel Smrz , Petr Motlicek

Text-to-image models are powerful for producing high-quality images based on given text prompts, but crafting these prompts often requires specialized vocabulary. To address this, existing methods train rewriting models with supervision…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Hongji Yang , Yucheng Zhou , Wencheng Han , Jianbing Shen

Consistently scaling pre-trained language models (PLMs) imposes substantial burdens on model adaptation, necessitating more efficient alternatives to conventional fine-tuning. Given the advantage of prompting in the zero-shot setting and…

Computation and Language · Computer Science 2023-06-01 Yulin Chen , Ning Ding , Xiaobin Wang , Shengding Hu , Hai-Tao Zheng , Zhiyuan Liu , Pengjun Xie

Being probabilistic models, during inference large language models (LLMs) display rare events: behaviour that is far from typical but highly significant. By definition all rare events are hard to see, but the enormous scale of LLM usage…

Machine Learning · Computer Science 2026-05-29 Jake McAllister Dorman , Edward Gillman , Dominic C. Rose , Jamie F. Mair , Juan P. Garrahan

The vision-language model has brought great improvement to few-shot industrial anomaly detection, which usually needs to design of hundreds of prompts through prompt engineering. For automated scenarios, we first use conventional prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Xiaofan Li , Zhizhong Zhang , Xin Tan , Chengwei Chen , Yanyun Qu , Yuan Xie , Lizhuang Ma

Vision-language foundation models (VLMs) have shown great potential in feature transfer and generalization across a wide spectrum of medical-related downstream tasks. However, fine-tuning these models is resource-intensive due to their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ye Du , Nanxi Yu , Shujun Wang