English
Related papers

Related papers: Can Generalist Foundation Models Outcompete Specia…

200 papers

Promptable foundation models, particularly Segment Anything Model (SAM), have emerged as a promising alternative to the traditional task-specific supervised learning for image segmentation. However, many evaluation studies have found that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Rachana Sathish , Rahul Venkataramani , K S Shriram , Prasad Sudhakar

Prompt engineering is crucial for harnessing the potential of large language models (LLMs), especially in the medical domain where specialized terminology and phrasing is used. However, the efficacy of prompt engineering in the medical…

Computation and Language · Computer Science 2025-07-22 Jamil Zaghir , Marco Naguib , Mina Bjelogrlic , Aurélie Névéol , Xavier Tannier , Christian Lovis

Distribution shift is a common challenge in medical images obtained from different clinical centers, significantly hindering the deployment of pre-trained semantic segmentation models in real-world applications across multiple domains.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Lingrui Li , Yanfeng Zhou , Nan Pu , Xin Chen , Zhun Zhong

Pre-trained large language models can efficiently interpolate human-written prompts in a natural way. Multitask prompted learning can help generalization through a diverse set of tasks at once, thus enhancing the potential for more…

Computation and Language · Computer Science 2022-12-22 M Saiful Bari , Aston Zhang , Shuai Zheng , Xingjian Shi , Yi Zhu , Shafiq Joty , Mu Li

Generalized Entity Matching (GEM), which aims at judging whether two records represented in different formats refer to the same real-world entity, is an essential task in data management. The prompt tuning paradigm for pre-trained language…

Computation and Language · Computer Science 2024-05-09 Yikuan Xia , Jiazun Chen , Xinchi Li , Jun Gao

The accelerated evolution of large language models has raised questions about their comparative performance across domains of practical importance. GPT-4 by OpenAI introduced advances in reasoning, multimodality, and task generalization,…

Human-Computer Interaction · Computer Science 2025-08-28 Georgios P. Georgiou

Prompt engineering is a challenging yet crucial task for optimizing the performance of large language models on customized tasks. It requires complex reasoning to examine the model's errors, hypothesize what is missing or misleading in the…

Computation and Language · Computer Science 2024-07-04 Qinyuan Ye , Maxamed Axmed , Reid Pryzant , Fereshte Khani

Large language models (LLMs) have demonstrated impressive performance on many tasks. However, to achieve optimal performance, specially designed prompting methods are still needed. These methods either rely on task-specific few-shot…

Computation and Language · Computer Science 2024-02-29 Haoxiang Guan , Jiyan He , Shuxin Zheng , En-Hong Chen , Weiming Zhang , Nenghai Yu

Prompt learning is one of the most effective paradigms for adapting pre-trained vision-language models (VLMs) to the biomedical image classification tasks in few shot scenarios. However, most of the current prompt learning methods only used…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Wei Peng , Kang Liu , Jianchen Hu , Meng Zhang

Prompt engineering is a technique that involves augmenting a large pre-trained model with task-specific hints, known as prompts, to adapt the model to new tasks. Prompts can be created manually as natural language instructions or generated…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jindong Gu , Zhen Han , Shuo Chen , Ahmad Beirami , Bailan He , Gengyuan Zhang , Ruotong Liao , Yao Qin , Volker Tresp , Philip Torr

Prompt tuning, a recently emerging paradigm, enables the powerful vision-language pre-training models to adapt to downstream tasks in a parameter -- and data -- efficient way, by learning the ``soft prompts'' to condition frozen…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Juncheng Li , Minghe Gao , Longhui Wei , Siliang Tang , Wenqiao Zhang , Mengze Li , Wei Ji , Qi Tian , Tat-Seng Chua , Yueting Zhuang

In the evolving landscape of machine learning, the adaptation of pre-trained models through prompt tuning has become increasingly prominent. This trend is particularly observable in the graph domain, where diverse pre-training strategies…

Machine Learning · Computer Science 2026-05-18 Junhyun Lee , Wooseong Yang , Jaewoo Kang

Foundation models (FMs) have exhibited remarkable performance across a wide range of downstream tasks in many domains. Nevertheless, general-purpose FMs often face challenges when confronted with domain-specific problems, due to their…

Computational Engineering, Finance, and Science · Computer Science 2023-08-22 Yizhen Luo , Jiahuan Zhang , Siqi Fan , Kai Yang , Yushuai Wu , Mu Qiao , Zaiqing Nie

Prompt learning is one of the most effective and trending ways to adapt powerful vision-language foundation models like CLIP to downstream datasets by tuning learnable prompt vectors with very few samples. However, although prompt learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Cairong Zhao , Yubin Wang , Xinyang Jiang , Yifei Shen , Kaitao Song , Dongsheng Li , Duoqian Miao

Learning to use feature-rich software is a persistent challenge, but generative AI tools promise to lower this barrier by replacing complex navigation with natural language prompts. We investigated how people approach prompt-based tools for…

Human-Computer Interaction · Computer Science 2026-04-01 Kanak Gautam , Poorvi Bhatia , Parmit K. Chilana

Prompt engineering is a critical technique in the field of natural language processing that involves designing and optimizing the prompts used to input information into models, aiming to enhance their performance on specific tasks. With the…

Large language model performance can be improved in a large number of ways. Many such techniques, like fine-tuning or advanced tool usage, are time-intensive and expensive. Although prompt engineering is significantly cheaper and often…

Computation and Language · Computer Science 2025-06-03 Philipp Schoenegger , Cameron R. Jones , Philip E. Tetlock , Barbara Mellers

Prompt learning has demonstrated impressive efficacy in the fine-tuning of multimodal large models to a wide range of downstream tasks. Nonetheless, applying existing prompt learning methods for the diagnosis of neurological disorder still…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Liang Peng , Songyue Cai , Zongqian Wu , Huifang Shang , Xiaofeng Zhu , Xiaoxiao Li

This paper reports on the use of prompt engineering and GPT-3.5 for biomedical query-focused multi-document summarisation. Using GPT-3.5 and appropriate prompts, our system achieves top ROUGE-F1 results in the task of obtaining…

Computation and Language · Computer Science 2023-11-10 Diego Mollá

The pre-trained foundation models (PFMs) have become essential for facilitating large-scale multimodal learning. Researchers have effectively employed the ``pre-train, prompt, and predict'' paradigm through prompt learning to induce…

Computation and Language · Computer Science 2025-12-24 Xiang Chen , Yixin Ou , Quan Feng , Lei Li , Piji Li , Haibo Ye , Sheng-Jun Huang , Shuofei Qiao , Shumin Deng , Huajun Chen , Ningyu Zhang