English
Related papers

Related papers: Multitask Prompted Training Enables Zero-Shot Task…

200 papers

Large language models (LLMs) are trained and tested extensively on symbolic representations such as code and graphs, yet real-world user tasks are often specified in natural language. To what extent can LLMs generalize across these…

Computation and Language · Computer Science 2026-02-04 Fangru Lin , Valentin Hofmann , Xingchen Wan , Weixing Wang , Zifeng Ding , Anthony G. Cohn , Janet B. Pierrehumbert

Instruction tuning is an emergent paradigm in NLP wherein natural language instructions are leveraged with language models to induce zero-shot performance on unseen tasks. Instructions have been shown to enable good performance on unseen…

Computation and Language · Computer Science 2022-10-27 Prakhar Gupta , Cathy Jiao , Yi-Ting Yeh , Shikib Mehri , Maxine Eskenazi , Jeffrey P. Bigham

While Large Language Models (LLMs) exhibit remarkable capabilities in zero-shot and few-shot scenarios, they often require computationally prohibitive sizes. Conversely, smaller Masked Language Models (MLMs) like BERT and RoBERTa achieve…

Computation and Language · Computer Science 2024-10-18 Ahmed Elshabrawy , Yongxin Huang , Iryna Gurevych , Alham Fikri Aji

As a step towards developing zero-shot task generalization capabilities in reinforcement learning (RL), we introduce a new RL problem where the agent should learn to execute sequences of instructions after learning useful skills that solve…

Artificial Intelligence · Computer Science 2017-11-08 Junhyuk Oh , Satinder Singh , Honglak Lee , Pushmeet Kohli

We introduce a method to improve the zero-shot reasoning abilities of large language models on general language understanding tasks. Specifically, we build an autonomous agent to instruct the reasoning process of large language models. We…

Computation and Language · Computer Science 2024-08-15 Nicholas Crispino , Kyle Montgomery , Fankun Zeng , Dawn Song , Chenguang Wang

Instruction tuning (IT) is widely used to teach pretrained large language models (LLMs) to follow arbitrary instructions, but is under-studied in multilingual settings. In this work, we conduct a systematic study of zero-shot cross-lingual…

Computation and Language · Computer Science 2024-04-23 Nadezhda Chirkova , Vassilina Nikoulina

Pre-trained vision-language models have shown impressive success on various computer vision tasks with their zero-shot generalizability. Recently, prompt learning approaches have been explored to efficiently and effectively adapt the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jinyoung Park , Juyeon Ko , Hyunwoo J. Kim

The recent development of fact verification systems with natural logic has enhanced their explainability by aligning claims with evidence through set-theoretic operators, providing faithful justifications. Despite these advancements, such…

Computation and Language · Computer Science 2024-10-07 Marek Strong , Rami Aly , Andreas Vlachos

The development of large-scale Chinese language models is flourishing, yet there is a lack of corresponding capability assessments. Therefore, we propose a test to measure the multitask accuracy of large Chinese language models. This test…

Computation and Language · Computer Science 2026-05-28 Hui Zeng

Recent foundational language models have shown state-of-the-art performance in many NLP tasks in zero- and few-shot settings. An advantage of these models over more standard approaches based on fine-tuning is the ability to understand…

Computation and Language · Computer Science 2024-04-16 Aleksandra Edwards , Jose Camacho-Collados

Large Language Models (LLMs) have transformed NLP with their remarkable In-context Learning (ICL) capabilities. Automated assistants based on LLMs are gaining popularity; however, adapting them to novel tasks is still challenging. While…

Computation and Language · Computer Science 2024-06-13 Anwoy Chatterjee , Eshaan Tanwar , Subhabrata Dutta , Tanmoy Chakraborty

Pretrained language models have shown success in various areas of natural language processing, including reading comprehension tasks. However, when applying machine learning methods to new domains, labeled data may not always be available.…

Computation and Language · Computer Science 2022-06-15 Xiang Pan , Alex Sheng , David Shimshoni , Aditya Singhal , Sara Rosenthal , Avirup Sil

Zero-shot learning has received increasing interest as a means to alleviate the often prohibitive expense of annotating training data for large scale recognition problems. These methods have achieved great success via learning intermediate…

Machine Learning · Computer Science 2015-03-27 Yanwei Fu , Yongxin Yang , Tim Hospedales , Tao Xiang , Shaogang Gong

As an effective approach to tune pre-trained language models (PLMs) for specific tasks, prompt-learning has recently attracted much attention from researchers. By using \textit{cloze}-style language prompts to stimulate the versatile…

Computation and Language · Computer Science 2021-08-25 Ning Ding , Yulin Chen , Xu Han , Guangwei Xu , Pengjun Xie , Hai-Tao Zheng , Zhiyuan Liu , Juanzi Li , Hong-Gee Kim

Prompt tuning, in which a base pretrained model is adapted to each task via conditioning on learned prompt vectors, has emerged as a promising approach for efficiently adapting large language models to multiple downstream tasks. However,…

Computation and Language · Computer Science 2023-03-07 Zhen Wang , Rameswar Panda , Leonid Karlinsky , Rogerio Feris , Huan Sun , Yoon Kim

This report presents a solution for the zero-shot referring expression comprehension task. Visual-language multimodal base models (such as CLIP, SAM) have gained significant attention in recent years as a cornerstone of mainstream research.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Longfei Huang , Feng Yu , Zhihao Guan , Zhonghua Wan , Yang Yang

Large language models (LLMs) offer impressive performance in various zero-shot and few-shot tasks. However, their success in zero-shot and few-shot settings may be affected by task contamination, a potential limitation that has not been…

Computation and Language · Computer Science 2024-01-02 Changmao Li , Jeffrey Flanigan

Zero-shot cross-lingual transfer is when a multilingual model is trained to perform a task in one language and then is applied to another language. Although the zero-shot cross-lingual transfer approach has achieved success in various…

Computation and Language · Computer Science 2023-05-30 Tianjian Li , Kenton Murray

We propose a new strategy for applying large pre-trained language models to novel tasks when labeled training data is limited. Rather than apply the model in a typical zero-shot or few-shot fashion, we treat the model as the basis for…

Machine Learning · Computer Science 2022-05-06 Ryan Smith , Jason A. Fries , Braden Hancock , Stephen H. Bach

Prompt engineering has emerged as an indispensable technique for extending the capabilities of large language models (LLMs) and vision-language models (VLMs). This approach leverages task-specific instructions, known as prompts, to enhance…

Artificial Intelligence · Computer Science 2025-03-18 Pranab Sahoo , Ayush Kumar Singh , Sriparna Saha , Vinija Jain , Samrat Mondal , Aman Chadha