English
Related papers

Related papers: Exploring Prompt-based Few-shot Learning for Groun…

200 papers

Natural Language Inference Generation task is to generate a text hypothesis given a text premise and a logical relation between the two. This task can be used in data augmentation and controllable text generation in practice. In this paper,…

Computation and Language · Computer Science 2022-05-24 Kaijian Li , Shansan Gong , Kenny Q. Zhu

As a crucial component in task-oriented dialog systems, the Natural Language Generation (NLG) module converts a dialog act represented in a semantic form into a response in natural language. The success of traditional template-based or…

Computation and Language · Computer Science 2020-02-28 Baolin Peng , Chenguang Zhu , Chunyuan Li , Xiujun Li , Jinchao Li , Michael Zeng , Jianfeng Gao

A key component of modern conversational systems is the Dialogue State Tracker (or DST), which models a user's goals and needs. Toward building more robust and reliable DSTs, we introduce a prompt-based learning approach to automatically…

Computation and Language · Computer Science 2023-06-08 Xiangjue Dong , Yun He , Ziwei Zhu , James Caverlee

Few-shot relational learning on knowledge graph (KGs) aims to perform reasoning over relations with only a few training examples. While current methods have focused primarily on leveraging specific relational information, rich semantics…

Artificial Intelligence · Computer Science 2025-11-06 Han Wu , Jie Yin

This paper introduces zero-shot dialog generation (ZSDG), as a step towards neural dialog systems that can instantly generalize to new situations with minimal data. ZSDG enables an end-to-end generative dialog system to generalize to a new…

Computation and Language · Computer Science 2018-05-15 Tiancheng Zhao , Maxine Eskenazi

We propose a simple yet a novel approach to improve completion in domain modeling activities. Our approach exploits the power of large language models by using few-shot prompt learning without the need to train or fine-tune those models…

Software Engineering · Computer Science 2022-12-08 Meriem Ben Chaaben , Lola Burgueño , Houari Sahraoui

Recent advances on prompt-tuning cast few-shot classification tasks as a masked language modeling problem. By wrapping input into a template and using a verbalizer which constructs a mapping between label space and label word space,…

Computation and Language · Computer Science 2022-01-17 Yinyi Wei , Tong Mo , Yongtao Jiang , Weiping Li , Wen Zhao

Although pretrained language models (PLMs) can be prompted to perform a wide range of language tasks, it remains an open question how much this ability comes from generalizable linguistic understanding versus surface-level lexical patterns.…

Computation and Language · Computer Science 2023-05-23 Terra Blevins , Hila Gonen , Luke Zettlemoyer

Pre-trained large language models, such as ChatGPT, archive outstanding performance in various reasoning tasks without supervised training and were found to have outperformed crowdsourcing workers. Nonetheless, ChatGPT's performance in the…

Computation and Language · Computer Science 2024-02-08 Frances Yung , Mansoor Ahmad , Merel Scholman , Vera Demberg

In this work, we aim to capitalize on the unique few-shot capabilities of large-scale language models (LSLMs) to overcome some of their challenges with respect to grounding to factual and up-to-date information. Motivated by semi-parametric…

Computation and Language · Computer Science 2022-05-24 Angeliki Lazaridou , Elena Gribovskaya , Wojciech Stokowiec , Nikolai Grigorev

Large pre-trained vision-language (VL) models can learn a new task with a handful of examples and generalize to a new task without fine-tuning. However, these VL models are hard to deploy for real-world applications due to their…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Woojeong Jin , Yu Cheng , Yelong Shen , Weizhu Chen , Xiang Ren

Existing knowledge-grounded dialogue systems typically use finetuned versions of a pretrained language model (LM) and large-scale knowledge bases. These models typically fail to generalize on topics outside of the knowledge base, and…

Computation and Language · Computer Science 2022-03-17 Zihan Liu , Mostofa Patwary , Ryan Prenger , Shrimai Prabhumoye , Wei Ping , Mohammad Shoeybi , Bryan Catanzaro

Prompt learning has become an efficient paradigm for adapting CLIP to downstream tasks. Compared with traditional fine-tuning, prompt learning optimizes a few parameters yet yields highly competitive results, especially appealing in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Jianhan Wu , Xiaoyang Qu , Zhangcheng Huang , Jianzong Wang

Few-shot question answering (QA) aims at precisely discovering answers to a set of questions from context passages while only a few training samples are available. Although existing studies have made some progress and can usually achieve…

Computation and Language · Computer Science 2023-06-08 Xiusi Chen , Yu Zhang , Jinliang Deng , Jyun-Yu Jiang , Wei Wang

Effective conversation requires common ground: a shared understanding between the participants. Common ground, however, does not emerge spontaneously in conversation. Speakers and listeners work together to both identify and construct a…

Computation and Language · Computer Science 2024-04-04 Omar Shaikh , Kristina Gligorić , Ashna Khetan , Matthias Gerstgrasser , Diyi Yang , Dan Jurafsky

Batch prompting is a common technique in large language models (LLMs) used to process multiple inputs simultaneously, aiming to improve computational efficiency. However, as batch sizes increase, performance degradation often occurs due to…

Computation and Language · Computer Science 2024-10-03 Longyu Feng , Mengze Hong , Chen Jason Zhang

Question-answering (QA) tasks often investigate specific question types, knowledge domains, or reasoning skills, leading to specialized models catering to specific categories of QA tasks. While recent research has explored the idea of…

Computation and Language · Computer Science 2023-05-25 Srijan Bansal , Semih Yavuz , Bo Pang , Meghana Bhat , Yingbo Zhou

This paper discusses our approaches for task-oriented conversational modelling using subjective knowledge, with a particular emphasis on response generation. Our methodology was shaped by an extensive data analysis that evaluated key…

Computation and Language · Computer Science 2023-08-03 Lea Krause , Selene Báez Santamaría , Michiel van der Meer , Urja Khurana

The use of large language model (LLM)-powered chatbots, such as ChatGPT, has become popular across various domains, supporting a range of tasks and processes. However, due to the intrinsic complexity of LLMs, effective prompting is more…

Decision Transformer (DT) has emerged as a promising class of algorithms in offline reinforcement learning (RL) tasks, leveraging pre-collected datasets and Transformer's capability to model long sequences. Recent works have demonstrated…

Machine Learning · Computer Science 2025-12-03 Yu Yang , Pan Xu