English
Related papers

Related papers: Gotta: Generative Few-shot Question Answering by P…

200 papers

Careful prompt design is critical to the use of large language models in zero-shot or few-shot learning. As a consequence, there is a growing interest in automated methods to design optimal prompts. In this work, we propose Test-time Prompt…

Computation and Language · Computer Science 2022-11-23 Tianjun Zhang , Xuezhi Wang , Denny Zhou , Dale Schuurmans , Joseph E. Gonzalez

Knowledge Graph Question Answering (KGQA) is a crucial task in natural language processing that requires reasoning over knowledge graphs (KGs) to answer natural language questions. Recent methods utilizing large language models (LLMs) have…

Computation and Language · Computer Science 2025-06-12 Xiujun Zhou , Pingjian Zhang , Deyou Tang

A particularly successful class of approaches for few-shot learning combines language models with prompts -- hand-crafted task descriptions that complement data samples. However, designing prompts by hand for each task commonly requires…

Computation and Language · Computer Science 2023-10-24 Rami Aly , Xingjian Shi , Kaixiang Lin , Aston Zhang , Andrew Gordon Wilson

Dialog models can be greatly strengthened through grounding on various external information, but grounded dialog corpora are usually not naturally accessible. In this work, we focus on the few-shot learning for grounded dialog generation…

Computation and Language · Computer Science 2022-01-17 Chujie Zheng , Minlie Huang

Recent approaches to multilingual open-domain question answering (MLODQA) have achieved promising results given abundant language-specific training data. However, the considerable annotation cost limits the application of these methods for…

Computation and Language · Computer Science 2025-02-28 Fan Jiang , Tom Drummond , Trevor Cohn

Prompt tuning has been an extremely effective tool to adapt a pre-trained model to downstream tasks. However, standard prompt-based methods mainly consider the case of sufficient data of downstream tasks. It is still unclear whether the…

Computation and Language · Computer Science 2022-07-19 Ping Yu , Wei Wang , Chunyuan Li , Ruiyi Zhang , Zhanpeng Jin , Changyou Chen

This paper presents a simple and cost-effective method for synthesizing data to train question-answering systems. For training, fine-tuning GPT models is a common practice in resource-rich languages like English, however, it becomes…

Computation and Language · Computer Science 2023-10-16 Kosuke Takahashi , Takahiro Omi , Kosuke Arima , Tatsuya Ishigaki

Few-shot action recognition has attracted increasing attention due to the difficulty in acquiring the properly labelled training samples. Current works have shown that preserving spatial information and comparing video descriptors are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Yang Bo , Yangdi Lu , Wenbo He

Dialogue systems need to produce responses that realize multiple types of dialogue acts (DAs) with high semantic fidelity. In the past, natural language generators (NLGs) for dialogue were trained on large parallel corpora that map from a…

Computation and Language · Computer Science 2023-07-28 Angela Ramirez , Karik Agarwal , Juraj Juraska , Utkarsh Garg , Marilyn A. Walker

Conversational Question Answering (CQA) is a challenging task that aims to generate natural answers for conversational flow questions. In this paper, we propose a pluggable approach for extractive methods that introduces a novel…

Computation and Language · Computer Science 2023-08-08 Yong Zhang , Zhitao Li , Jianzong Wang , Yiming Gao , Ning Cheng , Fengying Yu , Jing Xiao

Prompt-based fine-tuning has boosted the performance of Pre-trained Language Models (PLMs) on few-shot text classification by employing task-specific prompts. Yet, PLMs are unfamiliar with prompt-style expressions during pre-training, which…

Computation and Language · Computer Science 2022-05-12 Jianing Wang , Chengyu Wang , Fuli Luo , Chuanqi Tan , Minghui Qiu , Fei Yang , Qiuhui Shi , Songfang Huang , Ming Gao

Question Generation aims to automatically generate questions based on a given input provided as context. A controllable question generation scheme focuses on generating questions with specific attributes, allowing better control. In this…

Computation and Language · Computer Science 2025-06-10 Bernardo Leite , Henrique Lopes Cardoso

Neural approaches have become very popular in Question Answering (QA), however, they require a large amount of annotated data. In this work, we propose a novel approach that combines data augmentation via question-answer generation with…

Computation and Language · Computer Science 2024-09-16 Maximilian Kimmich , Andrea Bartezzaghi , Jasmina Bogojeska , Cristiano Malossi , Ngoc Thang Vu

Recent studies have revealed the intriguing few-shot learning ability of pretrained language models (PLMs): They can quickly adapt to a new task when fine-tuned on a small amount of labeled data formulated as prompts, without requiring…

Computation and Language · Computer Science 2023-05-15 Yu Meng , Martin Michalski , Jiaxin Huang , Yu Zhang , Tarek Abdelzaher , Jiawei Han

In the short text, the extremely short length, feature sparsity, and high ambiguity pose huge challenges to classification tasks. Recently, as an effective method for tuning Pre-trained Language Models for specific downstream tasks,…

Computation and Language · Computer Science 2022-04-01 Yi Zhu , Xinke Zhou , Jipeng Qiang , Yun Li , Yunhao Yuan , Xindong Wu

Large Language Models (LLMs) have been showing promising results for various NLP-tasks without the explicit need to be trained for these tasks by using few-shot or zero-shot prompting techniques. A common NLP-task is question-answering…

Computation and Language · Computer Science 2024-12-18 Kevin Fischer , Darren Fürst , Sebastian Steindl , Jakob Lindner , Ulrich Schäfer

Chain-of-thought (CoT) prompting with large language models has proven effective in numerous natural language processing tasks, but designing prompts that generalize well to diverse problem types can be challenging, especially in the…

Computation and Language · Computer Science 2023-06-12 Zhanming Jie , Wei Lu

Recent prompt-based approaches allow pretrained language models to achieve strong performances on few-shot finetuning by reformulating downstream tasks as a language modeling problem. In this work, we demonstrate that, despite its…

Computation and Language · Computer Science 2021-09-10 Prasetya Ajie Utama , Nafise Sadat Moosavi , Victor Sanh , Iryna Gurevych

Research to improve Automated Short Answer Grading has recently focused on Large Language Models (LLMs) with prompt engineering and no- or few-shot prompting to achieve best results. This is in contrast to the fine-tuning approach, which…

Machine Learning · Computer Science 2025-08-07 Joel Walsh , Siddarth Mamidanna , Benjamin Nye , Mark Core , Daniel Auerbach

Most previous methods for text data augmentation are limited to simple tasks and weak baselines. We explore data augmentation on hard tasks (i.e., few-shot natural language understanding) and strong baselines (i.e., pretrained models with…

Computation and Language · Computer Science 2022-03-16 Jing Zhou , Yanan Zheng , Jie Tang , Jian Li , Zhilin Yang