English
Related papers

Related papers: Few-Shot Bot: Prompt-Based Learning for Dialogue S…

200 papers

Few-shot dialogue state tracking (DST) with Large Language Models (LLM) relies on an effective and efficient conversation retriever to find similar in-context examples for prompt learning. Previous works use raw dialogue context as search…

Computation and Language · Computer Science 2024-04-04 Seanie Lee , Jianpeng Cheng , Joris Driesen , Alexandru Coca , Anders Johannsen

Active learning is designed to minimize annotation efforts by prioritizing instances that most enhance learning. However, many active learning strategies struggle with a `cold-start' problem, needing substantial initial data to be…

Computation and Language · Computer Science 2026-01-14 Markus Bayer , Justin Lutz , Christian Reuter

Building models that can be rapidly adapted to novel tasks using only a handful of annotated examples is an open challenge for multimodal machine learning research. We introduce Flamingo, a family of Visual Language Models (VLM) with this…

In this paper, we propose MPC (Modular Prompted Chatbot), a new approach for creating high-quality conversational agents without the need for fine-tuning. Our method utilizes pre-trained large language models (LLMs) as individual modules…

Computation and Language · Computer Science 2023-08-17 Gibbeum Lee , Volker Hartmann , Jongho Park , Dimitris Papailiopoulos , Kangwook Lee

The field of machine learning has recently made significant progress in reducing the requirements for labelled training data when building new models. These `cheaper' learning techniques hold significant potential for the social sciences,…

Computation and Language · Computer Science 2025-07-29 Leonardo Castro-Gonzalez , Yi-Ling Chung , Hannak Rose Kirk , John Francis , Angus R. Williams , Pica Johansson , Jonathan Bright

This study quantifies how prompting strategies interact with large language models (LLMs) to automate the screening stage of systematic literature reviews (SLRs). We evaluate six LLMs (GPT-4o, GPT-4o-mini, DeepSeek-Chat-V3,…

Computation and Language · Computer Science 2025-10-21 Binglan Han , Anuradha Mathrani , Teo Susnjak

Decoder-based large language models (LLMs) have shown high performance on many tasks in natural language processing. This is also true for sentence embedding learning, where a decoder-based model, PromptEOL, has achieved the best…

Computation and Language · Computer Science 2024-08-05 Soma Sato , Hayato Tsukagoshi , Ryohei Sasano , Koichi Takeda

The remarkable advancements in large language models (LLMs) have brought about significant improvements in Natural Language Processing(NLP) tasks. This paper presents a comprehensive review of in-context learning techniques, focusing on…

Computation and Language · Computer Science 2023-09-26 Yinheng Li

The use of large language models (LLMs) in natural language processing (NLP) tasks is rapidly increasing, leading to changes in how researchers approach problems in the field. To fully utilize these models' abilities, a better understanding…

Computation and Language · Computer Science 2023-11-07 Bishal Santra , Sakya Basak , Abhinandan De , Manish Gupta , Pawan Goyal

Pretrained language models (PLMs) have demonstrated remarkable performance in various natural language processing tasks: Unidirectional PLMs (e.g., GPT) are well known for their superior text generation capabilities; bidirectional PLMs…

Computation and Language · Computer Science 2022-10-13 Yu Meng , Jiaxin Huang , Yu Zhang , Jiawei Han

We present an approach to build Large Language Model (LLM) based slot-filling system to perform Dialogue State Tracking in conversational assistants serving across a wide variety of industry-grade applications. Key requirements of this…

Large language models (LLMs) have recently been shown to deliver impressive performance in various NLP tasks. To tackle multi-step reasoning tasks, few-shot chain-of-thought (CoT) prompting includes a few manually crafted step-by-step…

Computation and Language · Computer Science 2023-05-29 Lei Wang , Wanyu Xu , Yihuai Lan , Zhiqiang Hu , Yunshi Lan , Roy Ka-Wei Lee , Ee-Peng Lim

Vision-language models have recently shown great potential on many tasks in computer vision. Meanwhile, prior work demonstrates prompt tuning designed for vision-language models could acquire superior performance on few-shot image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Kun Ding , Ying Wang , Pengzhang Liu , Qiang Yu , Haojian Zhang , Shiming Xiang , Chunhong Pan

Recent advances on prompt-tuning cast few-shot classification tasks as a masked language modeling problem. By wrapping input into a template and using a verbalizer which constructs a mapping between label space and label word space,…

Computation and Language · Computer Science 2022-01-17 Yinyi Wei , Tong Mo , Yongtao Jiang , Weiping Li , Wen Zhao

In this paper, we introduce PanGu-Bot, a Chinese pre-trained open-domain dialogue generation model based on a large pre-trained language model (PLM) PANGU-alpha (Zeng et al.,2021). Different from other pre-trained dialogue models trained…

Computation and Language · Computer Science 2022-07-06 Fei Mi , Yitong Li , Yulong Zeng , Jingyan Zhou , Yasheng Wang , Chuanfei Xu , Lifeng Shang , Xin Jiang , Shiqi Zhao , Qun Liu

Large language models (LLMs) have shown remarkable capabilities in Natural Language Processing (NLP), especially in domains where labeled data is scarce or expensive, such as clinical domain. However, to unlock the clinical knowledge hidden…

Computation and Language · Computer Science 2023-09-18 Sonish Sivarajkumar , Mark Kelley , Alyssa Samolyk-Mazzanti , Shyam Visweswaran , Yanshan Wang

Assessing learners in ill-defined domains, such as scenario-based human tutoring training, is an area of limited research. Equity training requires a nuanced understanding of context, but do contemporary large language models (LLMs) have a…

Human-Computer Interaction · Computer Science 2025-01-14 Sanjit Kakarla , Conrad Borchers , Danielle Thomas , Shambhavi Bhushan , Kenneth R. Koedinger

Dialogue systems, also called chatbots, are now used in a wide range of applications. However, they still have some major weaknesses. One key weakness is that they are typically trained from manually-labeled data and/or written with…

Computation and Language · Computer Science 2021-02-25 Bing Liu , Sahisnu Mazumder

LLMs are typically trained in high-resource languages, and tasks in lower-resourced languages tend to underperform the higher-resource language counterparts for in-context learning. Despite the large body of work on prompting settings, it…

Computation and Language · Computer Science 2025-06-25 Christopher Toukmaji , Jeffrey Flanigan

Text classification is a well-studied and versatile building block for many NLP applications. Yet, existing approaches require either large annotated corpora to train a model with or, when using large language models as a base, require…

Computation and Language · Computer Science 2023-10-11 Arth Bohra , Govert Verkes , Artem Harutyunyan , Pascal Weinberger , Giovanni Campagna