English
Related papers

Related papers: In-Context Learning for Few-Shot Dialogue State Tr…

200 papers

Large language models (LLMs) excel at few-shot in-context learning (ICL) without requiring parameter updates. However, as ICL demonstrations increase from a few to many, performance tends to plateau and eventually decline. We identify two…

Machine Learning · Computer Science 2025-05-28 Xiaoqing Zhang , Ang Lv , Yuhan Liu , Flood Sung , Wei Liu , Jian Luan , Shuo Shang , Xiuying Chen , Rui Yan

We propose general visual inspection model using Vision-Language Model~(VLM) with few-shot images of non-defective or defective products, along with explanatory texts that serve as inspection criteria. Although existing VLM exhibit high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Shiryu Ueno , Yoshikazu Hayashi , Shunsuke Nakatsuka , Yusei Yamada , Hiroaki Aizawa , Kunihito Kato

Large-scale pre-trained language models (PLMs) are well-known for being capable of solving a task simply by conditioning a few input-label pairs dubbed demonstrations on a prompt without being explicitly tuned for the desired downstream…

Computation and Language · Computer Science 2022-06-17 Hyuhng Joon Kim , Hyunsoo Cho , Junyeob Kim , Taeuk Kim , Kang Min Yoo , Sang-goo Lee

In this paper, we investigate few-shot joint learning for dialogue language understanding. Most existing few-shot models learn a single task each time with only a few examples. However, dialogue language understanding contains two closely…

Computation and Language · Computer Science 2021-06-15 Yutai Hou , Yongkui Lai , Cheng Chen , Wanxiang Che , Ting Liu

In-context learning (ICL) using large language models for tasks with many labels is challenging due to the limited context window, which makes it difficult to fit a sufficient number of examples in the prompt. In this paper, we use a…

Computation and Language · Computer Science 2023-12-07 Aristides Milios , Siva Reddy , Dzmitry Bahdanau

In this work, we approach spoken Dialogue State Tracking (DST) by bridging the representation spaces of speech encoders and LLMs via a small connector module, with a focus on fully open-sourced and open-data components (WavLM-large, OLMo).…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-11 Šimon Sedláček , Bolaji Yusuf , Ján Švec , Pradyoth Hegde , Santosh Kesiraju , Oldřich Plchot , Jan Černocký

This paper gives an overview of the Schema-Guided Dialogue State Tracking task of the 8th Dialogue System Technology Challenge. The goal of this task is to develop dialogue state tracking models suitable for large-scale virtual assistants,…

Computation and Language · Computer Science 2020-02-05 Abhinav Rastogi , Xiaoxue Zang , Srinivas Sunkara , Raghav Gupta , Pranav Khaitan

Generalising dialogue state tracking (DST) to new data is especially challenging due to the strong reliance on abundant and fine-grained supervision during training. Sample sparsity, distributional shift and the occurrence of new concepts…

Computation and Language · Computer Science 2022-08-10 Michael Heck , Nurul Lubis , Carel van Niekerk , Shutong Feng , Christian Geishauser , Hsien-Chin Lin , Milica Gašić

A Dialogue State Tracker (DST) is a key component in a dialogue system aiming at estimating the beliefs of possible user goals at each dialogue turn. Most of the current DST trackers make use of recurrent neural networks and are based on…

Computation and Language · Computer Science 2019-10-23 Vevake Balaraman , Bernardo Magnini

Motivated by the needs of resource constrained dialog policy learning, we introduce dialog policy via differentiable inductive logic (DILOG). We explore the tasks of one-shot learning and zero-shot domain transfer with DILOG on SimDial and…

Computation and Language · Computer Science 2020-11-12 Zhenpeng Zhou , Ahmad Beirami , Paul Crook , Pararth Shah , Rajen Subba , Alborz Geramifard

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

Computation and Language · Computer Science 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan

As multimodal large language models (MLLMs) advance in handling interleaved image-text data, assessing their few-shot learning capabilities remains an open challenge. In this paper, we introduce FewMMBench, a comprehensive benchmark…

Computation and Language · Computer Science 2026-02-26 Mustafa Dogan , Ilker Kesen , Iacer Calixto , Aykut Erdem , Erkut Erdem

As a crucial component in task-oriented dialog systems, the Natural Language Generation (NLG) module converts a dialog act represented in a semantic form into a response in natural language. The success of traditional template-based or…

Computation and Language · Computer Science 2020-02-28 Baolin Peng , Chenguang Zhu , Chunyuan Li , Xiujun Li , Jinchao Li , Michael Zeng , Jianfeng Gao

Dialog state tracking (DST) is a crucial component in a task-oriented dialog system for conversational information access. A common practice in current dialog systems is to define the dialog state by a set of slot-value pairs. Such…

Computation and Language · Computer Science 2018-11-06 Yinpei Dai , Zhijian Ou , Dawei Ren , Pengfei Yu

We present an approach to build Large Language Model (LLM) based slot-filling system to perform Dialogue State Tracking in conversational assistants serving across a wide variety of industry-grade applications. Key requirements of this…

In-context Learning (ICL) is the ability of Large Language Models (LLMs) to perform new tasks when conditioned on prompts comprising a few task examples. However, ICL performance can be critically sensitive to the choice of examples. To…

Computation and Language · Computer Science 2024-02-23 Shivanshu Gupta , Clemens Rosenbaum , Ethan R. Elenberg

We propose a new paradigm for zero-shot learners that is format agnostic, i.e., it is compatible with any format and applicable to a list of language tasks, such as text classification, commonsense reasoning, coreference resolution, and…

Computation and Language · Computer Science 2022-10-19 Ping Yang , Junjie Wang , Ruyi Gan , Xinyu Zhu , Lin Zhang , Ziwei Wu , Xinyu Gao , Jiaxing Zhang , Tetsuya Sakai

Building machine translation (MT) systems for low-resource languages is notably difficult due to the scarcity of high-quality data. Although Large Language Models (LLMs) have improved MT system performance, adapting them to…

Computation and Language · Computer Science 2026-02-05 Luis Frentzen Salim , Esteban Carlin , Alexandre Morinvil , Xi Ai , Lun-Wei Ku

Building dialogue systems requires a large corpus of annotated dialogues. Such datasets are usually created via crowdsourcing, which is expensive and time-consuming. In this paper, we propose \textsc{Dialogic}, a novel dialogue simulation…

Computation and Language · Computer Science 2023-06-07 Zekun Li , Wenhu Chen , Shiyang Li , Hong Wang , Jing Qian , Xifeng Yan

Most recently proposed approaches in dialogue state tracking (DST) leverage the context and the last dialogue states to track current dialogue states, which are often slot-value pairs. Although the context contains the complete dialogue…

Computation and Language · Computer Science 2021-07-13 Jingyao Zhou , Haipang Wu , Zehao Lin , Guodun Li , Yin Zhang