English
Related papers

Related papers: BERT-DST: Scalable End-to-End Dialogue State Track…

200 papers

Emotion dynamics modeling is a significant task in emotion recognition in conversation. It aims to predict conversational emotions when building empathetic dialogue systems. Existing studies mainly develop models based on Recurrent Neural…

Artificial Intelligence · Computer Science 2021-04-22 Haiqin Yang , Jianping Shen

This paper presents an ontology-aware pretrained language model (OPAL) for end-to-end task-oriented dialogue (TOD). Unlike chit-chat dialogue models, task-oriented dialogue models fulfill at least two task-specific modules: dialogue state…

Computation and Language · Computer Science 2022-09-13 Zhi Chen , Yuncong Liu , Lu Chen , Su Zhu , Mengyue Wu , Kai Yu

A challenge in the Dialogue State Tracking (DST) field is adapting models to new domains without using any supervised data, zero-shot domain adaptation. Parameter-Efficient Transfer Learning (PETL) has the potential to address this problem…

Computation and Language · Computer Science 2023-06-09 Taha Aksu , Min-Yen Kan , Nancy F. Chen

Small large language models (sLLMs) offer the advantage of being lightweight and efficient, which makes them suitable for resource-constrained environments. However, sLLMs often struggle to maintain topic consistency in task-oriented…

Computation and Language · Computer Science 2025-05-23 Heejae Suh , Yejin Jeon , Deokhyung Kang , Taehee Park , Yejin Min , Gary Geunbae Lee

While there have been significant advances in de-tecting emotions in text, in the field of utter-ance-level emotion recognition (ULER), there are still many problems to be solved. In this paper, we address some challenges in ULER in dialog…

Computation and Language · Computer Science 2020-02-19 QingBiao Li , ChunHua Wu , KangFeng Zheng , Zhe Wang

Models based on the transformer architecture, such as BERT, have marked a crucial step forward in the field of Natural Language Processing. Importantly, they allow the creation of word embeddings that capture important semantic information…

Computation and Language · Computer Science 2021-01-01 Jacob Turton , David Vinson , Robert Elliott Smith

Goal oriented dialogue systems were originally designed as a natural language interface to a fixed data-set of entities that users might inquire about, further described by domain, slots, and values. As we move towards adaptable dialogue…

Computation and Language · Computer Science 2022-08-23 Renato Vukovic , Michael Heck , Benjamin Matthias Ruppik , Carel van Niekerk , Marcus Zibrowius , Milica Gašić

Large language models (LLMs) achieve impressive performance when a task is fully specified in a single turn, yet the same models lose up to 39% of that performance when the identical task is revealed incrementally across multiple turns, a…

Computation and Language · Computer Science 2026-05-27 Ramakrishna Vamsi Setti , Jagadeesh Rachapudi , Sachin Chaudhary , Praful Hambarde , Amit Shukla

Dialogue management (DM) decides the next action of a dialogue system according to the current dialogue state, and thus plays a central role in task-oriented dialogue systems. Since dialogue management requires to have access to not only…

Computation and Language · Computer Science 2018-05-14 Zheng Zhang , Minlie Huang , Zhongzhou Zhao , Feng Ji , Haiqing Chen , Xiaoyan Zhu

Dialogue state modules are a useful component in a task-oriented dialogue system. Traditional methods find dialogue states by manually labeling training corpora, upon which neural models are trained. However, the labeling process can be…

Computation and Language · Computer Science 2020-08-14 Qingkai Min , Libo Qin , Zhiyang Teng , Xiao Liu , Yue Zhang

Recently, pre-trained contextual models, such as BERT, have shown to perform well in language related tasks. We revisit the design decisions that govern the applicability of these models for the passage re-ranking task in open-domain…

Information Retrieval · Computer Science 2021-08-31 Jurek Leonhardt , Fabian Beringer , Avishek Anand

Detecting the user's intent and finding the corresponding slots among the utterance's words are important tasks in natural language understanding. Their interconnected nature makes their joint modeling a standard part of training such…

Computation and Language · Computer Science 2021-10-06 Momchil Hardalov , Ivan Koychev , Preslav Nakov

We present the Object Language Video Transformer (OLViT) - a novel model for video dialog operating over a multi-modal attention-based dialog state tracker. Existing video dialog models struggle with questions requiring both spatial and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Adnen Abdessaied , Manuel von Hochmeister , Andreas Bulling

Zero-shot dialogue understanding aims to enable dialogue to track the user's needs without any training data, which has gained increasing attention. In this work, we investigate the understanding ability of ChatGPT for zero-shot dialogue…

Computation and Language · Computer Science 2023-04-11 Wenbo Pan , Qiguang Chen , Xiao Xu , Wanxiang Che , Libo Qin

An ideal dialogue system requires continuous skill acquisition and adaptation to new tasks while retaining prior knowledge. Dialogue State Tracking (DST), vital in these systems, often involves learning new services and confronting…

Computation and Language · Computer Science 2024-10-17 Yujie Feng , Bo Liu , Xiaoyu Dong , Zexin Lu , Li-Ming Zhan , Albert Y. S. Lam , Xiao-Ming Wu

Task-oriented dialogue systems are either modularized with separate dialogue state tracking (DST) and management steps or end-to-end trainable. In either case, the knowledge base (KB) plays an essential role in fulfilling user requests.…

Computation and Language · Computer Science 2020-09-30 Andrea Madotto , Samuel Cahyawijaya , Genta Indra Winata , Yan Xu , Zihan Liu , Zhaojiang Lin , Pascale Fung

Estimation of semantic similarity is an important research problem both in natural language processing and the natural language understanding, and that has tremendous application on various downstream tasks such as question answering,…

Computation and Language · Computer Science 2025-06-24 R. Prashanth

Bidirectional Encoder Representations from Transformers (BERT) has recently achieved state-of-the-art performance on a broad range of NLP tasks including sentence classification, machine translation, and question answering. The BERT model…

Computation and Language · Computer Science 2020-03-17 Zhiheng Huang , Peng Xu , Davis Liang , Ajay Mishra , Bing Xiang

Visual Dialog (VD) is a task where an agent answers a series of image-related questions based on a multi-round dialog history. However, previous VD methods often treat the entire dialog history as a simple text input, disregarding the…

Artificial Intelligence · Computer Science 2024-08-14 Wei Pang , Ruixue Duan , Jinfu Yang , Ning Li

Automatic speech recognition (ASR) allows transcribing the communications between air traffic controllers (ATCOs) and aircraft pilots. The transcriptions are used later to extract ATC named entities, e.g., aircraft callsigns. One common…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-18 Juan Zuluaga-Gomez , Seyyed Saeed Sarfjoo , Amrutha Prasad , Iuliia Nigmatulina , Petr Motlicek , Karel Ondrej , Oliver Ohneiser , Hartmut Helmke